-- Logs begin at Mon 2022-08-29 22:01:55 UTC, end at Mon 2022-08-29 23:04:38 UTC. -- Aug 29 22:30:55.258440 dv-cinder-854270-4-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 29 22:30:55.269061 dv-cinder-854270-4-smb devstack@keystone.service[88327]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 29 22:30:55.271067 dv-cinder-854270-4-smb devstack@keystone.service[88327]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 29 22:30:55 2022] *** Aug 29 22:30:55.271067 dv-cinder-854270-4-smb devstack@keystone.service[88327]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 29 22:30:55.271067 dv-cinder-854270-4-smb devstack@keystone.service[88327]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 29 22:30:55.271067 dv-cinder-854270-4-smb devstack@keystone.service[88327]: nodename: dv-cinder-854270-4-smb Aug 29 22:30:55.271067 dv-cinder-854270-4-smb devstack@keystone.service[88327]: machine: x86_64 Aug 29 22:30:55.271067 dv-cinder-854270-4-smb devstack@keystone.service[88327]: clock source: unix Aug 29 22:30:55.271067 dv-cinder-854270-4-smb devstack@keystone.service[88327]: pcre jit disabled Aug 29 22:30:55.271067 dv-cinder-854270-4-smb devstack@keystone.service[88327]: detected number of CPU cores: 4 Aug 29 22:30:55.271067 dv-cinder-854270-4-smb devstack@keystone.service[88327]: current working directory: / Aug 29 22:30:55.271067 dv-cinder-854270-4-smb devstack@keystone.service[88327]: detected binary path: /usr/bin/uwsgi-core Aug 29 22:30:55.271067 dv-cinder-854270-4-smb devstack@keystone.service[88327]: your processes number limit is 47680 Aug 29 22:30:55.271673 dv-cinder-854270-4-smb devstack@keystone.service[88327]: your memory page size is 4096 bytes Aug 29 22:30:55.271673 dv-cinder-854270-4-smb devstack@keystone.service[88327]: detected max file descriptor number: 2048 Aug 29 22:30:55.271673 dv-cinder-854270-4-smb devstack@keystone.service[88327]: lock engine: pthread robust mutexes Aug 29 22:30:55.271673 dv-cinder-854270-4-smb devstack@keystone.service[88327]: thunder lock: enabled Aug 29 22:30:55.271673 dv-cinder-854270-4-smb devstack@keystone.service[88327]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 29 22:30:55.271673 dv-cinder-854270-4-smb devstack@keystone.service[88327]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 29 22:30:55.310964 dv-cinder-854270-4-smb devstack@keystone.service[88327]: Python main interpreter initialized at 0x55b50853d9c0 Aug 29 22:30:55.311068 dv-cinder-854270-4-smb devstack@keystone.service[88327]: python threads support enabled Aug 29 22:30:55.311068 dv-cinder-854270-4-smb devstack@keystone.service[88327]: your server socket listen backlog is limited to 100 connections Aug 29 22:30:55.311068 dv-cinder-854270-4-smb devstack@keystone.service[88327]: your mercy for graceful operations on workers is 90 seconds Aug 29 22:30:55.311293 dv-cinder-854270-4-smb devstack@keystone.service[88327]: mapped 403077 bytes (393 KB) for 2 cores Aug 29 22:30:55.311399 dv-cinder-854270-4-smb devstack@keystone.service[88327]: *** Operational MODE: preforking *** Aug 29 22:30:55.311682 dv-cinder-854270-4-smb devstack@keystone.service[88327]: *** uWSGI is running in multiple interpreter mode *** Aug 29 22:30:55.311682 dv-cinder-854270-4-smb devstack@keystone.service[88327]: spawned uWSGI master process (pid: 88327) Aug 29 22:30:55.311876 dv-cinder-854270-4-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 29 22:30:55.313057 dv-cinder-854270-4-smb devstack@keystone.service[88327]: spawned uWSGI worker 1 (pid: 88338, cores: 1) Aug 29 22:30:55.313057 dv-cinder-854270-4-smb devstack@keystone.service[88327]: spawned uWSGI worker 2 (pid: 88339, cores: 1) Aug 29 22:30:55.313057 dv-cinder-854270-4-smb devstack@keystone.service[88327]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 29 22:30:59.649220 dv-cinder-854270-4-smb devstack@keystone.service[88338]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 22:30:59.649220 dv-cinder-854270-4-smb devstack@keystone.service[88338]: from cryptography.utils import int_from_bytes Aug 29 22:30:59.650048 dv-cinder-854270-4-smb devstack@keystone.service[88339]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 22:30:59.650048 dv-cinder-854270-4-smb devstack@keystone.service[88339]: from cryptography.utils import int_from_bytes Aug 29 22:30:59.650453 dv-cinder-854270-4-smb devstack@keystone.service[88338]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 22:30:59.650453 dv-cinder-854270-4-smb devstack@keystone.service[88338]: from cryptography.utils import int_from_bytes Aug 29 22:30:59.650565 dv-cinder-854270-4-smb devstack@keystone.service[88339]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 22:30:59.650565 dv-cinder-854270-4-smb devstack@keystone.service[88339]: from cryptography.utils import int_from_bytes Aug 29 22:30:59.701157 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 22:30:59.701399 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 22:30:59.701694 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] command line args: [] {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 22:30:59.701854 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 22:30:59.701958 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 22:30:59.701958 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ================================================================================ {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 22:30:59.702089 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 22:30:59.702210 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] command line args: [] {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 22:30:59.702314 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] admin_token = **** {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.702434 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 22:30:59.702511 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] config_dir = [] {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.702736 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.702823 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ================================================================================ {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 22:30:59.702883 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] config_source = [] {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.703037 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] debug = True {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.703128 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] admin_token = **** {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.703194 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.705476 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] config_dir = [] {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.705476 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.705619 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.705619 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.705721 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] config_source = [] {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.705776 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.705835 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] debug = True {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.705896 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.705961 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.706040 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] list_limit = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.706097 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.706155 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] log_config_append = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.706215 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.706284 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.706284 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] log_dir = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.706384 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.706442 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] log_file = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.706501 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.706556 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.706620 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] list_limit = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.706676 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.706730 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] log_config_append = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.706783 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.706841 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.706841 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] log_dir = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.706990 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.707090 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] log_file = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.707153 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.707153 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.707257 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.707318 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.707394 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.707471 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.707559 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.707635 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.707692 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.707692 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.707882 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.707983 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.708045 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.708100 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.708161 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.708161 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.708870 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.709087 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.709254 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.709445 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.710250 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.710250 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.710905 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.47/identity {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.710905 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] publish_errors = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.711343 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.711545 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.711715 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.711914 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.712103 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.712314 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.712576 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.712790 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.712790 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.712790 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] standard_threads = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.713574 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.47/identity {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.713793 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.713999 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] publish_errors = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.713999 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.714379 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.714379 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.714667 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.714823 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] use_journal = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.714959 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.715124 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] use_json = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.715124 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] use_stderr = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.715414 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.715542 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] use_syslog = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.715665 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.715789 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.716023 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] standard_threads = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.716182 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.716325 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.716452 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.716452 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.716685 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.716881 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.717028 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.717164 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.717289 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] use_journal = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.717289 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] use_json = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.717561 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.717685 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] use_stderr = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.717808 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.717942 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] use_syslog = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.718068 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.718193 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:30:59.718322 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.718448 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.718602 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.718804 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.718959 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.718959 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.719320 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.719487 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.719662 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.719802 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.719934 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.720060 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.720183 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.720308 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.720433 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.720565 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.720697 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.720839 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.721052 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.721199 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.721390 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.721537 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.721675 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.721877 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.721877 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.722136 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.722261 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.722463 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.722591 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.722715 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.722858 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.722985 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.723140 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.723140 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.723414 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.723564 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.723690 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.723814 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.723939 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.724075 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.724206 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.724331 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.724456 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.724581 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.724581 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.724901 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.725077 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.725345 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.726026 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.726215 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.726432 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.726432 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.726804 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.726933 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.726933 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.727167 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.727305 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.727443 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.727569 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.727693 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.727817 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.727945 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.728079 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.728203 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.728333 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.728463 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.728593 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.728719 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.728851 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.728975 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.729105 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.729240 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.729403 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.729403 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.729769 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.729904 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.730036 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.730161 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.730161 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.730395 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.730527 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.730651 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.730776 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.730906 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.731042 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.731042 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.731291 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.731417 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.731542 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.731665 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.731665 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.731898 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.732031 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.732031 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.732271 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.732402 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.732402 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.732642 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.734207 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.734207 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.734777 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.735039 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.735039 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.735615 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.735868 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.736100 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.736317 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.736415 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.736525 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.736525 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.736760 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.737088 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.737536 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.737738 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.737738 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.737943 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.738050 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.738050 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.738221 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.738343 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.738424 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.738484 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.738484 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.738595 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.738653 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.738764 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.738842 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.738901 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.738958 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.739071 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.739148 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.739207 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.739263 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.739379 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.739461 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.739461 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.739580 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.739692 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.739813 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.739875 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.739932 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.740055 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.740055 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.740186 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.740243 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.740243 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.740448 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.740535 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.740535 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.740653 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.740710 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.740710 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.740933 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.740933 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.741181 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.741342 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.741447 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.741542 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.741634 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.741740 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.741838 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.741930 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.742029 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.742123 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.742215 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.742316 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.742416 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.742510 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.742603 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.742700 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.742801 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.742969 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.743066 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.743158 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.743257 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.743358 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.743452 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] auth.external = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.743552 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.743767 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.743879 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.743975 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.744079 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.744174 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.744266 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.744379 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] auth.password = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.744480 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.744480 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.744653 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] auth.token = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.744745 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.744844 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.744844 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.745037 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.745131 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.745223 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.745449 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.745555 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.745663 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.745759 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.745852 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.745944 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.746042 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.746135 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.746235 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] credential.caching = True {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.746329 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.746427 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.746427 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.746644 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.746644 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.746831 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.746932 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.747035 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.747131 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.747232 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.747232 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.747411 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.747634 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.747778 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.747882 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.747977 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.748077 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.748172 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.748271 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.748373 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.748468 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.748562 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.748739 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.748836 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.748836 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.749017 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.749125 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.749226 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.749486 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.749609 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.749609 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] federation.caching = True {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.749878 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.750221 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.750221 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.750438 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.750545 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.750642 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] auth.external = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.750642 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.750862 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.750862 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.751074 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.751189 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.751310 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.751438 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.751555 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] auth.password = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.751670 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.751784 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] auth.token = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.751897 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.752010 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.752131 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.752245 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.752358 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.752477 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.752592 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] identity.caching = True {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.752704 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.752827 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.752827 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.753040 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.753153 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.753266 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.753391 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.753523 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.753638 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.753751 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] credential.caching = True {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.753865 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.753978 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.754090 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.754211 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.754211 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.754425 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.754547 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.754661 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.754779 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.754904 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.755017 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.755130 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.755251 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.755365 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.755477 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.755597 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.755597 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.755810 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.755925 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.756037 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.756229 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.756347 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.756484 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.756598 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.756710 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.756823 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.756955 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.757071 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.757184 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.757296 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.757452 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.757566 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] federation.caching = True {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.757692 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.757812 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.757924 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.758037 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.758150 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.758270 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.758392 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.758507 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.758620 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.758739 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.758854 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.758966 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.759089 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.759089 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.759305 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.759419 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.759532 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.759644 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.759765 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.759915 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.760035 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.760150 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.760263 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.760375 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.760496 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] identity.caching = True {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.760611 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.760723 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.760836 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.760948 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.761062 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.761184 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.761298 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.761428 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.761542 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.761655 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.761768 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.761893 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.762009 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.762122 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.762237 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.762350 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.762453 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.762562 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.762675 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.762788 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.762901 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.763014 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.763127 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.763249 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.763370 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.763484 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.763597 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.763709 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.763822 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.763950 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.764075 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.764075 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.user = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.764289 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.764402 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.764515 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.764636 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.764751 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.764869 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.764982 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.765095 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.765207 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.765388 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.765506 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.765506 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.765717 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.765830 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.765943 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.766071 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.766187 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.766300 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.766421 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.766535 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.766656 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.766656 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.766869 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.766982 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.767094 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.767207 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.767327 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.767443 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.767559 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.767559 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.767771 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.767884 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.768005 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.768119 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.768232 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.768344 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.768457 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.768570 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.768691 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.768811 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.768926 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.769038 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.769151 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.769269 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.769410 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.769528 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.769640 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.769753 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.769866 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.770017 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.770143 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.770258 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.770371 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.770484 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.770598 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.770711 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.770831 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.770946 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.771059 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.771171 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.771284 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.771397 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.771518 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.771634 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.771747 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.771860 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.771973 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.772662 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.772789 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.772904 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.user = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.773017 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.773131 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.773245 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.773412 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.773541 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] resource.caching = True {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.773657 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.773771 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.773884 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.773997 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.774110 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.774231 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.774346 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.774459 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.774571 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.774685 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.774835 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.774958 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.774958 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.775172 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.775285 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.775397 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.775397 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.775616 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.775731 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.775846 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] role.caching = True {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.775959 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.776072 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] role.driver = sql {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.776184 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.776306 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.776420 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.776533 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.776645 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.776758 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.776872 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.776997 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.777113 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.777226 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.777364 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.777481 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.777595 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.777721 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.777875 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.777998 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.778111 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.778225 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.778337 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.778460 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.778574 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.778687 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.778799 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.778912 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.779026 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.779211 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.779327 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.779441 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.779554 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.779554 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.779773 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.779888 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.780002 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.780147 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.780263 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.780376 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.780498 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.780612 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.780724 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.780837 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.780949 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.781063 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.781184 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.781305 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.781439 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.781552 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] resource.caching = True {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.781666 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.781778 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.781904 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.782020 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.782134 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.782247 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.782360 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.782360 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.782581 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.782696 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.782809 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.782922 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.783034 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.783154 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.783277 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.783392 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.783505 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.783618 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.783731 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.783845 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.783966 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] role.caching = True {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.784081 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] token.caching = True {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.784194 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] role.driver = sql {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.784314 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.784428 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.784541 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.784662 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.784777 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.784890 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.785003 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.785115 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.785229 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.785405 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.785523 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.785636 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.785749 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.785862 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.785974 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.786099 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.786214 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.786328 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.786441 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.786559 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.786674 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.786795 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.786909 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.787021 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.787134 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.787246 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.787360 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.787481 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.787596 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.787745 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.788383 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.788501 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.788598 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.788692 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.788825 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] database.connection = **** {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.788941 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.789053 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.789171 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.789286 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.789442 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.789570 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.789685 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.789798 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.789910 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.790022 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.790134 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.790298 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.790412 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.790527 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.790527 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.790738 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.790851 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.790971 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.791086 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.791198 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.791311 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.791423 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.791537 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.791659 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.791773 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.791885 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.791998 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.792110 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.792222 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.792343 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.792715 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.792827 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.792940 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.793052 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] token.caching = True {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.793164 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.793285 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.793424 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 22:30:59.793539 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.793539 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.793539 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.793539 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.793539 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.793539 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.793539 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.793539 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.794354 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.794354 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.794354 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.794671 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.794783 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.794931 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.795179 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.795450 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.795714 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] database.connection = **** {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.795964 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.796215 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.796459 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.796705 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.796945 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.797187 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.797454 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.797697 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.797948 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.798188 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.798436 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.798675 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.798927 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.799168 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.799416 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.799649 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.799892 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.800131 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:30:59.800292 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 22:30:59.822308 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:30:59.822539 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:30:59.822764 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:30:59.826027 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:30:59.826256 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:30:59.826488 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:30:59.831247 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:30:59.834869 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:30:59.859236 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:30:59.859466 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:30:59.860789 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:30:59.861023 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:30:59.914940 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:30:59.915804 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:30:59.965287 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:30:59.965544 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:30:59.966122 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:30:59.966359 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:31:00.122766 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:31:00.122997 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:31:00.123180 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:31:00.123274 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:31:00.123417 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:31:00.123502 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:31:00.123649 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:31:00.123741 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:31:00.123870 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:31:00.123952 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:31:00.124089 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:31:00.124303 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:31:00.147181 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:31:00.147364 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:31:00.147515 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:31:00.147636 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:31:00.147761 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:31:00.147883 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:31:00.148021 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:31:00.148140 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:31:00.148260 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:31:00.148380 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:31:00.148505 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:31:00.148638 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:31:00.148753 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:31:00.148874 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:31:00.159695 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:31:00.159800 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:31:00.173386 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:31:00.173525 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:31:00.173603 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:31:00.173767 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:31:00.173862 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:31:00.173994 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:31:00.174078 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:31:00.174210 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:31:00.174293 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:31:00.174425 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:31:00.174508 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:31:00.174642 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:31:00.174725 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:31:00.174862 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 22:31:00.191950 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.192162 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 29 22:31:00.192264 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.192472 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 29 22:31:00.192554 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.192696 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 29 22:31:00.192819 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.192974 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.193073 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 29 22:31:00.193243 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.193347 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.193558 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.193816 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.193917 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.194102 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.194244 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.203604 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.203717 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.203886 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.203997 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.204160 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.204242 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.204446 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.204530 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.211472 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:31:00.211566 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:31:00.214681 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:31:00.214967 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.215257 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.215468 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:31:00.215562 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.215757 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.215838 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.216048 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.216131 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.216332 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.216415 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.216609 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.216701 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.216873 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.216997 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.217144 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.217279 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.217449 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.217580 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.217727 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.218004 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.218279 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.241692 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.242078 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.243171 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:31:00.243459 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.243543 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:31:00.243825 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.248149 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:31:00.248361 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:31:00.248460 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.248648 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.248731 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.248933 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.255085 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:31:00.255376 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.255461 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:31:00.255697 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.259730 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:31:00.260015 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:31:00.260116 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.260208 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.260286 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.260499 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.260583 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.260790 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.260881 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.261069 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.261152 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.261394 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.261671 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.263190 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.263488 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.263782 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.279447 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.279713 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.279804 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.280018 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.283638 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:31:00.283906 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:31:00.286939 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.287083 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.287242 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.287384 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.292082 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:31:00.292932 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:31:00.295533 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:31:00.296111 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:31:00.298756 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.299063 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.299307 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.299388 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.299610 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.299694 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.299923 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.300011 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.300178 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.300273 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.300459 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.300846 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.316552 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:31:00.316848 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.317119 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.317410 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.317692 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:31:00.317988 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.318263 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.318541 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.324359 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.325320 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.325927 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.327009 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.327481 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.327762 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.328559 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.328840 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.330415 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:31:00.330708 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.331113 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.331405 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.331514 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:31:00.331708 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.331799 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.332083 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.332370 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.332665 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.342919 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:31:00.343206 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.343585 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.343873 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.344181 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.344263 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:31:00.344467 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.344561 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.344768 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.344852 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.345057 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.345372 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.345659 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.345961 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.361025 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:31:00.361843 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:31:00.363951 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:31:00.364857 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:31:00.367601 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.368537 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.369038 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.370015 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.370686 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:31:00.370974 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.371275 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.371507 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:31:00.371792 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.372078 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.377983 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.378659 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.379467 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:31:00.380139 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:31:00.382525 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.382825 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.383117 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.383204 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.383398 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.383485 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.383728 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.384012 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.391404 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:31:00.391697 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.391981 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.392071 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:31:00.392271 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.392557 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.399694 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:31:00.399980 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.400065 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 22:31:00.400264 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.400350 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.400543 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.400629 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.400820 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.400905 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.401103 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.401189 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.401404 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.401504 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.401687 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.401769 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.401963 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.402049 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.402247 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.402342 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.402527 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.402612 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.402802 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.402887 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.403066 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.403151 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.403333 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.403417 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.403620 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 22:31:00.438451 dv-cinder-854270-4-smb devstack@keystone.service[88339]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b50853d9c0 pid: 88339 (default app) Aug 29 22:31:00.438739 dv-cinder-854270-4-smb devstack@keystone.service[88338]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b50853d9c0 pid: 88338 (default app) Aug 29 22:31:00.441733 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091755e9-f767-4140-a205-bcbecae6f05b None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:00.442021 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091755e9-f767-4140-a205-bcbecae6f05b None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:00.442295 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091755e9-f767-4140-a205-bcbecae6f05b None None] PATH_INFO: `/v3` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:00.446974 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1/1] 10.222.0.47 () {50 vars in 791 bytes} [Mon Aug 29 22:31:00 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:07.072913 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662098f-3fe0-46f8-9c58-576cabbb7225 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:07.073490 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662098f-3fe0-46f8-9c58-576cabbb7225 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:07.073490 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662098f-3fe0-46f8-9c58-576cabbb7225 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:07.077817 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1/2] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:31:07 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:31:07.083240 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447bcfe-7dad-4141-9854-73a10217755d None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:07.083938 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447bcfe-7dad-4141-9854-73a10217755d None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:07.083938 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447bcfe-7dad-4141-9854-73a10217755d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:07.155836 dv-cinder-854270-4-smb devstack@keystone.service[88339]: INFO dbcounter [None req-d447bcfe-7dad-4141-9854-73a10217755d None None] Registered counter for database keystone Aug 29 22:31:07.176169 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG oslo_db.sqlalchemy.engines [None req-d447bcfe-7dad-4141-9854-73a10217755d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88339) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 22:31:07.183252 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writer thread running {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 22:31:07.371988 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG passlib.handlers.bcrypt [None req-d447bcfe-7dad-4141-9854-73a10217755d None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=88339) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 29 22:31:07.372289 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG passlib.handlers.bcrypt [None req-d447bcfe-7dad-4141-9854-73a10217755d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88339) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 29 22:31:07.435085 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-d447bcfe-7dad-4141-9854-73a10217755d None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:07.436724 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-d447bcfe-7dad-4141-9854-73a10217755d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:07.568810 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 2/3] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 487 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 29 22:31:08.029139 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e662098f-3fe0-46f8-9c58-576cabbb7225 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:08.100235 dv-cinder-854270-4-smb devstack@keystone.service[88338]: INFO dbcounter [None req-e662098f-3fe0-46f8-9c58-576cabbb7225 None None] Registered counter for database keystone Aug 29 22:31:08.121524 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG oslo_db.sqlalchemy.engines [None req-e662098f-3fe0-46f8-9c58-576cabbb7225 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88338) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 22:31:08.127736 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writer thread running {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 22:31:08.250510 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e662098f-3fe0-46f8-9c58-576cabbb7225 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:08.255564 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c6f3b-bca6-4512-aa4a-b25cfbbe6f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:08.256204 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c6f3b-bca6-4512-aa4a-b25cfbbe6f60 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:08.256480 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c6f3b-bca6-4512-aa4a-b25cfbbe6f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:08.256754 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c6f3b-bca6-4512-aa4a-b25cfbbe6f60 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:08.264969 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8c6f3b-bca6-4512-aa4a-b25cfbbe6f60 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:08.317912 dv-cinder-854270-4-smb devstack@keystone.service[88338]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ec8c6f3b-bca6-4512-aa4a-b25cfbbe6f60 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 29 22:31:08.318261 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8c6f3b-bca6-4512-aa4a-b25cfbbe6f60 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:08.328423 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 2/4] 10.222.0.47 () {58 vars in 1324 bytes} [Mon Aug 29 22:31:08 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 22:31:08.335114 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d447bcfe-7dad-4141-9854-73a10217755d None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:08.349502 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d447bcfe-7dad-4141-9854-73a10217755d None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:08.353884 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b57a0b-4f2c-41bd-b0cf-d4552d8f1f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:08.354974 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b57a0b-4f2c-41bd-b0cf-d4552d8f1f41 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:08.355258 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b57a0b-4f2c-41bd-b0cf-d4552d8f1f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:08.355531 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b57a0b-4f2c-41bd-b0cf-d4552d8f1f41 admin admin] PATH_INFO: `/v3/projects/8ad4679521624f7c95e5cca6de7bc365` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:08.357103 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b57a0b-4f2c-41bd-b0cf-d4552d8f1f41 admin admin] RBAC: Authorizing `identity:get_project(project_id=8ad4679521624f7c95e5cca6de7bc365)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:08.410134 dv-cinder-854270-4-smb devstack@keystone.service[88339]: WARNING keystone.common.rbac_enforcer.enforcer [None req-27b57a0b-4f2c-41bd-b0cf-d4552d8f1f41 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 29 22:31:08.410480 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b57a0b-4f2c-41bd-b0cf-d4552d8f1f41 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:08.415119 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 3/5] 10.222.0.47 () {56 vars in 1207 bytes} [Mon Aug 29 22:31:08 2022] GET /identity/v3/projects/8ad4679521624f7c95e5cca6de7bc365 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:31:10.343921 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a050d7b0-9ca3-4bc7-9576-80b2bb87fac6 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:10.345017 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a050d7b0-9ca3-4bc7-9576-80b2bb87fac6 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:10.345301 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a050d7b0-9ca3-4bc7-9576-80b2bb87fac6 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:10.350920 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 3/6] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:31:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:31:10.356591 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec6c43-fad8-4c9a-9bcf-df12847457f9 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:10.357015 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec6c43-fad8-4c9a-9bcf-df12847457f9 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:10.357153 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec6c43-fad8-4c9a-9bcf-df12847457f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:10.377105 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-2cec6c43-fad8-4c9a-9bcf-df12847457f9 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:10.378681 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-2cec6c43-fad8-4c9a-9bcf-df12847457f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:10.386514 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 4/7] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 29 22:31:10.656560 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a050d7b0-9ca3-4bc7-9576-80b2bb87fac6 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:10.669519 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a050d7b0-9ca3-4bc7-9576-80b2bb87fac6 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:10.673760 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72bbde2-f2d0-4231-813a-92b282d1a62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:10.674367 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72bbde2-f2d0-4231-813a-92b282d1a62f admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:10.674651 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72bbde2-f2d0-4231-813a-92b282d1a62f admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:10.674926 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72bbde2-f2d0-4231-813a-92b282d1a62f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:10.682835 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72bbde2-f2d0-4231-813a-92b282d1a62f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:10.684615 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72bbde2-f2d0-4231-813a-92b282d1a62f admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:10.693988 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 4/8] 10.222.0.47 () {58 vars in 1324 bytes} [Mon Aug 29 22:31:10 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 22:31:10.699465 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cec6c43-fad8-4c9a-9bcf-df12847457f9 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:10.709223 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cec6c43-fad8-4c9a-9bcf-df12847457f9 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:10.713582 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88fe657-432e-4b6b-abd0-8529f545963c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:10.714278 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88fe657-432e-4b6b-abd0-8529f545963c admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:10.714562 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88fe657-432e-4b6b-abd0-8529f545963c admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:10.714838 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88fe657-432e-4b6b-abd0-8529f545963c admin admin] PATH_INFO: `/v3/users/2844206a473948fca3069da17e9f5996` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:10.716157 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88fe657-432e-4b6b-abd0-8529f545963c admin admin] RBAC: Authorizing `identity:get_user(user_id=2844206a473948fca3069da17e9f5996)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:10.718036 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88fe657-432e-4b6b-abd0-8529f545963c admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:10.719560 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 5/9] 10.222.0.47 () {56 vars in 1198 bytes} [Mon Aug 29 22:31:10 2022] GET /identity/v3/users/2844206a473948fca3069da17e9f5996 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:12.679515 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaeb439-618b-4770-af54-68c1eeaade8d None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:12.680081 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaeb439-618b-4770-af54-68c1eeaade8d None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:12.680333 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaeb439-618b-4770-af54-68c1eeaade8d None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:12.681692 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 5/10] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:31:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:12.687098 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7fb51e-bd1e-4aac-af05-7fd30465a9a7 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:12.687501 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7fb51e-bd1e-4aac-af05-7fd30465a9a7 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:12.687659 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7fb51e-bd1e-4aac-af05-7fd30465a9a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:12.706392 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-3f7fb51e-bd1e-4aac-af05-7fd30465a9a7 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:12.708207 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-3f7fb51e-bd1e-4aac-af05-7fd30465a9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:12.716405 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a86cf-5f14-4c6e-a972-53fac15de6c8 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:12.716693 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a86cf-5f14-4c6e-a972-53fac15de6c8 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:12.716973 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a86cf-5f14-4c6e-a972-53fac15de6c8 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:12.718331 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 6/11] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:31:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:31:12.724008 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e3273b-ebb0-4d2d-a5a9-15ce5ef93abe None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:12.724287 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e3273b-ebb0-4d2d-a5a9-15ce5ef93abe None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:12.724559 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e3273b-ebb0-4d2d-a5a9-15ce5ef93abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:12.767368 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG passlib.handlers.bcrypt [None req-32e3273b-ebb0-4d2d-a5a9-15ce5ef93abe None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=88338) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 29 22:31:12.767766 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG passlib.handlers.bcrypt [None req-32e3273b-ebb0-4d2d-a5a9-15ce5ef93abe None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88338) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 29 22:31:12.792263 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 6/12] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:31:12.818038 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-32e3273b-ebb0-4d2d-a5a9-15ce5ef93abe None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:12.819667 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-32e3273b-ebb0-4d2d-a5a9-15ce5ef93abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:12.920733 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 7/13] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:31:13.070458 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7fb51e-bd1e-4aac-af05-7fd30465a9a7 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:13.096612 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:13.178818 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7fb51e-bd1e-4aac-af05-7fd30465a9a7 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:13.196951 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e3273b-ebb0-4d2d-a5a9-15ce5ef93abe None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:13.212964 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7747f8f-bd90-4a68-9a97-462adc7ca1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:13.213643 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7747f8f-bd90-4a68-9a97-462adc7ca1b4 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:13.213917 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7747f8f-bd90-4a68-9a97-462adc7ca1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:13.214190 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7747f8f-bd90-4a68-9a97-462adc7ca1b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:13.225881 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7747f8f-bd90-4a68-9a97-462adc7ca1b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:31:13.234742 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-b7747f8f-bd90-4a68-9a97-462adc7ca1b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:31:13.234742 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:13.234742 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:13.234742 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:13.234742 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:13.234742 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:13.234742 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:13.234742 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:13.234742 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:13.234742 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:13.234742 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:13.234742 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:13.234742 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:31:13.234742 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:31:13.234742 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:31:13.234742 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:31:13.235676 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:31:13.235676 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:31:13.235676 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:31:13.235676 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:31:13.235676 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:13.235676 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:13.235676 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:13.235676 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:13.235676 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:13.235676 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:13.235676 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:13.235676 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:13.235676 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:13.235676 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:13.235676 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:13.235676 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:13.236685 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:13.236685 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:13.236685 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:13.236685 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:13.236685 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:31:13.236685 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:31:13.236685 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:31:13.236685 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:31:13.236685 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:31:13.236685 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:31:13.236685 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:31:13.236685 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:31:13.236685 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 7/14] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Aug 29 22:31:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:13.241804 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7747f8f-bd90-4a68-9a97-462adc7ca1b4 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:13.303498 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e3273b-ebb0-4d2d-a5a9-15ce5ef93abe None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:13.307028 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:13.329008 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:13.343898 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d4bb8-a262-4e44-b727-266d921ce58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:13.344921 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d4bb8-a262-4e44-b727-266d921ce58b None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:13.345270 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d4bb8-a262-4e44-b727-266d921ce58b None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:13.345593 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d4bb8-a262-4e44-b727-266d921ce58b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:13.348883 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7747f8f-bd90-4a68-9a97-462adc7ca1b4 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:13.384134 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32b8e21-c259-4b45-8ccb-8ffa65b4f82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:13.384744 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b8e21-c259-4b45-8ccb-8ffa65b4f82f None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:13.385046 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b8e21-c259-4b45-8ccb-8ffa65b4f82f None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:13.385374 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b8e21-c259-4b45-8ccb-8ffa65b4f82f None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:13.386104 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32b8e21-c259-4b45-8ccb-8ffa65b4f82f None admin] RBAC: Adding query filter params (name=admin) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:13.386409 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32b8e21-c259-4b45-8ccb-8ffa65b4f82f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:13.387805 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32b8e21-c259-4b45-8ccb-8ffa65b4f82f None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:13.400694 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 8/15] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Aug 29 22:31:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:31:13.406034 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32b8e21-c259-4b45-8ccb-8ffa65b4f82f None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:13.416785 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08d4bb8-a262-4e44-b727-266d921ce58b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:13.418366 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08d4bb8-a262-4e44-b727-266d921ce58b None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:13.507050 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32b8e21-c259-4b45-8ccb-8ffa65b4f82f None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:13.518113 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 8/16] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Aug 29 22:31:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 22:31:13.524354 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d4bb8-a262-4e44-b727-266d921ce58b None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:13.527154 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:13.544860 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa7de6-9391-4f80-8567-09e48f225913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:13.545527 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa7de6-9391-4f80-8567-09e48f225913 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:13.545814 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa7de6-9391-4f80-8567-09e48f225913 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:13.546091 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa7de6-9391-4f80-8567-09e48f225913 None admin] PATH_INFO: `/v3/users/2844206a473948fca3069da17e9f5996` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:13.547674 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aa7de6-9391-4f80-8567-09e48f225913 None admin] RBAC: Authorizing `identity:get_user(user_id=2844206a473948fca3069da17e9f5996)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:13.549142 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aa7de6-9391-4f80-8567-09e48f225913 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:13.550777 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 9/17] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Aug 29 22:31:13 2022] GET /identity/v3/users/2844206a473948fca3069da17e9f5996 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:31:13.556216 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa7de6-9391-4f80-8567-09e48f225913 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:13.571498 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:13.625237 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d4bb8-a262-4e44-b727-266d921ce58b None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:13.659915 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6412cc70-5936-4a1d-8038-ea90922c3b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:13.660633 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa7de6-9391-4f80-8567-09e48f225913 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:13.660792 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412cc70-5936-4a1d-8038-ea90922c3b9a None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:13.661072 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412cc70-5936-4a1d-8038-ea90922c3b9a None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:13.661372 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412cc70-5936-4a1d-8038-ea90922c3b9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:13.680294 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6412cc70-5936-4a1d-8038-ea90922c3b9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:13.681812 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6412cc70-5936-4a1d-8038-ea90922c3b9a None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:13.695698 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee0ecb9-7d8c-40fd-bc7a-5a75ec95f6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:13.696332 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee0ecb9-7d8c-40fd-bc7a-5a75ec95f6de None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:13.696616 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee0ecb9-7d8c-40fd-bc7a-5a75ec95f6de None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:13.696891 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee0ecb9-7d8c-40fd-bc7a-5a75ec95f6de None admin] PATH_INFO: `/v3/domains/default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:13.698042 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee0ecb9-7d8c-40fd-bc7a-5a75ec95f6de None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:13.699477 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee0ecb9-7d8c-40fd-bc7a-5a75ec95f6de None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:13.700620 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-6412cc70-5936-4a1d-8038-ea90922c3b9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:31:13.700620 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:13.700620 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:13.700620 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:13.700620 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:13.700620 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:13.700620 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:13.700620 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:13.700620 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:13.700620 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:13.700620 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:13.700620 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:13.700620 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:31:13.700620 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:31:13.700620 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:31:13.700620 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:31:13.706381 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:13.706381 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:13.706381 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:13.706381 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:13.706381 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:13.706381 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:13.706381 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:13.706381 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:13.706381 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:13.706381 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:13.706381 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:13.706381 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:13.706381 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:13.706381 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:13.706381 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:13.706381 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:13.706381 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:31:13.708087 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:31:13.708087 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:31:13.708087 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:31:13.708265 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 10/18] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:31:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:31:13.708328 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 9/19] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:31:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:31:13.708328 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6412cc70-5936-4a1d-8038-ea90922c3b9a None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:13.708442 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee0ecb9-7d8c-40fd-bc7a-5a75ec95f6de None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:13.766430 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:13.791657 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:13.811732 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee0ecb9-7d8c-40fd-bc7a-5a75ec95f6de None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:13.814495 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6412cc70-5936-4a1d-8038-ea90922c3b9a None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:13.847572 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a699b-d7ca-4d6b-9bf4-0a2c520b4567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:13.848181 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a699b-d7ca-4d6b-9bf4-0a2c520b4567 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:13.848465 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a699b-d7ca-4d6b-9bf4-0a2c520b4567 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:13.848739 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a699b-d7ca-4d6b-9bf4-0a2c520b4567 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:13.849506 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a699b-d7ca-4d6b-9bf4-0a2c520b4567 None admin] RBAC: Adding query filter params (role.id=d00eabaec96a4956aaec2c37a5819c25, scope.domain.id=default, user.id=2844206a473948fca3069da17e9f5996) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:13.849814 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a699b-d7ca-4d6b-9bf4-0a2c520b4567 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:13.850110 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72197087-e220-4752-8256-c05f27d1309d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:13.850723 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72197087-e220-4752-8256-c05f27d1309d None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:13.851007 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72197087-e220-4752-8256-c05f27d1309d None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:13.851255 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a699b-d7ca-4d6b-9bf4-0a2c520b4567 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:13.851345 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72197087-e220-4752-8256-c05f27d1309d None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:13.851916 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72197087-e220-4752-8256-c05f27d1309d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:13.852223 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72197087-e220-4752-8256-c05f27d1309d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:13.853661 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72197087-e220-4752-8256-c05f27d1309d None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:13.858074 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 11/20] 10.222.0.47 () {56 vars in 1322 bytes} [Mon Aug 29 22:31:13 2022] GET /identity/v3/role_assignments?user.id=2844206a473948fca3069da17e9f5996&scope.domain.id=default&role.id=d00eabaec96a4956aaec2c37a5819c25 => generated 233 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:31:13.874321 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 10/21] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:31:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:31:16.043335 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1785c85-45d6-4f52-84ef-109cdeb36d4a None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:16.043859 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1785c85-45d6-4f52-84ef-109cdeb36d4a None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:16.043859 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1785c85-45d6-4f52-84ef-109cdeb36d4a None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:16.045210 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 12/22] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:31:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:16.051487 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49887968-b14d-4191-93d0-e7d2ba576f11 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:16.052399 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49887968-b14d-4191-93d0-e7d2ba576f11 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:16.052883 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49887968-b14d-4191-93d0-e7d2ba576f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:16.082435 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-49887968-b14d-4191-93d0-e7d2ba576f11 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:16.084023 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-49887968-b14d-4191-93d0-e7d2ba576f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:16.123744 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3cc866-094a-433c-9598-b02f94c0e2fb None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:16.124380 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3cc866-094a-433c-9598-b02f94c0e2fb None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:16.124860 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3cc866-094a-433c-9598-b02f94c0e2fb None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:16.126456 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 13/23] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:31:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:31:16.132158 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8940bf90-4990-4a2c-bd68-0ffc3432e8c0 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:16.132696 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8940bf90-4990-4a2c-bd68-0ffc3432e8c0 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:16.133210 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8940bf90-4990-4a2c-bd68-0ffc3432e8c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:16.170361 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-8940bf90-4990-4a2c-bd68-0ffc3432e8c0 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:16.176093 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-8940bf90-4990-4a2c-bd68-0ffc3432e8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:16.262673 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 11/24] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:31:16.270934 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 14/25] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:31:16.294283 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3173a-8d68-442f-ab6a-7ed0a51b1b6c None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:16.294861 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3173a-8d68-442f-ab6a-7ed0a51b1b6c None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:16.295348 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3173a-8d68-442f-ab6a-7ed0a51b1b6c None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:16.296883 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 12/26] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:31:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:16.304350 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad8fa84-03db-42d2-b2c7-4c6d045b078c None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:16.304350 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad8fa84-03db-42d2-b2c7-4c6d045b078c None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:16.304350 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad8fa84-03db-42d2-b2c7-4c6d045b078c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:16.328762 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-7ad8fa84-03db-42d2-b2c7-4c6d045b078c None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:16.334010 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-7ad8fa84-03db-42d2-b2c7-4c6d045b078c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:16.431449 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 15/27] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:31:16.709415 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3173a-8d68-442f-ab6a-7ed0a51b1b6c None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:16.747157 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad8fa84-03db-42d2-b2c7-4c6d045b078c None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:16.752166 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:16.801650 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:16.893004 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad8fa84-03db-42d2-b2c7-4c6d045b078c None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:16.931376 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8044a6-d80c-4431-baff-0aacd10f0f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:16.932277 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8044a6-d80c-4431-baff-0aacd10f0f1c None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:16.932702 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8044a6-d80c-4431-baff-0aacd10f0f1c None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:16.933108 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8044a6-d80c-4431-baff-0aacd10f0f1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:16.944958 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8044a6-d80c-4431-baff-0aacd10f0f1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:16.946722 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8044a6-d80c-4431-baff-0aacd10f0f1c None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:16.963394 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-8a8044a6-d80c-4431-baff-0aacd10f0f1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:31:16.963394 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:16.963394 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:16.963394 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:16.963394 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:16.963394 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:16.963394 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:16.963394 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:16.963394 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:16.963394 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:16.963394 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:16.963394 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:16.963394 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:31:16.963394 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:31:16.963394 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:31:16.963394 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:31:16.964232 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:16.964232 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:16.964232 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:16.964232 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:16.964232 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:16.964232 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:16.964232 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:16.964232 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:16.964232 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:16.964232 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:16.964232 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:16.964232 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:16.964232 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:16.964232 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:16.964232 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:16.964232 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:16.964232 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:31:16.965012 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:31:16.965012 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:31:16.965012 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:31:16.967011 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 16/28] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:31:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:31:16.967678 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3173a-8d68-442f-ab6a-7ed0a51b1b6c None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:16.968209 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8044a6-d80c-4431-baff-0aacd10f0f1c None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:17.014382 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae905b86-4859-4e77-a6d1-db77e1f37f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:17.015291 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae905b86-4859-4e77-a6d1-db77e1f37f56 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:17.015768 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae905b86-4859-4e77-a6d1-db77e1f37f56 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:17.016559 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae905b86-4859-4e77-a6d1-db77e1f37f56 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:17.033118 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae905b86-4859-4e77-a6d1-db77e1f37f56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:31:17.043670 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-ae905b86-4859-4e77-a6d1-db77e1f37f56 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:31:17.043670 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:17.043670 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:17.043670 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:17.043670 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:17.043670 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:17.043670 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:17.043670 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:17.043670 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:17.043670 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:17.043670 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:17.043670 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:17.043670 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:31:17.043670 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:31:17.043670 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:31:17.043670 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:31:17.044725 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:31:17.044725 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:31:17.044725 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:31:17.044725 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:31:17.044725 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:17.044725 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:17.044725 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:17.044725 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:17.044725 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:17.044725 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:17.044725 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:17.044725 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:17.044725 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:17.044725 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:17.044725 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:17.044725 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:17.045649 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:17.045649 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:17.045649 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:17.045649 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:17.045649 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:31:17.045649 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:31:17.045649 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:31:17.045649 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:31:17.045649 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:31:17.045649 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:31:17.045649 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:31:17.045649 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:31:17.046965 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 13/29] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Aug 29 22:31:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:17.052232 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae905b86-4859-4e77-a6d1-db77e1f37f56 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:17.062610 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:17.115477 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8044a6-d80c-4431-baff-0aacd10f0f1c None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:17.153693 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74784491-c29a-4861-99a6-7e066b9f8fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:17.154373 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74784491-c29a-4861-99a6-7e066b9f8fdd None admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:17.154945 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74784491-c29a-4861-99a6-7e066b9f8fdd None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:17.154945 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74784491-c29a-4861-99a6-7e066b9f8fdd None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:17.155572 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74784491-c29a-4861-99a6-7e066b9f8fdd None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:17.157043 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74784491-c29a-4861-99a6-7e066b9f8fdd None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:17.183781 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae905b86-4859-4e77-a6d1-db77e1f37f56 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:17.192528 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:17.222894 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8496e8a4-1013-4023-ac43-74bd0d29b0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:17.223596 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496e8a4-1013-4023-ac43-74bd0d29b0ba None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:17.223973 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496e8a4-1013-4023-ac43-74bd0d29b0ba None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:17.224368 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496e8a4-1013-4023-ac43-74bd0d29b0ba None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:17.225131 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8496e8a4-1013-4023-ac43-74bd0d29b0ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:17.225590 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8496e8a4-1013-4023-ac43-74bd0d29b0ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:17.227202 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8496e8a4-1013-4023-ac43-74bd0d29b0ba None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:17.239477 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 14/30] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:31:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:17.240938 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df2e92-c7ce-4dca-ba85-c062c8eb9882 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:17.241322 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df2e92-c7ce-4dca-ba85-c062c8eb9882 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:17.241716 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df2e92-c7ce-4dca-ba85-c062c8eb9882 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:17.243218 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 15/31] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:31:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:17.247182 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2df2e92-c7ce-4dca-ba85-c062c8eb9882 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:17.311874 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 17/32] 10.222.0.47 () {60 vars in 1131 bytes} [Mon Aug 29 22:31:16 2022] POST /identity/v3/roles => generated 219 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:31:17.313062 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74784491-c29a-4861-99a6-7e066b9f8fdd None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:17.375218 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2df2e92-c7ce-4dca-ba85-c062c8eb9882 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:17.415922 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385328cb-c962-43b9-8b2d-00e8c8067099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:17.416852 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385328cb-c962-43b9-8b2d-00e8c8067099 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:17.417111 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385328cb-c962-43b9-8b2d-00e8c8067099 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:17.417495 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385328cb-c962-43b9-8b2d-00e8c8067099 None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:17.418700 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385328cb-c962-43b9-8b2d-00e8c8067099 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:17.418700 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385328cb-c962-43b9-8b2d-00e8c8067099 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:17.420372 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385328cb-c962-43b9-8b2d-00e8c8067099 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:17.436955 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 16/33] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Aug 29 22:31:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:17.443093 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dff5e7-9ced-4fb3-ad30-26ee2ef0a978 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:17.443661 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dff5e7-9ced-4fb3-ad30-26ee2ef0a978 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:17.444408 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dff5e7-9ced-4fb3-ad30-26ee2ef0a978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:17.446370 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74784491-c29a-4861-99a6-7e066b9f8fdd None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:17.467777 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-70dff5e7-9ced-4fb3-ad30-26ee2ef0a978 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:17.468723 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:17.472166 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-70dff5e7-9ced-4fb3-ad30-26ee2ef0a978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:17.500914 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1efa33c-a47c-47d5-85e3-586eda3d7a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:17.502244 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1efa33c-a47c-47d5-85e3-586eda3d7a72 None admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:17.504721 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1efa33c-a47c-47d5-85e3-586eda3d7a72 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:17.506084 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1efa33c-a47c-47d5-85e3-586eda3d7a72 None admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:17.507020 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1efa33c-a47c-47d5-85e3-586eda3d7a72 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:17.512411 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1efa33c-a47c-47d5-85e3-586eda3d7a72 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:17.523859 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:17.566770 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 18/34] 10.222.0.47 () {60 vars in 1141 bytes} [Mon Aug 29 22:31:17 2022] POST /identity/v3/projects => generated 301 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:31:17.570663 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1efa33c-a47c-47d5-85e3-586eda3d7a72 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:17.603591 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 17/35] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:31:17.705136 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1efa33c-a47c-47d5-85e3-586eda3d7a72 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:17.745319 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e6e70b-e0b0-447d-b063-8f49154aef79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:17.745976 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e6e70b-e0b0-447d-b063-8f49154aef79 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:17.746262 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e6e70b-e0b0-447d-b063-8f49154aef79 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:17.746539 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e6e70b-e0b0-447d-b063-8f49154aef79 None admin] PATH_INFO: `/v3/users/2844206a473948fca3069da17e9f5996` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:17.747761 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e6e70b-e0b0-447d-b063-8f49154aef79 None admin] RBAC: Authorizing `identity:get_user(user_id=2844206a473948fca3069da17e9f5996)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:17.749240 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e6e70b-e0b0-447d-b063-8f49154aef79 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:17.750866 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 19/36] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Aug 29 22:31:17 2022] GET /identity/v3/users/2844206a473948fca3069da17e9f5996 => generated 247 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:17.757204 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dff5e7-9ced-4fb3-ad30-26ee2ef0a978 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:17.844517 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd177498-1b2c-41fc-8d10-34cab9e08472 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:17.844827 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd177498-1b2c-41fc-8d10-34cab9e08472 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:17.845082 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd177498-1b2c-41fc-8d10-34cab9e08472 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:17.847266 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 20/37] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:31:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:17.852723 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb0a94-fb41-4053-b9ab-12195ba56c90 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:17.853014 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb0a94-fb41-4053-b9ab-12195ba56c90 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:17.853353 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb0a94-fb41-4053-b9ab-12195ba56c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:17.874190 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-0ffb0a94-fb41-4053-b9ab-12195ba56c90 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:17.875826 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-0ffb0a94-fb41-4053-b9ab-12195ba56c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:17.882053 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dff5e7-9ced-4fb3-ad30-26ee2ef0a978 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:17.912271 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:17.931013 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c929ce-6aeb-43f9-9a09-60479ec15fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:17.931772 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c929ce-6aeb-43f9-9a09-60479ec15fc6 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:17.932052 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c929ce-6aeb-43f9-9a09-60479ec15fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:17.932326 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c929ce-6aeb-43f9-9a09-60479ec15fc6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:17.933853 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c929ce-6aeb-43f9-9a09-60479ec15fc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:17.935296 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c929ce-6aeb-43f9-9a09-60479ec15fc6 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:17.936882 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 18/38] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:31:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:17.938017 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac3dc0-7709-44f7-9658-3fc4f6e4c5b2 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:17.938295 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac3dc0-7709-44f7-9658-3fc4f6e4c5b2 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:17.938562 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac3dc0-7709-44f7-9658-3fc4f6e4c5b2 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:17.939781 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 19/39] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:31:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:17.940468 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac3dc0-7709-44f7-9658-3fc4f6e4c5b2 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:17.955875 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 21/40] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:31:17.960265 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffb0a94-fb41-4053-b9ab-12195ba56c90 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:17.969419 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:18.059369 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac3dc0-7709-44f7-9658-3fc4f6e4c5b2 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:18.097601 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ed221-cb3c-449c-b556-6e73a73edcac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:18.098232 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ed221-cb3c-449c-b556-6e73a73edcac None admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:18.098512 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ed221-cb3c-449c-b556-6e73a73edcac None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:18.098783 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ed221-cb3c-449c-b556-6e73a73edcac None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:18.099465 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8ed221-cb3c-449c-b556-6e73a73edcac None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:18.100874 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8ed221-cb3c-449c-b556-6e73a73edcac None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:18.175970 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffb0a94-fb41-4053-b9ab-12195ba56c90 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:18.211110 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ac476-c1c0-4c1d-ac0b-10e24acb5907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:18.211870 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ac476-c1c0-4c1d-ac0b-10e24acb5907 None admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:18.212147 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ac476-c1c0-4c1d-ac0b-10e24acb5907 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:18.212450 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ac476-c1c0-4c1d-ac0b-10e24acb5907 None admin] PATH_INFO: `/v3/domains/default/users/2844206a473948fca3069da17e9f5996/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:18.214399 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8ac476-c1c0-4c1d-ac0b-10e24acb5907 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=2844206a473948fca3069da17e9f5996, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:18.215847 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8ac476-c1c0-4c1d-ac0b-10e24acb5907 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:18.237554 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 20/41] 10.222.0.47 () {60 vars in 1131 bytes} [Mon Aug 29 22:31:17 2022] POST /identity/v3/roles => generated 225 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:31:18.237554 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a19c7f1-99a4-451f-8f76-70df43815d25 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:18.237554 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a19c7f1-99a4-451f-8f76-70df43815d25 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:18.237554 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a19c7f1-99a4-451f-8f76-70df43815d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:18.238020 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 22/42] 10.222.0.47 () {58 vars in 1361 bytes} [Mon Aug 29 22:31:17 2022] PUT /identity/v3/domains/default/users/2844206a473948fca3069da17e9f5996/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:31:18.238020 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ac476-c1c0-4c1d-ac0b-10e24acb5907 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:18.270836 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-0a19c7f1-99a4-451f-8f76-70df43815d25 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:18.273563 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-0a19c7f1-99a4-451f-8f76-70df43815d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:18.274710 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:18.374690 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 21/43] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:31:18.385058 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ac476-c1c0-4c1d-ac0b-10e24acb5907 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:18.423778 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8fa011-9122-45d1-995e-b27c6aa5306a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:18.425128 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8fa011-9122-45d1-995e-b27c6aa5306a None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:18.425656 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8fa011-9122-45d1-995e-b27c6aa5306a None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:18.425932 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8fa011-9122-45d1-995e-b27c6aa5306a None admin] PATH_INFO: `/v3/domains/default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:18.427096 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8fa011-9122-45d1-995e-b27c6aa5306a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:18.428571 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8fa011-9122-45d1-995e-b27c6aa5306a None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:18.430220 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 23/44] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:31:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:31:18.436166 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a19c7f1-99a4-451f-8f76-70df43815d25 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:18.461218 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:18.550089 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a19c7f1-99a4-451f-8f76-70df43815d25 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:18.585049 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc8e34-1db1-4f0f-a9f8-74c14b157028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:18.585699 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc8e34-1db1-4f0f-a9f8-74c14b157028 None admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:18.585983 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc8e34-1db1-4f0f-a9f8-74c14b157028 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:18.586260 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc8e34-1db1-4f0f-a9f8-74c14b157028 None admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:18.586924 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abc8e34-1db1-4f0f-a9f8-74c14b157028 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:18.588515 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abc8e34-1db1-4f0f-a9f8-74c14b157028 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:18.618913 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 22/45] 10.222.0.47 () {60 vars in 1141 bytes} [Mon Aug 29 22:31:18 2022] POST /identity/v3/projects => generated 312 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:31:18.651055 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8fa011-9122-45d1-995e-b27c6aa5306a None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:18.760783 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:18.770593 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8fa011-9122-45d1-995e-b27c6aa5306a None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:18.806012 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df53e93-10eb-45f6-9e17-4fbe61147401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:18.806633 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df53e93-10eb-45f6-9e17-4fbe61147401 None admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:18.806920 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df53e93-10eb-45f6-9e17-4fbe61147401 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:18.807195 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df53e93-10eb-45f6-9e17-4fbe61147401 None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:18.807879 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df53e93-10eb-45f6-9e17-4fbe61147401 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:18.809275 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df53e93-10eb-45f6-9e17-4fbe61147401 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:18.824951 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 24/46] 10.222.0.47 () {60 vars in 1131 bytes} [Mon Aug 29 22:31:18 2022] POST /identity/v3/roles => generated 223 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:31:20.205292 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e414b9a-cf2b-4ab6-98b6-ad5714efc977 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:20.205933 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e414b9a-cf2b-4ab6-98b6-ad5714efc977 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:20.205933 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e414b9a-cf2b-4ab6-98b6-ad5714efc977 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:20.207219 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 23/47] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:31:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:20.212701 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522818dc-9959-4f0a-b556-45e9023f8fc2 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:20.213102 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522818dc-9959-4f0a-b556-45e9023f8fc2 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:20.213255 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522818dc-9959-4f0a-b556-45e9023f8fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:20.232141 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-522818dc-9959-4f0a-b556-45e9023f8fc2 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:20.233366 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-522818dc-9959-4f0a-b556-45e9023f8fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:20.305989 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 25/48] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:31:20.567233 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97e9ee-2f7c-486b-a794-df69ece60591 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:20.567521 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97e9ee-2f7c-486b-a794-df69ece60591 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:20.567799 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97e9ee-2f7c-486b-a794-df69ece60591 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:20.569131 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 24/49] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:31:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:20.574337 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef55b409-b417-4aad-ae60-16aadcc1921a None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:20.574696 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef55b409-b417-4aad-ae60-16aadcc1921a None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:20.575042 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef55b409-b417-4aad-ae60-16aadcc1921a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:20.578813 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97e9ee-2f7c-486b-a794-df69ece60591 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:20.593277 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-ef55b409-b417-4aad-ae60-16aadcc1921a None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:20.594488 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-ef55b409-b417-4aad-ae60-16aadcc1921a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:20.647914 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:20.664192 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 26/50] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:31:20.684672 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97e9ee-2f7c-486b-a794-df69ece60591 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:20.717887 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f00aaa1-31b6-45aa-9589-9654b7cb6294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:20.718513 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00aaa1-31b6-45aa-9589-9654b7cb6294 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:20.718794 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00aaa1-31b6-45aa-9589-9654b7cb6294 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:20.719071 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00aaa1-31b6-45aa-9589-9654b7cb6294 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:20.730117 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f00aaa1-31b6-45aa-9589-9654b7cb6294 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:31:20.735024 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-9f00aaa1-31b6-45aa-9589-9654b7cb6294 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:31:20.735024 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:20.735024 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:20.735024 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:20.735024 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:20.735024 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:20.735024 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:20.735024 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:20.735024 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:20.735024 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:20.735024 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:20.735024 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:20.735024 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:31:20.735024 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:31:20.735024 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:31:20.735024 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:31:20.735880 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:31:20.735880 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:31:20.735880 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:31:20.735880 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:31:20.735880 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:20.735880 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:20.735880 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:20.735880 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:20.735880 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:20.735880 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:20.735880 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:20.735880 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:20.735880 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:20.735880 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:20.735880 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:20.735880 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:20.736937 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:20.736937 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:20.736937 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:20.736937 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:20.736937 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:31:20.736937 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:31:20.736937 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:31:20.736937 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:31:20.736937 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:31:20.736937 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:31:20.736937 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:31:20.736937 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:31:20.736937 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 25/51] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Aug 29 22:31:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:31:20.742225 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef55b409-b417-4aad-ae60-16aadcc1921a None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:20.757626 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:20.844036 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef55b409-b417-4aad-ae60-16aadcc1921a None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:20.877825 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a5aeb-b203-4ec5-bdf9-f828c2db3e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:20.878431 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a5aeb-b203-4ec5-bdf9-f828c2db3e1c None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:20.878715 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a5aeb-b203-4ec5-bdf9-f828c2db3e1c None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:20.878992 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a5aeb-b203-4ec5-bdf9-f828c2db3e1c None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:20.879654 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14a5aeb-b203-4ec5-bdf9-f828c2db3e1c None admin] RBAC: Adding query filter params (name=admin) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:20.879960 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14a5aeb-b203-4ec5-bdf9-f828c2db3e1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:20.881353 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14a5aeb-b203-4ec5-bdf9-f828c2db3e1c None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:20.889428 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 27/52] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Aug 29 22:31:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:20.895662 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f00aaa1-31b6-45aa-9589-9654b7cb6294 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:20.930693 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a5aeb-b203-4ec5-bdf9-f828c2db3e1c None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:20.996776 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f00aaa1-31b6-45aa-9589-9654b7cb6294 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:21.008561 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:21.025757 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:21.034076 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a5aeb-b203-4ec5-bdf9-f828c2db3e1c None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:21.035422 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bc1b24-d78a-47cb-9822-c8670882f68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:21.036223 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc1b24-d78a-47cb-9822-c8670882f68e None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:21.037322 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc1b24-d78a-47cb-9822-c8670882f68e None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:21.037649 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc1b24-d78a-47cb-9822-c8670882f68e None admin] PATH_INFO: `/v3/users/2844206a473948fca3069da17e9f5996` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:21.039323 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bc1b24-d78a-47cb-9822-c8670882f68e None admin] RBAC: Authorizing `identity:get_user(user_id=2844206a473948fca3069da17e9f5996)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:21.040800 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bc1b24-d78a-47cb-9822-c8670882f68e None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:21.042443 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 26/53] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Aug 29 22:31:20 2022] GET /identity/v3/users/2844206a473948fca3069da17e9f5996 => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:21.047927 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bc1b24-d78a-47cb-9822-c8670882f68e None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:21.071323 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f089b8fe-4256-4a31-b628-92bd7c32fd3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:21.071960 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089b8fe-4256-4a31-b628-92bd7c32fd3e None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:21.072243 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089b8fe-4256-4a31-b628-92bd7c32fd3e None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:21.072514 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089b8fe-4256-4a31-b628-92bd7c32fd3e None admin] PATH_INFO: `/v3/domains/default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:21.073672 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f089b8fe-4256-4a31-b628-92bd7c32fd3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:21.075122 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f089b8fe-4256-4a31-b628-92bd7c32fd3e None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:21.076684 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 28/54] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:31:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:31:21.082778 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f089b8fe-4256-4a31-b628-92bd7c32fd3e None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:21.150895 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bc1b24-d78a-47cb-9822-c8670882f68e None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:21.182293 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f089b8fe-4256-4a31-b628-92bd7c32fd3e None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:21.184381 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb26b410-8530-4880-a78e-8d129df83ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:21.185023 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26b410-8530-4880-a78e-8d129df83ed2 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:21.185303 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26b410-8530-4880-a78e-8d129df83ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:21.185610 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26b410-8530-4880-a78e-8d129df83ed2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:21.186732 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb26b410-8530-4880-a78e-8d129df83ed2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:21.188181 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb26b410-8530-4880-a78e-8d129df83ed2 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:21.190542 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 27/55] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:31:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:31:21.196234 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb26b410-8530-4880-a78e-8d129df83ed2 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:21.217175 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4240830-866e-4adc-87a1-d2030775edab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:21.217814 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4240830-866e-4adc-87a1-d2030775edab None admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:21.218095 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4240830-866e-4adc-87a1-d2030775edab None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:21.218370 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4240830-866e-4adc-87a1-d2030775edab None admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:21.219048 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4240830-866e-4adc-87a1-d2030775edab None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:21.220556 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4240830-866e-4adc-87a1-d2030775edab None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:21.236065 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:21.248686 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 29/56] 10.222.0.47 () {60 vars in 1140 bytes} [Mon Aug 29 22:31:21 2022] POST /identity/v3/projects => generated 298 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:31:21.262863 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:21.311031 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb26b410-8530-4880-a78e-8d129df83ed2 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:21.348203 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651c2b19-c9cc-4343-8970-9144477e33f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:21.348833 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c2b19-c9cc-4343-8970-9144477e33f0 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:21.349117 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c2b19-c9cc-4343-8970-9144477e33f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:21.349421 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c2b19-c9cc-4343-8970-9144477e33f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:21.350169 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651c2b19-c9cc-4343-8970-9144477e33f0 None admin] RBAC: Adding query filter params (role.id=d00eabaec96a4956aaec2c37a5819c25, scope.domain.id=default, user.id=2844206a473948fca3069da17e9f5996) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:21.350478 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651c2b19-c9cc-4343-8970-9144477e33f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:21.351958 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651c2b19-c9cc-4343-8970-9144477e33f0 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:21.362237 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 28/57] 10.222.0.47 () {56 vars in 1322 bytes} [Mon Aug 29 22:31:21 2022] GET /identity/v3/role_assignments?user.id=2844206a473948fca3069da17e9f5996&scope.domain.id=default&role.id=d00eabaec96a4956aaec2c37a5819c25 => generated 530 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:31:23.178683 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f6b066-3342-426e-9edb-fbbca3470bfe None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:23.179196 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f6b066-3342-426e-9edb-fbbca3470bfe None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:23.179277 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f6b066-3342-426e-9edb-fbbca3470bfe None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:23.180588 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 30/58] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:31:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:23.185771 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4491f-7fb0-4094-9ece-dfecc94e000d None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:23.186189 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4491f-7fb0-4094-9ece-dfecc94e000d None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:23.186322 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4491f-7fb0-4094-9ece-dfecc94e000d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:23.324956 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-c6f4491f-7fb0-4094-9ece-dfecc94e000d None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:23.326205 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-c6f4491f-7fb0-4094-9ece-dfecc94e000d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:23.391327 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 29/59] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:31:23.664753 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f6b066-3342-426e-9edb-fbbca3470bfe None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:23.765686 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f6b066-3342-426e-9edb-fbbca3470bfe None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:23.798833 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a5bd7a-135a-432a-9fa7-02e41a9ff6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:23.799458 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5bd7a-135a-432a-9fa7-02e41a9ff6a8 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:23.799813 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5bd7a-135a-432a-9fa7-02e41a9ff6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:23.800104 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5bd7a-135a-432a-9fa7-02e41a9ff6a8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:23.801245 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a5bd7a-135a-432a-9fa7-02e41a9ff6a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:23.802743 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a5bd7a-135a-432a-9fa7-02e41a9ff6a8 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:23.804304 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 31/60] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:31:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:23.810012 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f4491f-7fb0-4094-9ece-dfecc94e000d None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:23.867089 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:23.908443 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f4491f-7fb0-4094-9ece-dfecc94e000d None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:23.942230 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950c2a2c-b25e-4e32-a50d-e921c16ecd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:23.942775 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c2a2c-b25e-4e32-a50d-e921c16ecd80 None admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:23.943069 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c2a2c-b25e-4e32-a50d-e921c16ecd80 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:23.943325 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c2a2c-b25e-4e32-a50d-e921c16ecd80 None admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:23.943974 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950c2a2c-b25e-4e32-a50d-e921c16ecd80 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:23.945454 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950c2a2c-b25e-4e32-a50d-e921c16ecd80 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:23.971439 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 30/61] 10.222.0.47 () {60 vars in 1132 bytes} [Mon Aug 29 22:31:23 2022] POST /identity/v3/users => generated 275 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:31:27.020150 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aacb642-a6dd-41eb-afe5-9e00f87af0b8 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:27.020999 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aacb642-a6dd-41eb-afe5-9e00f87af0b8 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:27.021474 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aacb642-a6dd-41eb-afe5-9e00f87af0b8 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:27.023330 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 32/62] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:31:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:27.029070 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f400a6f-0d61-456a-a015-3137c84203a1 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:27.029533 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f400a6f-0d61-456a-a015-3137c84203a1 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:27.029678 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f400a6f-0d61-456a-a015-3137c84203a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:27.059017 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-4f400a6f-0d61-456a-a015-3137c84203a1 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:27.060243 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-4f400a6f-0d61-456a-a015-3137c84203a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:27.151959 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 31/63] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:31:27.160496 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e27e2-3949-4f35-98e4-d559f4bfea8c None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:27.160962 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e27e2-3949-4f35-98e4-d559f4bfea8c None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:27.161414 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e27e2-3949-4f35-98e4-d559f4bfea8c None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:27.163425 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 33/64] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:31:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:27.168858 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c745b32f-668c-46bc-9f32-79e4e1e4a04a None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:27.169315 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c745b32f-668c-46bc-9f32-79e4e1e4a04a None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:27.169778 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c745b32f-668c-46bc-9f32-79e4e1e4a04a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:27.194367 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-c745b32f-668c-46bc-9f32-79e4e1e4a04a None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:27.195816 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-c745b32f-668c-46bc-9f32-79e4e1e4a04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:27.239570 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:27.264401 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193943ff-d1b9-4dfe-941d-c74d73df50a3 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:27.264912 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193943ff-d1b9-4dfe-941d-c74d73df50a3 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:27.265347 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193943ff-d1b9-4dfe-941d-c74d73df50a3 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:27.266971 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 34/65] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:31:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:31:27.272257 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71459a63-7d9b-4749-a221-ac130ac9fe08 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:27.272716 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71459a63-7d9b-4749-a221-ac130ac9fe08 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:27.273117 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71459a63-7d9b-4749-a221-ac130ac9fe08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:27.284007 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 32/66] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:31:27.295873 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-71459a63-7d9b-4749-a221-ac130ac9fe08 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:27.297402 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-71459a63-7d9b-4749-a221-ac130ac9fe08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:27.391241 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:27.403626 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 35/67] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:31:27.453649 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66a499-edf4-4501-a273-e3b09de0c94a None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:27.453958 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66a499-edf4-4501-a273-e3b09de0c94a None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:27.454224 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66a499-edf4-4501-a273-e3b09de0c94a None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:27.455594 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 33/68] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:31:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:27.460942 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5c930-a07c-4214-8cd0-8d20b621982c None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:27.461238 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5c930-a07c-4214-8cd0-8d20b621982c None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:27.461555 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5c930-a07c-4214-8cd0-8d20b621982c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:27.488514 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-36c5c930-a07c-4214-8cd0-8d20b621982c None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:27.489753 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-36c5c930-a07c-4214-8cd0-8d20b621982c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:27.534353 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c66a499-edf4-4501-a273-e3b09de0c94a None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:27.592902 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 36/69] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:31:27.629380 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c5c930-a07c-4214-8cd0-8d20b621982c None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:27.694029 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c66a499-edf4-4501-a273-e3b09de0c94a None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:27.738125 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c5c930-a07c-4214-8cd0-8d20b621982c None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:27.748487 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a8bd00-1f6f-4de8-96fe-18598f9fb4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:27.749415 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a8bd00-1f6f-4de8-96fe-18598f9fb4dd None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:27.750034 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a8bd00-1f6f-4de8-96fe-18598f9fb4dd None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:27.750700 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a8bd00-1f6f-4de8-96fe-18598f9fb4dd None admin] PATH_INFO: `/v3/roles/member` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:27.762699 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a8bd00-1f6f-4de8-96fe-18598f9fb4dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:31:27.763892 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:27.770798 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-e7a8bd00-1f6f-4de8-96fe-18598f9fb4dd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:31:27.770798 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:27.770798 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:27.770798 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:27.770798 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:27.770798 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:27.770798 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:27.770798 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:27.770798 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:27.770798 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:27.770798 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:27.770798 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:27.770798 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:31:27.770798 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:31:27.770798 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:31:27.770798 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:31:27.771649 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:31:27.771649 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:31:27.771649 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:31:27.771649 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:31:27.771649 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:27.771649 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:27.771649 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:27.771649 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:27.771649 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:27.771649 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:27.771649 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:27.771649 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:27.771649 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:27.771649 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:27.771649 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:27.771649 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:27.772394 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:27.772394 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:27.772394 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:27.772394 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:27.772394 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:31:27.772394 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:31:27.772394 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:31:27.772394 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:31:27.772394 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:31:27.772394 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:31:27.772394 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:31:27.772394 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:31:27.774925 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 34/70] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Aug 29 22:31:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:31:27.775553 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c706964-7389-464f-822b-5d5b45bb468f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:27.776199 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c706964-7389-464f-822b-5d5b45bb468f None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:27.776484 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c706964-7389-464f-822b-5d5b45bb468f None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:27.776762 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c706964-7389-464f-822b-5d5b45bb468f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:27.778076 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a8bd00-1f6f-4de8-96fe-18598f9fb4dd None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:27.798340 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c706964-7389-464f-822b-5d5b45bb468f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:31:27.803281 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-3c706964-7389-464f-822b-5d5b45bb468f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:31:27.803281 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:27.803281 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:27.803281 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:27.803281 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:27.803281 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:27.803281 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:27.803281 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:27.803281 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:27.803281 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:27.803281 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:27.803281 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:27.803281 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:31:27.803281 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:31:27.803281 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:31:27.803281 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:31:27.804086 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:31:27.804086 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:31:27.804086 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:31:27.804086 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:31:27.804086 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:27.804086 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:27.804086 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:27.804086 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:27.804086 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:27.804086 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:27.804086 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:27.804086 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:27.804086 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:27.804086 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:27.804086 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:27.804086 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:27.804825 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:27.804825 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:27.804825 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:27.804825 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:27.804825 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:31:27.804825 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:31:27.804825 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:31:27.804825 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:31:27.804825 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:31:27.804825 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:31:27.804825 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:31:27.804825 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:31:27.804825 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 37/71] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Aug 29 22:31:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:27.805488 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c706964-7389-464f-822b-5d5b45bb468f None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:27.829128 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:27.906155 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a8bd00-1f6f-4de8-96fe-18598f9fb4dd None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:27.918082 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c706964-7389-464f-822b-5d5b45bb468f None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:27.947305 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fbb897-7d43-4837-afc8-82ee96c8de52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:27.947955 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fbb897-7d43-4837-afc8-82ee96c8de52 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:27.948244 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fbb897-7d43-4837-afc8-82ee96c8de52 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:27.948530 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fbb897-7d43-4837-afc8-82ee96c8de52 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:27.955826 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0a30de-f06b-4631-a1d4-b6b37a08182e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:27.956440 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a30de-f06b-4631-a1d4-b6b37a08182e None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:27.956725 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a30de-f06b-4631-a1d4-b6b37a08182e None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:27.957007 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a30de-f06b-4631-a1d4-b6b37a08182e None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:27.957713 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0a30de-f06b-4631-a1d4-b6b37a08182e None admin] RBAC: Adding query filter params (name=member) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:27.958022 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0a30de-f06b-4631-a1d4-b6b37a08182e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:27.959414 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0a30de-f06b-4631-a1d4-b6b37a08182e None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:27.960530 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fbb897-7d43-4837-afc8-82ee96c8de52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:31:27.965686 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-47fbb897-7d43-4837-afc8-82ee96c8de52 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:31:27.965686 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:27.965686 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:27.965686 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:27.965686 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:27.965686 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:27.965686 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:27.965686 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:27.965686 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:27.965686 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:27.965686 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:27.965686 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:27.965686 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:31:27.965686 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:31:27.965686 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:31:27.965686 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:31:27.966504 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:31:27.966504 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:31:27.966504 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:31:27.966504 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:31:27.966504 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:27.966504 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:27.966504 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:27.966504 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:27.966504 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:27.966504 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:27.966504 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:27.966504 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:27.966504 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:27.966504 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:27.966504 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:27.966504 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:27.967234 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:27.967234 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:27.967234 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:27.967234 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:27.967234 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:31:27.967234 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:31:27.967234 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:31:27.967234 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:31:27.967234 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:31:27.967234 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:31:27.967234 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:31:27.967234 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:31:27.973083 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 38/72] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Aug 29 22:31:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:27.973083 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0a30de-f06b-4631-a1d4-b6b37a08182e None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:27.973283 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 35/73] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Aug 29 22:31:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:27.977015 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fbb897-7d43-4837-afc8-82ee96c8de52 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:28.022184 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:28.074052 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:28.079334 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0a30de-f06b-4631-a1d4-b6b37a08182e None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:28.081528 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fbb897-7d43-4837-afc8-82ee96c8de52 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:28.114478 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1223a30a-8b55-4943-b08e-9333dabca2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:28.115091 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223a30a-8b55-4943-b08e-9333dabca2f9 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:28.115377 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223a30a-8b55-4943-b08e-9333dabca2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:28.115652 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223a30a-8b55-4943-b08e-9333dabca2f9 None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:28.116316 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1223a30a-8b55-4943-b08e-9333dabca2f9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:28.116620 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1223a30a-8b55-4943-b08e-9333dabca2f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:28.116713 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad2833-36f9-4910-94ef-6713f8426b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:28.117318 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad2833-36f9-4910-94ef-6713f8426b02 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:28.117632 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad2833-36f9-4910-94ef-6713f8426b02 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:28.117907 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad2833-36f9-4910-94ef-6713f8426b02 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:28.118034 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1223a30a-8b55-4943-b08e-9333dabca2f9 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:28.126603 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 39/74] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Aug 29 22:31:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:28.127598 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1223a30a-8b55-4943-b08e-9333dabca2f9 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:28.129291 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dad2833-36f9-4910-94ef-6713f8426b02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:31:28.134555 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-4dad2833-36f9-4910-94ef-6713f8426b02 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:31:28.134555 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:28.134555 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:28.134555 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:28.134555 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:28.134555 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:28.134555 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:28.134555 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:28.134555 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:28.134555 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:28.134555 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:28.134555 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:28.134555 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:31:28.134555 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:31:28.134555 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:31:28.134555 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:31:28.135387 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:31:28.135387 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:31:28.135387 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:31:28.135387 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:31:28.135387 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:28.135387 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:28.135387 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:28.135387 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:28.135387 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:28.135387 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:28.135387 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:28.135387 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:28.135387 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:28.135387 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:28.135387 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:28.135387 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:28.136116 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:28.136116 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:28.136116 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:28.136116 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:28.136116 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:31:28.136116 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:31:28.136116 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:31:28.136116 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:31:28.136116 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:31:28.136116 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:31:28.136116 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:31:28.136116 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:31:28.136116 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 36/75] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Aug 29 22:31:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:28.137525 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad2833-36f9-4910-94ef-6713f8426b02 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:28.232281 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1223a30a-8b55-4943-b08e-9333dabca2f9 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:28.238968 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad2833-36f9-4910-94ef-6713f8426b02 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:28.241222 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:28.267189 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e131d2-fc9c-4015-9268-0ed11ab84b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:28.267812 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e131d2-fc9c-4015-9268-0ed11ab84b18 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:28.268100 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e131d2-fc9c-4015-9268-0ed11ab84b18 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:28.268367 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e131d2-fc9c-4015-9268-0ed11ab84b18 None admin] PATH_INFO: `/v3/users/d825c7992679472eaa3ad17d44674788` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:28.273587 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b261a25-51fe-4551-83b9-c512292b391b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:28.274210 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b261a25-51fe-4551-83b9-c512292b391b None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:28.274555 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b261a25-51fe-4551-83b9-c512292b391b None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:28.274836 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b261a25-51fe-4551-83b9-c512292b391b None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:28.275510 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b261a25-51fe-4551-83b9-c512292b391b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:28.275815 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b261a25-51fe-4551-83b9-c512292b391b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:28.277220 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b261a25-51fe-4551-83b9-c512292b391b None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:28.283094 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e131d2-fc9c-4015-9268-0ed11ab84b18 None admin] RBAC: Authorizing `identity:get_user(user_id=d825c7992679472eaa3ad17d44674788)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:28.284557 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e131d2-fc9c-4015-9268-0ed11ab84b18 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:28.291466 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 37/76] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Aug 29 22:31:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:28.291609 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 40/77] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Aug 29 22:31:28 2022] GET /identity/v3/users/d825c7992679472eaa3ad17d44674788 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:28.291705 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1d72e-4c2c-42b2-bb76-bba139124aad None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:28.291705 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1d72e-4c2c-42b2-bb76-bba139124aad None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:28.291705 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1d72e-4c2c-42b2-bb76-bba139124aad None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:28.291871 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e131d2-fc9c-4015-9268-0ed11ab84b18 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:28.291934 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 38/78] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:31:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:28.291934 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec1d72e-4c2c-42b2-bb76-bba139124aad None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:28.318427 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:28.397830 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e131d2-fc9c-4015-9268-0ed11ab84b18 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:28.413030 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec1d72e-4c2c-42b2-bb76-bba139124aad None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:28.433720 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b83be4-4d92-4cd0-b36d-882d1f1e1f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:28.434356 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b83be4-4d92-4cd0-b36d-882d1f1e1f1a None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:28.434641 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b83be4-4d92-4cd0-b36d-882d1f1e1f1a None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:28.434918 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b83be4-4d92-4cd0-b36d-882d1f1e1f1a None admin] PATH_INFO: `/v3/users/2844206a473948fca3069da17e9f5996` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:28.436081 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b83be4-4d92-4cd0-b36d-882d1f1e1f1a None admin] RBAC: Authorizing `identity:get_user(user_id=2844206a473948fca3069da17e9f5996)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:28.437585 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b83be4-4d92-4cd0-b36d-882d1f1e1f1a None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:28.443892 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 41/79] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Aug 29 22:31:28 2022] GET /identity/v3/users/2844206a473948fca3069da17e9f5996 => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:28.443892 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b83be4-4d92-4cd0-b36d-882d1f1e1f1a None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:28.446976 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34abd6fb-c3fa-4124-8f2c-90a5b9309fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:28.447592 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34abd6fb-c3fa-4124-8f2c-90a5b9309fc1 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:28.447880 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34abd6fb-c3fa-4124-8f2c-90a5b9309fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:28.448160 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34abd6fb-c3fa-4124-8f2c-90a5b9309fc1 None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:28.448850 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34abd6fb-c3fa-4124-8f2c-90a5b9309fc1 None admin] RBAC: Adding query filter params (name=member) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:28.449131 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34abd6fb-c3fa-4124-8f2c-90a5b9309fc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:28.450568 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34abd6fb-c3fa-4124-8f2c-90a5b9309fc1 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:28.460016 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 39/80] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Aug 29 22:31:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:28.460830 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34abd6fb-c3fa-4124-8f2c-90a5b9309fc1 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:28.476528 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:28.544911 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:28.545147 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b83be4-4d92-4cd0-b36d-882d1f1e1f1a None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:28.567379 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34abd6fb-c3fa-4124-8f2c-90a5b9309fc1 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:28.579405 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f061a-4d4b-403b-b1dc-f65cdafa1c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:28.580010 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f061a-4d4b-403b-b1dc-f65cdafa1c54 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:28.580295 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f061a-4d4b-403b-b1dc-f65cdafa1c54 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:28.580568 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f061a-4d4b-403b-b1dc-f65cdafa1c54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:28.601918 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4997d63f-661e-4a68-b182-cb8d1dfacdc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:28.602554 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4997d63f-661e-4a68-b182-cb8d1dfacdc8 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:28.602840 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4997d63f-661e-4a68-b182-cb8d1dfacdc8 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:28.603130 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4997d63f-661e-4a68-b182-cb8d1dfacdc8 None admin] PATH_INFO: `/v3/users/d825c7992679472eaa3ad17d44674788` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:28.604269 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4997d63f-661e-4a68-b182-cb8d1dfacdc8 None admin] RBAC: Authorizing `identity:get_user(user_id=d825c7992679472eaa3ad17d44674788)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:28.605771 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4997d63f-661e-4a68-b182-cb8d1dfacdc8 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:28.607351 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 40/81] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Aug 29 22:31:28 2022] GET /identity/v3/users/d825c7992679472eaa3ad17d44674788 => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:28.610620 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de7ccb-e504-4569-bc7f-6fd1791f649b None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:28.610907 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de7ccb-e504-4569-bc7f-6fd1791f649b None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:28.611183 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de7ccb-e504-4569-bc7f-6fd1791f649b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:28.629693 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-c5de7ccb-e504-4569-bc7f-6fd1791f649b None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:28.631472 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-c5de7ccb-e504-4569-bc7f-6fd1791f649b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:28.652700 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597f061a-4d4b-403b-b1dc-f65cdafa1c54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:28.654933 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597f061a-4d4b-403b-b1dc-f65cdafa1c54 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:28.691649 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:28.706990 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 41/82] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:31:28.707865 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5de7ccb-e504-4569-bc7f-6fd1791f649b None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:28.763810 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 42/83] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Aug 29 22:31:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:31:28.764668 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f061a-4d4b-403b-b1dc-f65cdafa1c54 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:28.799694 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:28.827063 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5de7ccb-e504-4569-bc7f-6fd1791f649b None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:28.866618 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f071aa47-c87c-4f6e-94f0-fba238612b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:28.867232 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f071aa47-c87c-4f6e-94f0-fba238612b06 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:28.867514 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f071aa47-c87c-4f6e-94f0-fba238612b06 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:28.867785 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f071aa47-c87c-4f6e-94f0-fba238612b06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:28.877303 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f061a-4d4b-403b-b1dc-f65cdafa1c54 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:28.913721 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c2e927-8313-47f9-ad79-ebda9e858d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:28.914289 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c2e927-8313-47f9-ad79-ebda9e858d3f None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:28.914576 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c2e927-8313-47f9-ad79-ebda9e858d3f None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:28.914854 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c2e927-8313-47f9-ad79-ebda9e858d3f None admin] PATH_INFO: `/v3/users/d825c7992679472eaa3ad17d44674788` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:28.916018 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c2e927-8313-47f9-ad79-ebda9e858d3f None admin] RBAC: Authorizing `identity:get_user(user_id=d825c7992679472eaa3ad17d44674788)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:28.917530 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c2e927-8313-47f9-ad79-ebda9e858d3f None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:28.919118 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 43/84] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Aug 29 22:31:28 2022] GET /identity/v3/users/d825c7992679472eaa3ad17d44674788 => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:28.919878 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c2e927-8313-47f9-ad79-ebda9e858d3f None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:28.923194 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:28.958201 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f071aa47-c87c-4f6e-94f0-fba238612b06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:28.959680 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f071aa47-c87c-4f6e-94f0-fba238612b06 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:29.031409 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c2e927-8313-47f9-ad79-ebda9e858d3f None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:29.040899 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:29.066640 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 42/85] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Aug 29 22:31:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:31:29.067512 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5619001-e2d1-4b02-841c-58c2386e0901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:29.068131 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5619001-e2d1-4b02-841c-58c2386e0901 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:29.068414 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5619001-e2d1-4b02-841c-58c2386e0901 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:29.068570 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f071aa47-c87c-4f6e-94f0-fba238612b06 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:29.068720 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5619001-e2d1-4b02-841c-58c2386e0901 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:29.136245 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5619001-e2d1-4b02-841c-58c2386e0901 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:29.137786 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5619001-e2d1-4b02-841c-58c2386e0901 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:29.139618 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:29.168277 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f071aa47-c87c-4f6e-94f0-fba238612b06 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:29.201954 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a5c2e3-3196-4136-aaf3-56dfdffd691f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:29.202588 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5c2e3-3196-4136-aaf3-56dfdffd691f None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:29.202935 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5c2e3-3196-4136-aaf3-56dfdffd691f None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:29.203772 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5c2e3-3196-4136-aaf3-56dfdffd691f None admin] PATH_INFO: `/v3/projects/86b325231ef14af1b9223cffefd8d475` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:29.204915 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a5c2e3-3196-4136-aaf3-56dfdffd691f None admin] RBAC: Authorizing `identity:get_project(project_id=86b325231ef14af1b9223cffefd8d475)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:29.206419 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a5c2e3-3196-4136-aaf3-56dfdffd691f None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:29.208066 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 43/86] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Aug 29 22:31:29 2022] GET /identity/v3/projects/86b325231ef14af1b9223cffefd8d475 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:29.212988 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a5c2e3-3196-4136-aaf3-56dfdffd691f None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:29.240254 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 44/87] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Aug 29 22:31:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:31:29.241098 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5619001-e2d1-4b02-841c-58c2386e0901 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:29.263064 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:29.320373 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a5c2e3-3196-4136-aaf3-56dfdffd691f None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:29.339951 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5619001-e2d1-4b02-841c-58c2386e0901 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:29.341530 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:29.355610 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e923fe16-d391-41b3-9892-302cee280501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:29.356226 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923fe16-d391-41b3-9892-302cee280501 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:29.356508 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923fe16-d391-41b3-9892-302cee280501 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:29.356784 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923fe16-d391-41b3-9892-302cee280501 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:29.376497 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8930f51-9264-4ac9-9fd3-8d0a3adcf1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:29.377122 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8930f51-9264-4ac9-9fd3-8d0a3adcf1a3 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:29.377444 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8930f51-9264-4ac9-9fd3-8d0a3adcf1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:29.377727 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8930f51-9264-4ac9-9fd3-8d0a3adcf1a3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:29.378856 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8930f51-9264-4ac9-9fd3-8d0a3adcf1a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:29.380299 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8930f51-9264-4ac9-9fd3-8d0a3adcf1a3 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:29.381913 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 45/88] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:31:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:29.382675 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8930f51-9264-4ac9-9fd3-8d0a3adcf1a3 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:29.425318 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e923fe16-d391-41b3-9892-302cee280501 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:29.426767 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e923fe16-d391-41b3-9892-302cee280501 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:29.470899 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:29.483451 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8930f51-9264-4ac9-9fd3-8d0a3adcf1a3 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:29.517483 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20ef963-1a54-4ce2-8191-9f3c05c6959d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:29.518167 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ef963-1a54-4ce2-8191-9f3c05c6959d None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:29.518497 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ef963-1a54-4ce2-8191-9f3c05c6959d None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:29.518775 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ef963-1a54-4ce2-8191-9f3c05c6959d None admin] PATH_INFO: `/v3/projects/86b325231ef14af1b9223cffefd8d475` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:29.519977 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20ef963-1a54-4ce2-8191-9f3c05c6959d None admin] RBAC: Authorizing `identity:get_project(project_id=86b325231ef14af1b9223cffefd8d475)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:29.521540 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20ef963-1a54-4ce2-8191-9f3c05c6959d None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:29.523198 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 46/89] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Aug 29 22:31:29 2022] GET /identity/v3/projects/86b325231ef14af1b9223cffefd8d475 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:29.524041 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20ef963-1a54-4ce2-8191-9f3c05c6959d None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:29.530387 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 44/90] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Aug 29 22:31:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:31:29.531815 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e923fe16-d391-41b3-9892-302cee280501 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:29.565084 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:29.626334 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20ef963-1a54-4ce2-8191-9f3c05c6959d None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:29.633000 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e923fe16-d391-41b3-9892-302cee280501 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:29.660799 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e2214-071e-407f-94f3-0816cac3f879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:29.661438 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e2214-071e-407f-94f3-0816cac3f879 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:29.661980 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e2214-071e-407f-94f3-0816cac3f879 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:29.662256 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e2214-071e-407f-94f3-0816cac3f879 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:29.662985 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022e2214-071e-407f-94f3-0816cac3f879 None admin] RBAC: Adding query filter params (role.id=0c67797d444d4c929b2ccab47c468848, scope.project.id=86b325231ef14af1b9223cffefd8d475, user.id=d825c7992679472eaa3ad17d44674788) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:29.663291 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022e2214-071e-407f-94f3-0816cac3f879 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:29.664747 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022e2214-071e-407f-94f3-0816cac3f879 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:29.668074 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8065af-c652-4bb8-87d3-7a2b321911ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:29.668707 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8065af-c652-4bb8-87d3-7a2b321911ec None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:29.668993 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8065af-c652-4bb8-87d3-7a2b321911ec None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:29.669272 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8065af-c652-4bb8-87d3-7a2b321911ec None admin] PATH_INFO: `/v3/projects/86b325231ef14af1b9223cffefd8d475` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:29.670117 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 47/91] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Aug 29 22:31:29 2022] GET /identity/v3/role_assignments?user.id=d825c7992679472eaa3ad17d44674788&scope.project.id=86b325231ef14af1b9223cffefd8d475&role.id=0c67797d444d4c929b2ccab47c468848 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:29.670437 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8065af-c652-4bb8-87d3-7a2b321911ec None admin] RBAC: Authorizing `identity:get_project(project_id=86b325231ef14af1b9223cffefd8d475)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:29.670879 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e2214-071e-407f-94f3-0816cac3f879 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:29.672422 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8065af-c652-4bb8-87d3-7a2b321911ec None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:29.674225 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 45/92] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Aug 29 22:31:29 2022] GET /identity/v3/projects/86b325231ef14af1b9223cffefd8d475 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:29.675039 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8065af-c652-4bb8-87d3-7a2b321911ec None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:29.693617 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:29.798866 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8065af-c652-4bb8-87d3-7a2b321911ec None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:29.799107 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e2214-071e-407f-94f3-0816cac3f879 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:29.800850 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:29.841363 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb71a6e-7ed3-411a-be3f-8473a4865b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:29.841974 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb71a6e-7ed3-411a-be3f-8473a4865b8a None admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:29.842349 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb71a6e-7ed3-411a-be3f-8473a4865b8a None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:29.842629 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb71a6e-7ed3-411a-be3f-8473a4865b8a None admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:29.842896 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9857cdcd-18a0-466f-85e3-c0b23f018196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:29.843284 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb71a6e-7ed3-411a-be3f-8473a4865b8a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:29.843516 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857cdcd-18a0-466f-85e3-c0b23f018196 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:29.844152 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857cdcd-18a0-466f-85e3-c0b23f018196 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:29.844152 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857cdcd-18a0-466f-85e3-c0b23f018196 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:29.844756 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb71a6e-7ed3-411a-be3f-8473a4865b8a None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:29.844866 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9857cdcd-18a0-466f-85e3-c0b23f018196 None admin] RBAC: Adding query filter params (role.id=d00eabaec96a4956aaec2c37a5819c25, scope.project.id=86b325231ef14af1b9223cffefd8d475, user.id=2844206a473948fca3069da17e9f5996) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:29.845162 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9857cdcd-18a0-466f-85e3-c0b23f018196 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:29.846674 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9857cdcd-18a0-466f-85e3-c0b23f018196 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:29.861671 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 46/93] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Aug 29 22:31:29 2022] GET /identity/v3/role_assignments?user.id=2844206a473948fca3069da17e9f5996&scope.project.id=86b325231ef14af1b9223cffefd8d475&role.id=d00eabaec96a4956aaec2c37a5819c25 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:29.861671 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9857cdcd-18a0-466f-85e3-c0b23f018196 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:29.874787 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 48/94] 10.222.0.47 () {60 vars in 1132 bytes} [Mon Aug 29 22:31:29 2022] POST /identity/v3/users => generated 289 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:31:29.876423 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb71a6e-7ed3-411a-be3f-8473a4865b8a None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:29.964911 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:30.002485 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9857cdcd-18a0-466f-85e3-c0b23f018196 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:30.006910 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb71a6e-7ed3-411a-be3f-8473a4865b8a None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:30.053637 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c9762-cc4f-434b-8f32-f2e61e3aac1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:30.054271 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d538c08-6cc2-4161-b122-3933401bec47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:30.054463 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d538c08-6cc2-4161-b122-3933401bec47 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:30.054599 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c9762-cc4f-434b-8f32-f2e61e3aac1c None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:30.054777 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d538c08-6cc2-4161-b122-3933401bec47 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:30.055176 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c9762-cc4f-434b-8f32-f2e61e3aac1c None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:30.055280 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d538c08-6cc2-4161-b122-3933401bec47 None admin] PATH_INFO: `/v3/projects/1db1f2b43bf4404d8bea2f850a16fde2` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:30.055834 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c9762-cc4f-434b-8f32-f2e61e3aac1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:30.056431 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d538c08-6cc2-4161-b122-3933401bec47 None admin] RBAC: Authorizing `identity:get_project(project_id=1db1f2b43bf4404d8bea2f850a16fde2)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:30.057008 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8c9762-cc4f-434b-8f32-f2e61e3aac1c None admin] RBAC: Adding query filter params (role.id=066c4a2915d247089e9df06936eb9a97, scope.project.id=86b325231ef14af1b9223cffefd8d475, user.id=d825c7992679472eaa3ad17d44674788) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:30.057561 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8c9762-cc4f-434b-8f32-f2e61e3aac1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:30.057960 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d538c08-6cc2-4161-b122-3933401bec47 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:30.059455 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8c9762-cc4f-434b-8f32-f2e61e3aac1c None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:30.059643 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 47/95] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Aug 29 22:31:29 2022] GET /identity/v3/projects/1db1f2b43bf4404d8bea2f850a16fde2 => generated 312 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:30.070596 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 49/96] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Aug 29 22:31:29 2022] GET /identity/v3/role_assignments?user.id=d825c7992679472eaa3ad17d44674788&scope.project.id=86b325231ef14af1b9223cffefd8d475&role.id=066c4a2915d247089e9df06936eb9a97 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:30.072267 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d538c08-6cc2-4161-b122-3933401bec47 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:30.208242 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d538c08-6cc2-4161-b122-3933401bec47 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:30.250037 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad5196-8cec-4219-b521-1c8516896b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:30.250599 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad5196-8cec-4219-b521-1c8516896b1e None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:30.250890 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad5196-8cec-4219-b521-1c8516896b1e None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:30.251175 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad5196-8cec-4219-b521-1c8516896b1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:30.251922 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ad5196-8cec-4219-b521-1c8516896b1e None admin] RBAC: Adding query filter params (role.id=0c67797d444d4c929b2ccab47c468848, scope.project.id=1db1f2b43bf4404d8bea2f850a16fde2, user.id=d825c7992679472eaa3ad17d44674788) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:30.252238 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ad5196-8cec-4219-b521-1c8516896b1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:30.253726 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ad5196-8cec-4219-b521-1c8516896b1e None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:30.260068 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 48/97] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Aug 29 22:31:30 2022] GET /identity/v3/role_assignments?user.id=d825c7992679472eaa3ad17d44674788&scope.project.id=1db1f2b43bf4404d8bea2f850a16fde2&role.id=0c67797d444d4c929b2ccab47c468848 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:32.337957 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b2cfb-57c6-49ff-ae73-e6f25997461c None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:32.338932 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b2cfb-57c6-49ff-ae73-e6f25997461c None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:32.339423 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b2cfb-57c6-49ff-ae73-e6f25997461c None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:32.341292 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 50/98] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:31:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:32.354924 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d948525f-88ef-4a13-b897-d1f5d9d23046 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:32.355819 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d948525f-88ef-4a13-b897-d1f5d9d23046 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:32.356301 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d948525f-88ef-4a13-b897-d1f5d9d23046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:32.386382 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-d948525f-88ef-4a13-b897-d1f5d9d23046 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:32.387944 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-d948525f-88ef-4a13-b897-d1f5d9d23046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:32.390633 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:32.472296 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 49/99] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:31:32.578313 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40572d96-306e-40ee-b247-2f4c3bfd2685 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:32.578313 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40572d96-306e-40ee-b247-2f4c3bfd2685 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:32.578313 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40572d96-306e-40ee-b247-2f4c3bfd2685 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:32.578313 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 51/100] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:31:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:32.584169 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab89ad-1dc2-4048-a685-1f6ab8bb5de3 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:32.584694 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab89ad-1dc2-4048-a685-1f6ab8bb5de3 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:32.585169 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab89ad-1dc2-4048-a685-1f6ab8bb5de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:32.608189 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-60ab89ad-1dc2-4048-a685-1f6ab8bb5de3 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:32.610452 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-60ab89ad-1dc2-4048-a685-1f6ab8bb5de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:32.711673 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 50/101] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:31:32.783193 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485ddeb-390f-464f-ad0a-2c7d7065066e None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:32.783804 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485ddeb-390f-464f-ad0a-2c7d7065066e None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:32.784307 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485ddeb-390f-464f-ad0a-2c7d7065066e None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:32.785897 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 52/102] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:31:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:32.802960 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d69faa-cdb0-4f7d-8ccf-8df563acd555 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:32.803254 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d69faa-cdb0-4f7d-8ccf-8df563acd555 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:32.803540 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d69faa-cdb0-4f7d-8ccf-8df563acd555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:32.826317 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-54d69faa-cdb0-4f7d-8ccf-8df563acd555 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:32.828053 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-54d69faa-cdb0-4f7d-8ccf-8df563acd555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:32.910949 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:32.916579 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 51/103] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:31:32.940327 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e0cac-9533-45e1-bfb4-434a8f83ea7e None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:32.940930 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e0cac-9533-45e1-bfb4-434a8f83ea7e None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:32.941483 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e0cac-9533-45e1-bfb4-434a8f83ea7e None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:32.943030 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 53/104] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:31:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:32.948443 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f9e1a-a5e9-43c5-a217-4c1d4b9e101a None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:32.948730 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f9e1a-a5e9-43c5-a217-4c1d4b9e101a None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:32.949010 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f9e1a-a5e9-43c5-a217-4c1d4b9e101a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:32.975277 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-983f9e1a-a5e9-43c5-a217-4c1d4b9e101a None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:32.976487 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-983f9e1a-a5e9-43c5-a217-4c1d4b9e101a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:32.986153 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1e0cac-9533-45e1-bfb4-434a8f83ea7e None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:33.032085 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:33.109315 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 52/105] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:31:33.110210 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983f9e1a-a5e9-43c5-a217-4c1d4b9e101a None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:33.205194 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1e0cac-9533-45e1-bfb4-434a8f83ea7e None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:33.268562 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b4fe6-6bf6-4be8-9df7-adaa2f956598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:33.269656 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b4fe6-6bf6-4be8-9df7-adaa2f956598 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:33.270152 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b4fe6-6bf6-4be8-9df7-adaa2f956598 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:33.270606 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b4fe6-6bf6-4be8-9df7-adaa2f956598 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:33.272024 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983f9e1a-a5e9-43c5-a217-4c1d4b9e101a None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:33.295164 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291b4fe6-6bf6-4be8-9df7-adaa2f956598 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:31:33.301683 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-291b4fe6-6bf6-4be8-9df7-adaa2f956598 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:31:33.301683 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:33.301683 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:33.301683 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:33.301683 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:33.301683 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:33.301683 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:33.301683 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:33.301683 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:33.301683 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:33.301683 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:33.301683 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:33.301683 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:31:33.301683 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:31:33.301683 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:31:33.301683 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:31:33.302621 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:31:33.302621 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:31:33.302621 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:31:33.302621 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:31:33.302621 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:33.302621 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:33.302621 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:33.302621 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:33.302621 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:33.302621 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:33.302621 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:33.302621 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:33.302621 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:33.302621 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:33.302621 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:33.302621 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:33.303384 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:33.303384 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:33.303384 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:33.303384 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:33.303384 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:31:33.303384 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:31:33.303384 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:31:33.303384 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:31:33.303384 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:31:33.303384 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:31:33.303384 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:31:33.303384 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:31:33.303384 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 54/106] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Aug 29 22:31:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:31:33.310489 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b4fe6-6bf6-4be8-9df7-adaa2f956598 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:33.311200 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:33.319606 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e813045f-4598-4d6e-b504-4d24f4eda66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:33.320656 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813045f-4598-4d6e-b504-4d24f4eda66c None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:33.321139 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813045f-4598-4d6e-b504-4d24f4eda66c None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:33.321634 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813045f-4598-4d6e-b504-4d24f4eda66c None admin] PATH_INFO: `/v3/roles/member` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:33.335434 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e813045f-4598-4d6e-b504-4d24f4eda66c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:31:33.341935 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-e813045f-4598-4d6e-b504-4d24f4eda66c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:31:33.341935 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:33.341935 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:33.341935 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:33.341935 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:33.341935 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:33.341935 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:33.341935 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:33.341935 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:33.341935 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:33.341935 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:33.341935 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:33.341935 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:31:33.341935 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:31:33.341935 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:31:33.341935 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:31:33.342765 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:31:33.342765 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:31:33.342765 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:31:33.342765 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:31:33.342765 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:33.342765 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:33.342765 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:33.342765 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:33.342765 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:33.342765 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:33.342765 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:33.342765 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:33.342765 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:33.342765 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:33.342765 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:33.342765 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:33.344109 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:33.344109 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:33.344109 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:33.344109 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:33.344109 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:31:33.344109 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:31:33.344109 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:31:33.344109 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:31:33.344109 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:31:33.344109 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:31:33.344109 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:31:33.344109 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:31:33.346795 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 53/107] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Aug 29 22:31:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:33.347753 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e813045f-4598-4d6e-b504-4d24f4eda66c None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:33.413724 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:33.437597 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b4fe6-6bf6-4be8-9df7-adaa2f956598 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:33.471604 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e813045f-4598-4d6e-b504-4d24f4eda66c None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:33.473929 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e5fec9-3a34-4844-a308-f231298ffd56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:33.474569 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5fec9-3a34-4844-a308-f231298ffd56 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:33.474852 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5fec9-3a34-4844-a308-f231298ffd56 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:33.475125 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5fec9-3a34-4844-a308-f231298ffd56 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:33.486349 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e5fec9-3a34-4844-a308-f231298ffd56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:31:33.491261 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-36e5fec9-3a34-4844-a308-f231298ffd56 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:31:33.491261 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:33.491261 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:33.491261 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:33.491261 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:33.491261 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:33.491261 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:33.491261 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:33.491261 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:33.491261 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:33.491261 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:33.491261 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:33.491261 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:31:33.491261 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:31:33.491261 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:31:33.491261 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:31:33.492132 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:31:33.492132 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:31:33.492132 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:31:33.492132 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:31:33.492132 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:33.492132 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:33.492132 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:33.492132 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:33.492132 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:33.492132 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:33.492132 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:33.492132 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:33.492132 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:33.492132 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:33.492132 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:33.492132 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:33.492895 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:33.492895 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:33.492895 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:33.492895 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:33.492895 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:31:33.492895 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:31:33.492895 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:31:33.492895 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:31:33.492895 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:31:33.492895 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:31:33.492895 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:31:33.492895 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:31:33.492895 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 55/108] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Aug 29 22:31:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:33.494573 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca64de-a6f3-465a-8c19-29af39881ced None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:33.494861 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca64de-a6f3-465a-8c19-29af39881ced None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:33.495139 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca64de-a6f3-465a-8c19-29af39881ced None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:33.497052 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 56/109] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:31:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:33.497647 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca64de-a6f3-465a-8c19-29af39881ced None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:33.517183 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b5dfae-9cef-4402-9ea0-e9c283ebb119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:33.517912 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5dfae-9cef-4402-9ea0-e9c283ebb119 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:33.518729 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5dfae-9cef-4402-9ea0-e9c283ebb119 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:33.519112 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5dfae-9cef-4402-9ea0-e9c283ebb119 None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:33.520194 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b5dfae-9cef-4402-9ea0-e9c283ebb119 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:33.520674 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b5dfae-9cef-4402-9ea0-e9c283ebb119 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:33.522756 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b5dfae-9cef-4402-9ea0-e9c283ebb119 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:33.534171 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 54/110] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Aug 29 22:31:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:33.534171 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b5dfae-9cef-4402-9ea0-e9c283ebb119 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:33.590539 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:33.615728 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca64de-a6f3-465a-8c19-29af39881ced None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:33.642307 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b5dfae-9cef-4402-9ea0-e9c283ebb119 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:33.655857 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19a948a-ca19-468f-bdd7-0fcaf9d84385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:33.656731 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a948a-ca19-468f-bdd7-0fcaf9d84385 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:33.657120 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a948a-ca19-468f-bdd7-0fcaf9d84385 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:33.657416 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a948a-ca19-468f-bdd7-0fcaf9d84385 None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:33.658207 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19a948a-ca19-468f-bdd7-0fcaf9d84385 None admin] RBAC: Adding query filter params (name=member) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:33.658509 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19a948a-ca19-468f-bdd7-0fcaf9d84385 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:33.659896 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19a948a-ca19-468f-bdd7-0fcaf9d84385 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:33.674143 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 57/111] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Aug 29 22:31:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:33.674143 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19a948a-ca19-468f-bdd7-0fcaf9d84385 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:33.676065 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:33.685466 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf4bed3-a7c1-43a7-9fe7-4f9f50cabf78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:33.686115 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4bed3-a7c1-43a7-9fe7-4f9f50cabf78 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:33.686401 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4bed3-a7c1-43a7-9fe7-4f9f50cabf78 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:33.687323 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4bed3-a7c1-43a7-9fe7-4f9f50cabf78 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:33.698296 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf4bed3-a7c1-43a7-9fe7-4f9f50cabf78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:31:33.703725 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-cdf4bed3-a7c1-43a7-9fe7-4f9f50cabf78 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:31:33.703725 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:33.703725 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:33.703725 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:33.703725 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:33.703725 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:33.703725 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:33.703725 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:33.703725 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:33.703725 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:33.703725 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:33.703725 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:33.703725 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:31:33.703725 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:31:33.703725 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:31:33.703725 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:31:33.704580 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:31:33.704580 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:31:33.704580 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:31:33.704580 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:31:33.704580 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:33.704580 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:33.704580 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:33.704580 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:33.704580 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:33.704580 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:33.704580 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:33.704580 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:33.704580 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:33.704580 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:33.704580 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:33.704580 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:33.705319 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:33.705319 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:33.705319 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:33.705319 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:33.705319 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:31:33.705319 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:31:33.705319 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:31:33.705319 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:31:33.705319 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:31:33.705319 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:31:33.705319 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:31:33.705319 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:31:33.705319 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 55/112] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Aug 29 22:31:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:33.706430 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90b1d2-9e92-4757-932d-f62c0bde476a None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:33.706430 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90b1d2-9e92-4757-932d-f62c0bde476a None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:33.706596 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90b1d2-9e92-4757-932d-f62c0bde476a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:33.725045 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-5b90b1d2-9e92-4757-932d-f62c0bde476a None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:33.726203 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-5b90b1d2-9e92-4757-932d-f62c0bde476a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:33.787703 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19a948a-ca19-468f-bdd7-0fcaf9d84385 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:33.795969 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 56/113] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:31:33.798409 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b90b1d2-9e92-4757-932d-f62c0bde476a None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:33.822613 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60d2062-6868-445e-a9ff-8196b483408d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:33.823228 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d2062-6868-445e-a9ff-8196b483408d None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:33.823511 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d2062-6868-445e-a9ff-8196b483408d None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:33.823788 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d2062-6868-445e-a9ff-8196b483408d None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:33.824457 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60d2062-6868-445e-a9ff-8196b483408d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:33.824760 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60d2062-6868-445e-a9ff-8196b483408d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:33.826189 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60d2062-6868-445e-a9ff-8196b483408d None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:33.839165 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 58/114] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Aug 29 22:31:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:33.840038 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60d2062-6868-445e-a9ff-8196b483408d None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:33.845985 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:33.922045 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b90b1d2-9e92-4757-932d-f62c0bde476a None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:33.925813 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:33.959879 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc30fde-af8a-46df-9fb4-c8135c99f6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:33.960763 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc30fde-af8a-46df-9fb4-c8135c99f6e8 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:33.961213 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc30fde-af8a-46df-9fb4-c8135c99f6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:33.961668 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc30fde-af8a-46df-9fb4-c8135c99f6e8 None admin] PATH_INFO: `/v3/users/2844206a473948fca3069da17e9f5996` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:33.962968 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc30fde-af8a-46df-9fb4-c8135c99f6e8 None admin] RBAC: Authorizing `identity:get_user(user_id=2844206a473948fca3069da17e9f5996)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:33.964569 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc30fde-af8a-46df-9fb4-c8135c99f6e8 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:33.966519 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 57/115] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Aug 29 22:31:33 2022] GET /identity/v3/users/2844206a473948fca3069da17e9f5996 => generated 247 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:33.967535 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc30fde-af8a-46df-9fb4-c8135c99f6e8 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:33.978279 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60d2062-6868-445e-a9ff-8196b483408d None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:34.028913 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428cf341-5ef3-4023-84e8-e7f711254947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:34.029921 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428cf341-5ef3-4023-84e8-e7f711254947 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:34.030206 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428cf341-5ef3-4023-84e8-e7f711254947 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:34.031092 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428cf341-5ef3-4023-84e8-e7f711254947 None admin] PATH_INFO: `/v3/users/d825c7992679472eaa3ad17d44674788` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:34.032171 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428cf341-5ef3-4023-84e8-e7f711254947 None admin] RBAC: Authorizing `identity:get_user(user_id=d825c7992679472eaa3ad17d44674788)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:34.033832 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428cf341-5ef3-4023-84e8-e7f711254947 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:34.035321 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 59/116] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Aug 29 22:31:33 2022] GET /identity/v3/users/d825c7992679472eaa3ad17d44674788 => generated 275 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:34.036813 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e026985-db74-429a-8ad3-e4627b659f6c None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:34.037112 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e026985-db74-429a-8ad3-e4627b659f6c None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:34.038009 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e026985-db74-429a-8ad3-e4627b659f6c None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:34.038841 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 60/117] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:31:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:34.039364 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e026985-db74-429a-8ad3-e4627b659f6c None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:34.104911 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc30fde-af8a-46df-9fb4-c8135c99f6e8 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:34.114882 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:34.142573 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097e7c9-0cb3-490d-90b8-6282283a51e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:34.143622 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097e7c9-0cb3-490d-90b8-6282283a51e3 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:34.143622 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097e7c9-0cb3-490d-90b8-6282283a51e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:34.143965 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097e7c9-0cb3-490d-90b8-6282283a51e3 None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:34.146385 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b097e7c9-0cb3-490d-90b8-6282283a51e3 None admin] RBAC: Adding query filter params (name=member) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:34.146385 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b097e7c9-0cb3-490d-90b8-6282283a51e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:34.146713 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b097e7c9-0cb3-490d-90b8-6282283a51e3 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:34.156003 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 58/118] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Aug 29 22:31:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:34.157276 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097e7c9-0cb3-490d-90b8-6282283a51e3 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:34.173454 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e026985-db74-429a-8ad3-e4627b659f6c None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:34.208112 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b6e35-0daa-44a1-b2b5-68bc92892899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:34.208752 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b6e35-0daa-44a1-b2b5-68bc92892899 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:34.209126 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b6e35-0daa-44a1-b2b5-68bc92892899 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:34.209451 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b6e35-0daa-44a1-b2b5-68bc92892899 None admin] PATH_INFO: `/v3/users/d825c7992679472eaa3ad17d44674788` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:34.210808 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8b6e35-0daa-44a1-b2b5-68bc92892899 None admin] RBAC: Authorizing `identity:get_user(user_id=d825c7992679472eaa3ad17d44674788)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:34.212344 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8b6e35-0daa-44a1-b2b5-68bc92892899 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:34.214005 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 61/119] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Aug 29 22:31:34 2022] GET /identity/v3/users/d825c7992679472eaa3ad17d44674788 => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:34.215138 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a9d9d3-9098-44b2-a538-7ae7c1c6b738 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:34.215423 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a9d9d3-9098-44b2-a538-7ae7c1c6b738 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:34.215697 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a9d9d3-9098-44b2-a538-7ae7c1c6b738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:34.222478 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:34.235472 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-41a9d9d3-9098-44b2-a538-7ae7c1c6b738 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:34.236634 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-41a9d9d3-9098-44b2-a538-7ae7c1c6b738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:34.271026 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097e7c9-0cb3-490d-90b8-6282283a51e3 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:34.308279 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 62/120] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:31:34.309155 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a9d9d3-9098-44b2-a538-7ae7c1c6b738 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:34.320423 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd0eba0-3e3b-498a-ad7e-d9b8420988b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:34.321475 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0eba0-3e3b-498a-ad7e-d9b8420988b2 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:34.321475 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0eba0-3e3b-498a-ad7e-d9b8420988b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:34.321727 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0eba0-3e3b-498a-ad7e-d9b8420988b2 None admin] PATH_INFO: `/v3/projects/86b325231ef14af1b9223cffefd8d475` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:34.323518 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd0eba0-3e3b-498a-ad7e-d9b8420988b2 None admin] RBAC: Authorizing `identity:get_project(project_id=86b325231ef14af1b9223cffefd8d475)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:34.325036 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd0eba0-3e3b-498a-ad7e-d9b8420988b2 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:34.326984 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 59/121] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Aug 29 22:31:34 2022] GET /identity/v3/projects/86b325231ef14af1b9223cffefd8d475 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:34.332843 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd0eba0-3e3b-498a-ad7e-d9b8420988b2 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:34.387449 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:34.440574 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a9d9d3-9098-44b2-a538-7ae7c1c6b738 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:34.465354 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd0eba0-3e3b-498a-ad7e-d9b8420988b2 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:34.473617 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:34.480514 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3bfb5d-54de-4a5b-a9cd-d694d8382aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:34.481477 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3bfb5d-54de-4a5b-a9cd-d694d8382aec None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:34.481775 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3bfb5d-54de-4a5b-a9cd-d694d8382aec None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:34.482168 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3bfb5d-54de-4a5b-a9cd-d694d8382aec None admin] PATH_INFO: `/v3/projects/86b325231ef14af1b9223cffefd8d475` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:34.483374 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3bfb5d-54de-4a5b-a9cd-d694d8382aec None admin] RBAC: Authorizing `identity:get_project(project_id=86b325231ef14af1b9223cffefd8d475)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:34.485467 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3bfb5d-54de-4a5b-a9cd-d694d8382aec None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:34.487218 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 63/122] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Aug 29 22:31:34 2022] GET /identity/v3/projects/86b325231ef14af1b9223cffefd8d475 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:34.490587 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3bfb5d-54de-4a5b-a9cd-d694d8382aec None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:34.509588 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d083166-8584-4cf5-b1db-2edf39dc5320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:34.510563 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d083166-8584-4cf5-b1db-2edf39dc5320 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:34.510860 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d083166-8584-4cf5-b1db-2edf39dc5320 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:34.511282 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d083166-8584-4cf5-b1db-2edf39dc5320 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:34.524793 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d083166-8584-4cf5-b1db-2edf39dc5320 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:31:34.531431 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-4d083166-8584-4cf5-b1db-2edf39dc5320 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 22:31:34.531431 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:34.531431 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:34.531431 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:34.531431 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:34.531431 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:34.531431 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:34.531431 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:34.531431 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:34.531431 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:34.531431 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:34.531431 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:34.531431 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:31:34.531431 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:31:34.531431 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:31:34.531431 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:31:34.532283 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:31:34.532283 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:31:34.532283 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:31:34.532283 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:31:34.532283 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:34.532283 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:34.532283 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:34.532283 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:34.532283 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:34.532283 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:34.532283 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:34.532283 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:34.532283 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:34.532283 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:34.532283 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:34.532283 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:34.533855 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:34.533855 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:34.533855 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:34.533855 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:34.533855 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:31:34.533855 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:31:34.533855 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:31:34.533855 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:31:34.533855 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:31:34.533855 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:31:34.533855 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 22:31:34.533855 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:31:34.533855 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 60/123] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Aug 29 22:31:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:34.533855 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d083166-8584-4cf5-b1db-2edf39dc5320 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:34.613310 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3bfb5d-54de-4a5b-a9cd-d694d8382aec None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:34.643832 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:34.648400 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d083166-8584-4cf5-b1db-2edf39dc5320 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:34.648545 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03e2e6f-7730-4d9d-94a8-950f0f5a9b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:34.649068 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e2e6f-7730-4d9d-94a8-950f0f5a9b6d None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:34.649381 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e2e6f-7730-4d9d-94a8-950f0f5a9b6d None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:34.649659 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e2e6f-7730-4d9d-94a8-950f0f5a9b6d None admin] PATH_INFO: `/v3/users/d825c7992679472eaa3ad17d44674788` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:34.650785 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03e2e6f-7730-4d9d-94a8-950f0f5a9b6d None admin] RBAC: Authorizing `identity:get_user(user_id=d825c7992679472eaa3ad17d44674788)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:34.652237 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03e2e6f-7730-4d9d-94a8-950f0f5a9b6d None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:34.653847 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 64/124] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Aug 29 22:31:34 2022] GET /identity/v3/users/d825c7992679472eaa3ad17d44674788 => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:34.654582 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03e2e6f-7730-4d9d-94a8-950f0f5a9b6d None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:34.683084 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2561812-8f93-458b-a2c9-6295a6b674e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:34.683724 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2561812-8f93-458b-a2c9-6295a6b674e4 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:34.684002 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2561812-8f93-458b-a2c9-6295a6b674e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:34.684274 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2561812-8f93-458b-a2c9-6295a6b674e4 None admin] PATH_INFO: `/v3/projects/86b325231ef14af1b9223cffefd8d475` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:34.685413 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2561812-8f93-458b-a2c9-6295a6b674e4 None admin] RBAC: Authorizing `identity:get_project(project_id=86b325231ef14af1b9223cffefd8d475)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:34.687616 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2561812-8f93-458b-a2c9-6295a6b674e4 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:34.689492 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 61/125] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Aug 29 22:31:34 2022] GET /identity/v3/projects/86b325231ef14af1b9223cffefd8d475 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:34.694395 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2561812-8f93-458b-a2c9-6295a6b674e4 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:34.726091 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:34.760765 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03e2e6f-7730-4d9d-94a8-950f0f5a9b6d None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:34.794022 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2561812-8f93-458b-a2c9-6295a6b674e4 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:34.794637 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd846a-5f78-4afe-b7c8-62f0f43cb5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:34.795295 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd846a-5f78-4afe-b7c8-62f0f43cb5ac None admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:34.795575 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd846a-5f78-4afe-b7c8-62f0f43cb5ac None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:34.796019 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd846a-5f78-4afe-b7c8-62f0f43cb5ac None admin] PATH_INFO: `/v3/projects/86b325231ef14af1b9223cffefd8d475/users/2844206a473948fca3069da17e9f5996/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:34.812461 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bd846a-5f78-4afe-b7c8-62f0f43cb5ac None admin] RBAC: Authorizing `identity:create_grant(project_id=86b325231ef14af1b9223cffefd8d475, user_id=2844206a473948fca3069da17e9f5996, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:34.813979 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bd846a-5f78-4afe-b7c8-62f0f43cb5ac None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:34.831201 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 65/126] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Aug 29 22:31:34 2022] PUT /identity/v3/projects/86b325231ef14af1b9223cffefd8d475/users/2844206a473948fca3069da17e9f5996/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:31:34.832045 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd846a-5f78-4afe-b7c8-62f0f43cb5ac None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:34.847138 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d994a9d2-0064-4240-8e38-4a55c1496cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:34.847844 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994a9d2-0064-4240-8e38-4a55c1496cf3 None admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:34.848131 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994a9d2-0064-4240-8e38-4a55c1496cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:34.848434 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994a9d2-0064-4240-8e38-4a55c1496cf3 None admin] PATH_INFO: `/v3/projects/86b325231ef14af1b9223cffefd8d475/users/d825c7992679472eaa3ad17d44674788/roles/0c67797d444d4c929b2ccab47c468848` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:34.850540 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d994a9d2-0064-4240-8e38-4a55c1496cf3 None admin] RBAC: Authorizing `identity:create_grant(project_id=86b325231ef14af1b9223cffefd8d475, user_id=d825c7992679472eaa3ad17d44674788, role_id=0c67797d444d4c929b2ccab47c468848)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:34.852051 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d994a9d2-0064-4240-8e38-4a55c1496cf3 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:34.881374 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 62/127] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Aug 29 22:31:34 2022] PUT /identity/v3/projects/86b325231ef14af1b9223cffefd8d475/users/d825c7992679472eaa3ad17d44674788/roles/0c67797d444d4c929b2ccab47c468848 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:31:34.881374 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d994a9d2-0064-4240-8e38-4a55c1496cf3 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:34.913452 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:35.001265 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd846a-5f78-4afe-b7c8-62f0f43cb5ac None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:35.012628 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d994a9d2-0064-4240-8e38-4a55c1496cf3 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:35.045459 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:35.059326 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae40f7-3fdc-470e-a286-313027dc94f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:35.060258 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae40f7-3fdc-470e-a286-313027dc94f9 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:35.060657 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae40f7-3fdc-470e-a286-313027dc94f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:35.061033 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae40f7-3fdc-470e-a286-313027dc94f9 None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:35.061807 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eae40f7-3fdc-470e-a286-313027dc94f9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:35.062112 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eae40f7-3fdc-470e-a286-313027dc94f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:35.063614 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eae40f7-3fdc-470e-a286-313027dc94f9 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:35.065059 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679031c3-d8c8-4dcb-9228-9a3bb4097024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:35.066018 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679031c3-d8c8-4dcb-9228-9a3bb4097024 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:35.066474 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679031c3-d8c8-4dcb-9228-9a3bb4097024 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:35.066923 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679031c3-d8c8-4dcb-9228-9a3bb4097024 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:35.068259 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679031c3-d8c8-4dcb-9228-9a3bb4097024 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:35.069962 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679031c3-d8c8-4dcb-9228-9a3bb4097024 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:35.071723 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 63/128] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:31:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:35.073519 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 66/129] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Aug 29 22:31:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:35.074269 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae40f7-3fdc-470e-a286-313027dc94f9 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:35.074679 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679031c3-d8c8-4dcb-9228-9a3bb4097024 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:35.186135 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679031c3-d8c8-4dcb-9228-9a3bb4097024 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:35.189670 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:35.224307 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae40f7-3fdc-470e-a286-313027dc94f9 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:35.226760 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54f00c3-cd9e-4ff2-bf91-8b79efddba26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:35.228351 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f00c3-cd9e-4ff2-bf91-8b79efddba26 None admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:35.228740 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f00c3-cd9e-4ff2-bf91-8b79efddba26 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:35.229150 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f00c3-cd9e-4ff2-bf91-8b79efddba26 None admin] PATH_INFO: `/v3/projects/86b325231ef14af1b9223cffefd8d475/users/d825c7992679472eaa3ad17d44674788/roles/066c4a2915d247089e9df06936eb9a97` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:35.231576 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54f00c3-cd9e-4ff2-bf91-8b79efddba26 None admin] RBAC: Authorizing `identity:create_grant(project_id=86b325231ef14af1b9223cffefd8d475, user_id=d825c7992679472eaa3ad17d44674788, role_id=066c4a2915d247089e9df06936eb9a97)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:35.233681 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54f00c3-cd9e-4ff2-bf91-8b79efddba26 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:35.252390 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 64/130] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Aug 29 22:31:35 2022] PUT /identity/v3/projects/86b325231ef14af1b9223cffefd8d475/users/d825c7992679472eaa3ad17d44674788/roles/066c4a2915d247089e9df06936eb9a97 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:31:35.254215 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54f00c3-cd9e-4ff2-bf91-8b79efddba26 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:35.285441 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50ee33c-565e-4308-bd87-9f682bd44f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:35.285441 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ee33c-565e-4308-bd87-9f682bd44f89 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:35.285441 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ee33c-565e-4308-bd87-9f682bd44f89 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:35.285441 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ee33c-565e-4308-bd87-9f682bd44f89 None admin] PATH_INFO: `/v3/projects/1db1f2b43bf4404d8bea2f850a16fde2` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:35.285848 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50ee33c-565e-4308-bd87-9f682bd44f89 None admin] RBAC: Authorizing `identity:get_project(project_id=1db1f2b43bf4404d8bea2f850a16fde2)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:35.290228 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50ee33c-565e-4308-bd87-9f682bd44f89 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:35.294029 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 67/131] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Aug 29 22:31:35 2022] GET /identity/v3/projects/1db1f2b43bf4404d8bea2f850a16fde2 => generated 312 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:35.296154 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50ee33c-565e-4308-bd87-9f682bd44f89 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:35.428220 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:35.464411 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54f00c3-cd9e-4ff2-bf91-8b79efddba26 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:35.485525 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50ee33c-565e-4308-bd87-9f682bd44f89 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:35.513677 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac539d48-e052-4abd-b73d-a6c1b4da913e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:35.514374 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac539d48-e052-4abd-b73d-a6c1b4da913e None admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:35.515282 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac539d48-e052-4abd-b73d-a6c1b4da913e None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:35.515630 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac539d48-e052-4abd-b73d-a6c1b4da913e None admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:35.516761 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac539d48-e052-4abd-b73d-a6c1b4da913e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:35.523314 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac539d48-e052-4abd-b73d-a6c1b4da913e None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:35.544243 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f827968-6c88-4967-a6cd-be3247459735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:35.546907 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f827968-6c88-4967-a6cd-be3247459735 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:35.547209 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f827968-6c88-4967-a6cd-be3247459735 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:35.548196 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f827968-6c88-4967-a6cd-be3247459735 None admin] PATH_INFO: `/v3/users/e06003fdc1b44b718b28ae60cddaafcd` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:35.559001 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 65/132] 10.222.0.47 () {60 vars in 1141 bytes} [Mon Aug 29 22:31:35 2022] POST /identity/v3/projects => generated 302 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:31:35.559851 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac539d48-e052-4abd-b73d-a6c1b4da913e None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:35.583033 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f827968-6c88-4967-a6cd-be3247459735 None admin] RBAC: Authorizing `identity:get_user(user_id=e06003fdc1b44b718b28ae60cddaafcd)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:35.584634 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f827968-6c88-4967-a6cd-be3247459735 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:35.587642 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 68/133] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Aug 29 22:31:35 2022] GET /identity/v3/users/e06003fdc1b44b718b28ae60cddaafcd => generated 289 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:35.590047 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:35.599245 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f827968-6c88-4967-a6cd-be3247459735 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:35.721322 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f827968-6c88-4967-a6cd-be3247459735 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:35.740522 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:35.767347 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f28f978-cae1-47c7-8038-7e4c7ae8e45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:35.767980 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28f978-cae1-47c7-8038-7e4c7ae8e45f None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:35.768266 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28f978-cae1-47c7-8038-7e4c7ae8e45f None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:35.768509 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac539d48-e052-4abd-b73d-a6c1b4da913e None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:35.768606 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28f978-cae1-47c7-8038-7e4c7ae8e45f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:35.821532 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26815f13-3b65-40c4-a535-255f07328f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:35.822226 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26815f13-3b65-40c4-a535-255f07328f00 None admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:35.822512 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26815f13-3b65-40c4-a535-255f07328f00 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:35.822793 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26815f13-3b65-40c4-a535-255f07328f00 None admin] PATH_INFO: `/v3/projects/1db1f2b43bf4404d8bea2f850a16fde2/users/d825c7992679472eaa3ad17d44674788/roles/0c67797d444d4c929b2ccab47c468848` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:35.834345 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26815f13-3b65-40c4-a535-255f07328f00 None admin] RBAC: Authorizing `identity:create_grant(project_id=1db1f2b43bf4404d8bea2f850a16fde2, user_id=d825c7992679472eaa3ad17d44674788, role_id=0c67797d444d4c929b2ccab47c468848)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:35.835878 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26815f13-3b65-40c4-a535-255f07328f00 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:35.864942 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 66/134] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Aug 29 22:31:35 2022] PUT /identity/v3/projects/1db1f2b43bf4404d8bea2f850a16fde2/users/d825c7992679472eaa3ad17d44674788/roles/0c67797d444d4c929b2ccab47c468848 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:31:35.911787 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f28f978-cae1-47c7-8038-7e4c7ae8e45f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:35.913313 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f28f978-cae1-47c7-8038-7e4c7ae8e45f None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:36.053405 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 69/135] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Aug 29 22:31:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:31:36.061713 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26815f13-3b65-40c4-a535-255f07328f00 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:36.140721 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:36.188661 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26815f13-3b65-40c4-a535-255f07328f00 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:36.233243 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e0e35-9fee-42c2-9b80-9a1c90ce705c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:36.234007 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e0e35-9fee-42c2-9b80-9a1c90ce705c None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:36.234290 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e0e35-9fee-42c2-9b80-9a1c90ce705c None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:36.234566 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e0e35-9fee-42c2-9b80-9a1c90ce705c None admin] PATH_INFO: `/v3/projects/86b325231ef14af1b9223cffefd8d475` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:36.238020 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9e0e35-9fee-42c2-9b80-9a1c90ce705c None admin] RBAC: Authorizing `identity:get_project(project_id=86b325231ef14af1b9223cffefd8d475)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:36.239474 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9e0e35-9fee-42c2-9b80-9a1c90ce705c None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:36.241488 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 67/136] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Aug 29 22:31:36 2022] GET /identity/v3/projects/86b325231ef14af1b9223cffefd8d475 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:36.247371 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f28f978-cae1-47c7-8038-7e4c7ae8e45f None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:36.278209 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:36.388654 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f28f978-cae1-47c7-8038-7e4c7ae8e45f None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:36.437375 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf89251-3a21-4720-ba9a-0aa4a455b5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:36.437921 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf89251-3a21-4720-ba9a-0aa4a455b5c6 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:36.438202 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf89251-3a21-4720-ba9a-0aa4a455b5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:36.438475 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf89251-3a21-4720-ba9a-0aa4a455b5c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:36.439224 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf89251-3a21-4720-ba9a-0aa4a455b5c6 None admin] RBAC: Adding query filter params (role.id=20d05bce224344d7b13c43a2e9de7abd, scope.project.id=86b325231ef14af1b9223cffefd8d475, user.id=e06003fdc1b44b718b28ae60cddaafcd) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:36.439531 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf89251-3a21-4720-ba9a-0aa4a455b5c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:36.441002 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf89251-3a21-4720-ba9a-0aa4a455b5c6 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:36.449524 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 70/137] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Aug 29 22:31:36 2022] GET /identity/v3/role_assignments?user.id=e06003fdc1b44b718b28ae60cddaafcd&scope.project.id=86b325231ef14af1b9223cffefd8d475&role.id=20d05bce224344d7b13c43a2e9de7abd => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:37.237967 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1bc990-745b-4d9a-94ac-6a8a07f0f760 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:37.238509 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1bc990-745b-4d9a-94ac-6a8a07f0f760 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:37.238509 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1bc990-745b-4d9a-94ac-6a8a07f0f760 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:37.239838 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 68/138] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:31:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:37.246128 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a309564-e34d-4ac2-b77a-e7f169730344 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:37.246601 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a309564-e34d-4ac2-b77a-e7f169730344 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:37.246957 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a309564-e34d-4ac2-b77a-e7f169730344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:37.275028 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-5a309564-e34d-4ac2-b77a-e7f169730344 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:37.276234 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-5a309564-e34d-4ac2-b77a-e7f169730344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:37.358839 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 71/139] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:31:37.721963 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1bc990-745b-4d9a-94ac-6a8a07f0f760 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:37.851369 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0880c18-2b8b-49c9-9ad4-c950480b49e5 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:37.851727 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0880c18-2b8b-49c9-9ad4-c950480b49e5 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:37.851927 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0880c18-2b8b-49c9-9ad4-c950480b49e5 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:37.856963 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 72/140] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:31:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:31:37.858542 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd152b-12b5-4713-a422-5cb1b9d02806 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:37.858830 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd152b-12b5-4713-a422-5cb1b9d02806 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:37.865350 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd152b-12b5-4713-a422-5cb1b9d02806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:37.870397 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1bc990-745b-4d9a-94ac-6a8a07f0f760 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:37.893725 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-52dd152b-12b5-4713-a422-5cb1b9d02806 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:37.894934 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-52dd152b-12b5-4713-a422-5cb1b9d02806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:37.900955 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:37.950108 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d4f17d-f203-4d82-ab96-423bb6f853ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:37.950828 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d4f17d-f203-4d82-ab96-423bb6f853ec None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:37.951171 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d4f17d-f203-4d82-ab96-423bb6f853ec None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:37.952028 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d4f17d-f203-4d82-ab96-423bb6f853ec None admin] PATH_INFO: `/v3/roles/member` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:37.961658 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:37.977104 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d4f17d-f203-4d82-ab96-423bb6f853ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:31:37.982344 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-a0d4f17d-f203-4d82-ab96-423bb6f853ec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:31:37.982344 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:37.982344 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:37.982344 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:37.982344 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:37.982344 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:37.982344 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:37.982344 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:37.982344 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:37.982344 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:37.982344 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:37.982344 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:37.982344 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:31:37.982344 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:31:37.982344 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:31:37.982344 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:31:37.983276 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:31:37.983276 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:31:37.983276 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:31:37.983276 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:31:37.983276 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:37.983276 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:37.983276 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:37.983276 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:37.983276 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:37.983276 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:37.983276 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:37.983276 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:37.983276 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:37.983276 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:37.983276 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:37.983276 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:37.984422 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:37.984422 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:37.984422 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:37.984422 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:37.984422 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:31:37.984422 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:31:37.984422 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:31:37.984422 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:31:37.984422 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:31:37.984422 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:31:37.984422 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:31:37.984422 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:31:37.984422 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 69/141] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Aug 29 22:31:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:37.997904 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edb0752-9993-46cd-bee2-86f9e8ddc488 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:37.998223 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edb0752-9993-46cd-bee2-86f9e8ddc488 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:37.998541 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edb0752-9993-46cd-bee2-86f9e8ddc488 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:38.000169 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 70/142] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:31:37 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:38.000938 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edb0752-9993-46cd-bee2-86f9e8ddc488 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:38.009391 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 73/143] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:31:38.010670 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fdbec6-776d-408e-a0d1-9152e20093e0 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:38.010960 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fdbec6-776d-408e-a0d1-9152e20093e0 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:38.011232 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fdbec6-776d-408e-a0d1-9152e20093e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:38.064825 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-69fdbec6-776d-408e-a0d1-9152e20093e0 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:38.066057 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-69fdbec6-776d-408e-a0d1-9152e20093e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:38.212332 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 74/144] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:31:38.271078 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edb0752-9993-46cd-bee2-86f9e8ddc488 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:38.323377 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef28a4-239e-49b4-9dab-f2573078336f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:38.323997 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef28a4-239e-49b4-9dab-f2573078336f None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:38.324280 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef28a4-239e-49b4-9dab-f2573078336f None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:38.324554 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef28a4-239e-49b4-9dab-f2573078336f None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:38.325225 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ef28a4-239e-49b4-9dab-f2573078336f None admin] RBAC: Adding query filter params (name=member) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:38.325559 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ef28a4-239e-49b4-9dab-f2573078336f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:38.326996 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ef28a4-239e-49b4-9dab-f2573078336f None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:38.329111 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fdbec6-776d-408e-a0d1-9152e20093e0 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:38.339600 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 71/145] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Aug 29 22:31:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:38.344723 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef28a4-239e-49b4-9dab-f2573078336f None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:38.416914 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:38.501735 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef28a4-239e-49b4-9dab-f2573078336f None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:38.535237 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:38.597417 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2444ac0d-b44b-4c02-89fe-f0b05d7a4cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:38.598062 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444ac0d-b44b-4c02-89fe-f0b05d7a4cd3 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:38.598340 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444ac0d-b44b-4c02-89fe-f0b05d7a4cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:38.598903 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444ac0d-b44b-4c02-89fe-f0b05d7a4cd3 None admin] PATH_INFO: `/v3/users/d825c7992679472eaa3ad17d44674788` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:38.600048 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2444ac0d-b44b-4c02-89fe-f0b05d7a4cd3 None admin] RBAC: Authorizing `identity:get_user(user_id=d825c7992679472eaa3ad17d44674788)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:38.601526 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2444ac0d-b44b-4c02-89fe-f0b05d7a4cd3 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:38.603129 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 72/146] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Aug 29 22:31:38 2022] GET /identity/v3/users/d825c7992679472eaa3ad17d44674788 => generated 275 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:31:38.610673 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2444ac0d-b44b-4c02-89fe-f0b05d7a4cd3 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:38.627620 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fdbec6-776d-408e-a0d1-9152e20093e0 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:38.715410 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dca6595-c483-464d-88e8-1ebc7d071814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:38.716078 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca6595-c483-464d-88e8-1ebc7d071814 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:38.716360 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca6595-c483-464d-88e8-1ebc7d071814 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:38.716636 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca6595-c483-464d-88e8-1ebc7d071814 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:38.730555 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dca6595-c483-464d-88e8-1ebc7d071814 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:31:38.735501 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-3dca6595-c483-464d-88e8-1ebc7d071814 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:31:38.735501 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:38.735501 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:38.735501 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:38.735501 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:38.735501 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:38.735501 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:38.735501 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:38.735501 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:38.735501 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:38.735501 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:38.735501 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:38.735501 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:31:38.735501 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:31:38.735501 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:31:38.735501 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:31:38.736352 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:31:38.736352 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:31:38.736352 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:31:38.736352 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:31:38.736352 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:38.736352 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:38.736352 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:38.736352 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:38.736352 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:38.736352 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:38.736352 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:38.736352 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:38.736352 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:38.736352 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:38.736352 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:38.736352 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:38.737101 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:38.737101 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:38.737101 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:38.737101 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:38.737101 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:31:38.737101 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:31:38.737101 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:31:38.737101 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:31:38.737101 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:31:38.737101 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:31:38.737101 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:31:38.737101 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:31:38.737101 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 75/147] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Aug 29 22:31:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 408 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:31:38.738595 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678bd098-eed8-47ce-b1dd-bbcb3decea1d None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:38.739101 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678bd098-eed8-47ce-b1dd-bbcb3decea1d None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:38.739539 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678bd098-eed8-47ce-b1dd-bbcb3decea1d None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:38.740928 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 76/148] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:31:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:38.741793 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678bd098-eed8-47ce-b1dd-bbcb3decea1d None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:38.801267 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2444ac0d-b44b-4c02-89fe-f0b05d7a4cd3 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:38.828734 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:38.840634 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769be51c-efc2-4122-9e68-7e9893a7ed04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:38.841548 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769be51c-efc2-4122-9e68-7e9893a7ed04 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:38.842041 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769be51c-efc2-4122-9e68-7e9893a7ed04 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:38.843034 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769be51c-efc2-4122-9e68-7e9893a7ed04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:38.854836 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678bd098-eed8-47ce-b1dd-bbcb3decea1d None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:38.884903 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:38.892698 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d44716-ca87-4cfe-bed7-34428b6782fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:38.893283 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d44716-ca87-4cfe-bed7-34428b6782fd None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:38.893596 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d44716-ca87-4cfe-bed7-34428b6782fd None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:38.893872 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d44716-ca87-4cfe-bed7-34428b6782fd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:38.904847 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d44716-ca87-4cfe-bed7-34428b6782fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:31:38.909909 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-70d44716-ca87-4cfe-bed7-34428b6782fd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:31:38.909909 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:38.909909 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:38.909909 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:38.909909 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:38.909909 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:38.909909 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:38.909909 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:38.909909 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:38.909909 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:38.909909 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:38.909909 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:38.909909 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:31:38.909909 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:31:38.909909 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:31:38.909909 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:31:38.911035 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:31:38.911035 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:31:38.911035 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:31:38.911035 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:31:38.911035 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:38.911035 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:38.911035 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:38.911035 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:38.911035 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:38.911035 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:38.911035 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:38.911035 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:38.911035 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:38.911035 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:38.911035 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:38.911035 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:38.912476 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:38.912476 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:38.912476 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:38.912476 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:38.912476 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:31:38.912476 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:31:38.912476 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:31:38.912476 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:31:38.912476 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:31:38.912476 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:31:38.912476 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:31:38.912476 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:31:38.912476 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 77/149] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Aug 29 22:31:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:38.913105 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975013b-a905-40b9-92a0-5d7698f80836 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:38.913105 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975013b-a905-40b9-92a0-5d7698f80836 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:38.913449 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975013b-a905-40b9-92a0-5d7698f80836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:38.925875 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769be51c-efc2-4122-9e68-7e9893a7ed04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:38.927369 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769be51c-efc2-4122-9e68-7e9893a7ed04 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:38.931846 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-d975013b-a905-40b9-92a0-5d7698f80836 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:38.933029 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-d975013b-a905-40b9-92a0-5d7698f80836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:39.021390 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 78/150] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:31:39.021589 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d975013b-a905-40b9-92a0-5d7698f80836 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:39.056330 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 73/151] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Aug 29 22:31:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 22:31:39.057697 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c020eef-087b-4f69-a070-5e47e34db404 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:39.057985 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c020eef-087b-4f69-a070-5e47e34db404 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:39.058260 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c020eef-087b-4f69-a070-5e47e34db404 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:39.059704 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 74/152] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:31:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:39.064734 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c020eef-087b-4f69-a070-5e47e34db404 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:39.093448 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:39.140960 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d975013b-a905-40b9-92a0-5d7698f80836 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:39.163133 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:39.179102 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d00157-1c29-4179-95be-c34a4016d6b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:39.179591 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d00157-1c29-4179-95be-c34a4016d6b9 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:39.179875 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d00157-1c29-4179-95be-c34a4016d6b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:39.180221 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d00157-1c29-4179-95be-c34a4016d6b9 None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:39.180815 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d00157-1c29-4179-95be-c34a4016d6b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:39.181118 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d00157-1c29-4179-95be-c34a4016d6b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:39.182563 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d00157-1c29-4179-95be-c34a4016d6b9 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:39.183942 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c020eef-087b-4f69-a070-5e47e34db404 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:39.191279 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 79/153] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Aug 29 22:31:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:39.196569 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d00157-1c29-4179-95be-c34a4016d6b9 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:39.224263 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfe9c67-58fd-4954-a3e7-02f2cdd61980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:39.225241 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe9c67-58fd-4954-a3e7-02f2cdd61980 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:39.225773 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe9c67-58fd-4954-a3e7-02f2cdd61980 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:39.226211 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe9c67-58fd-4954-a3e7-02f2cdd61980 None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:39.227087 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfe9c67-58fd-4954-a3e7-02f2cdd61980 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:39.227526 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfe9c67-58fd-4954-a3e7-02f2cdd61980 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:39.229268 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfe9c67-58fd-4954-a3e7-02f2cdd61980 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:39.239538 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 75/154] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Aug 29 22:31:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:39.240990 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e8733-f7f5-4f40-9bb2-a380a3b7ce8c None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:39.241460 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e8733-f7f5-4f40-9bb2-a380a3b7ce8c None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:39.241885 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e8733-f7f5-4f40-9bb2-a380a3b7ce8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:39.261634 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-f63e8733-f7f5-4f40-9bb2-a380a3b7ce8c None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:39.263333 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-f63e8733-f7f5-4f40-9bb2-a380a3b7ce8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:39.313715 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d00157-1c29-4179-95be-c34a4016d6b9 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:39.353352 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 76/155] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:31:39.353352 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e8733-f7f5-4f40-9bb2-a380a3b7ce8c None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:39.360537 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd177c0-0cbc-4226-af82-d2e5d04cbd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:39.361297 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd177c0-0cbc-4226-af82-d2e5d04cbd24 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:39.361645 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd177c0-0cbc-4226-af82-d2e5d04cbd24 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:39.361921 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd177c0-0cbc-4226-af82-d2e5d04cbd24 None admin] PATH_INFO: `/v3/projects/86b325231ef14af1b9223cffefd8d475` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:39.363189 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd177c0-0cbc-4226-af82-d2e5d04cbd24 None admin] RBAC: Authorizing `identity:get_project(project_id=86b325231ef14af1b9223cffefd8d475)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:39.364758 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd177c0-0cbc-4226-af82-d2e5d04cbd24 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:39.371132 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 80/156] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Aug 29 22:31:39 2022] GET /identity/v3/projects/86b325231ef14af1b9223cffefd8d475 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:39.371132 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd177c0-0cbc-4226-af82-d2e5d04cbd24 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:39.383582 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:39.434162 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:39.477690 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e8733-f7f5-4f40-9bb2-a380a3b7ce8c None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:39.494513 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd177c0-0cbc-4226-af82-d2e5d04cbd24 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:39.517363 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d70d3ab-31ff-49e4-ba8e-c89240394d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:39.518211 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70d3ab-31ff-49e4-ba8e-c89240394d22 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:39.518757 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70d3ab-31ff-49e4-ba8e-c89240394d22 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:39.519173 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70d3ab-31ff-49e4-ba8e-c89240394d22 None admin] PATH_INFO: `/v3/users/2844206a473948fca3069da17e9f5996` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:39.520468 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d70d3ab-31ff-49e4-ba8e-c89240394d22 None admin] RBAC: Authorizing `identity:get_user(user_id=2844206a473948fca3069da17e9f5996)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:39.522107 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d70d3ab-31ff-49e4-ba8e-c89240394d22 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:39.523830 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 77/157] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Aug 29 22:31:39 2022] GET /identity/v3/users/2844206a473948fca3069da17e9f5996 => generated 247 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:39.524907 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d70d3ab-31ff-49e4-ba8e-c89240394d22 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:39.536735 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a85a5-24df-4b60-8428-2213b2d86402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:39.537887 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a85a5-24df-4b60-8428-2213b2d86402 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:39.538172 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a85a5-24df-4b60-8428-2213b2d86402 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:39.538447 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a85a5-24df-4b60-8428-2213b2d86402 None admin] PATH_INFO: `/v3/users/d825c7992679472eaa3ad17d44674788` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:39.539904 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8a85a5-24df-4b60-8428-2213b2d86402 None admin] RBAC: Authorizing `identity:get_user(user_id=d825c7992679472eaa3ad17d44674788)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:39.541384 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8a85a5-24df-4b60-8428-2213b2d86402 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:39.547436 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 81/158] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Aug 29 22:31:39 2022] GET /identity/v3/users/d825c7992679472eaa3ad17d44674788 => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:39.547436 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a85a5-24df-4b60-8428-2213b2d86402 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:39.626658 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:39.644842 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d70d3ab-31ff-49e4-ba8e-c89240394d22 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:39.651407 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a85a5-24df-4b60-8428-2213b2d86402 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:39.669593 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:39.680122 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eb3751-e9de-4427-8751-baa22c5e4002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:39.680759 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb3751-e9de-4427-8751-baa22c5e4002 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:39.681033 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb3751-e9de-4427-8751-baa22c5e4002 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:39.681302 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb3751-e9de-4427-8751-baa22c5e4002 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:39.687427 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401757fa-7873-4157-9fda-dd7b414735d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:39.688032 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401757fa-7873-4157-9fda-dd7b414735d9 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:39.688320 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401757fa-7873-4157-9fda-dd7b414735d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:39.688599 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401757fa-7873-4157-9fda-dd7b414735d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:39.689351 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401757fa-7873-4157-9fda-dd7b414735d9 None admin] RBAC: Adding query filter params (role.id=0c67797d444d4c929b2ccab47c468848, scope.project.id=86b325231ef14af1b9223cffefd8d475, user.id=d825c7992679472eaa3ad17d44674788) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:39.689662 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401757fa-7873-4157-9fda-dd7b414735d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:39.691097 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401757fa-7873-4157-9fda-dd7b414735d9 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:39.692250 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eb3751-e9de-4427-8751-baa22c5e4002 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:31:39.696833 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 82/159] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Aug 29 22:31:39 2022] GET /identity/v3/role_assignments?user.id=d825c7992679472eaa3ad17d44674788&scope.project.id=86b325231ef14af1b9223cffefd8d475&role.id=0c67797d444d4c929b2ccab47c468848 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:39.697131 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-72eb3751-e9de-4427-8751-baa22c5e4002 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:31:39.697131 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:39.697131 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:39.697131 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:39.697131 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:39.697131 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:39.697131 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:39.697131 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:39.697131 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:39.697131 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:39.697131 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:39.697131 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:39.697131 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:31:39.697131 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:31:39.697131 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:31:39.697131 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:31:39.698300 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:31:39.698300 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:31:39.698300 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:31:39.698300 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:31:39.698300 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:39.698300 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:39.698300 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:39.698300 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:39.698300 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:39.698300 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:39.698300 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:39.698300 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:39.698300 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:39.698300 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:39.698300 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:39.698300 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:39.699053 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:39.699053 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:39.699053 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:39.699053 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:39.699053 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:31:39.699053 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:31:39.699053 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:31:39.699053 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:31:39.699053 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:31:39.699053 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:31:39.699053 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:31:39.699053 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:31:39.699659 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd196e-9d97-4bb6-af1d-31efa0ec09d5 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:39.699724 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 78/160] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Aug 29 22:31:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:39.699785 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd196e-9d97-4bb6-af1d-31efa0ec09d5 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:39.699785 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd196e-9d97-4bb6-af1d-31efa0ec09d5 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:39.699904 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eb3751-e9de-4427-8751-baa22c5e4002 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:39.699967 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 83/161] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:31:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:39.705388 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd196e-9d97-4bb6-af1d-31efa0ec09d5 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:39.829880 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd196e-9d97-4bb6-af1d-31efa0ec09d5 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:39.830502 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eb3751-e9de-4427-8751-baa22c5e4002 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:39.872584 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a60c33-aa3f-40d7-8263-00cec113b517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:39.873832 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a60c33-aa3f-40d7-8263-00cec113b517 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:39.873832 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a60c33-aa3f-40d7-8263-00cec113b517 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:39.874622 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a60c33-aa3f-40d7-8263-00cec113b517 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:39.876511 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b591b-60c1-408f-9613-82e0f090c629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:39.877886 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b591b-60c1-408f-9613-82e0f090c629 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:39.877886 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b591b-60c1-408f-9613-82e0f090c629 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:39.877886 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b591b-60c1-408f-9613-82e0f090c629 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:39.894557 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:39.937693 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:39.956678 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97b591b-60c1-408f-9613-82e0f090c629 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:39.957092 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a60c33-aa3f-40d7-8263-00cec113b517 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:39.958182 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97b591b-60c1-408f-9613-82e0f090c629 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:39.958586 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a60c33-aa3f-40d7-8263-00cec113b517 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:40.055888 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 79/162] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Aug 29 22:31:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:31:40.056140 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 84/163] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Aug 29 22:31:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:31:40.056707 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b591b-60c1-408f-9613-82e0f090c629 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:40.057404 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384fdcf-70dc-48e3-b32b-f3c959e471ba None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:40.057692 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384fdcf-70dc-48e3-b32b-f3c959e471ba None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:40.057966 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384fdcf-70dc-48e3-b32b-f3c959e471ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:40.078778 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-0384fdcf-70dc-48e3-b32b-f3c959e471ba None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:40.079999 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-0384fdcf-70dc-48e3-b32b-f3c959e471ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:40.107312 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:40.157148 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 85/164] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:31:40.158584 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384fdcf-70dc-48e3-b32b-f3c959e471ba None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:40.167167 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b591b-60c1-408f-9613-82e0f090c629 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:40.174594 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:40.218630 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f00392-f3b8-4338-948e-50c7036b4ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:40.220195 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f00392-f3b8-4338-948e-50c7036b4ec3 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:40.220952 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f00392-f3b8-4338-948e-50c7036b4ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:40.221752 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f00392-f3b8-4338-948e-50c7036b4ec3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:40.223759 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f00392-f3b8-4338-948e-50c7036b4ec3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:40.226558 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f00392-f3b8-4338-948e-50c7036b4ec3 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:40.229547 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 80/165] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:31:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:40.230875 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f00392-f3b8-4338-948e-50c7036b4ec3 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:40.293399 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384fdcf-70dc-48e3-b32b-f3c959e471ba None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:40.342249 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1884409c-2d78-4ccd-8317-a6244e61ad69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:40.343180 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884409c-2d78-4ccd-8317-a6244e61ad69 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:40.343576 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884409c-2d78-4ccd-8317-a6244e61ad69 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:40.343944 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884409c-2d78-4ccd-8317-a6244e61ad69 None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:40.344647 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f00392-f3b8-4338-948e-50c7036b4ec3 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:40.344954 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1884409c-2d78-4ccd-8317-a6244e61ad69 None admin] RBAC: Adding query filter params (name=member) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:40.345369 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1884409c-2d78-4ccd-8317-a6244e61ad69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:40.346880 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1884409c-2d78-4ccd-8317-a6244e61ad69 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:40.360124 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:40.364753 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 86/166] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Aug 29 22:31:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:40.365977 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1884409c-2d78-4ccd-8317-a6244e61ad69 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:40.382944 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e611cd-9ac2-449f-bfd0-431db3e53e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:40.383581 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e611cd-9ac2-449f-bfd0-431db3e53e0a None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:40.383864 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e611cd-9ac2-449f-bfd0-431db3e53e0a None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:40.384140 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e611cd-9ac2-449f-bfd0-431db3e53e0a None admin] PATH_INFO: `/v3/projects/86b325231ef14af1b9223cffefd8d475` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:40.385262 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e611cd-9ac2-449f-bfd0-431db3e53e0a None admin] RBAC: Authorizing `identity:get_project(project_id=86b325231ef14af1b9223cffefd8d475)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:40.386857 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e611cd-9ac2-449f-bfd0-431db3e53e0a None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:40.388758 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 81/167] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Aug 29 22:31:40 2022] GET /identity/v3/projects/86b325231ef14af1b9223cffefd8d475 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:40.394555 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e611cd-9ac2-449f-bfd0-431db3e53e0a None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:40.457766 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:40.488773 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1884409c-2d78-4ccd-8317-a6244e61ad69 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:40.505063 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e611cd-9ac2-449f-bfd0-431db3e53e0a None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:40.527519 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca5236b-28ab-4edf-a542-f32fe5fa0962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:40.528159 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5236b-28ab-4edf-a542-f32fe5fa0962 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:40.528445 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5236b-28ab-4edf-a542-f32fe5fa0962 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:40.528717 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5236b-28ab-4edf-a542-f32fe5fa0962 None admin] PATH_INFO: `/v3/projects/86b325231ef14af1b9223cffefd8d475` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:40.530436 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca5236b-28ab-4edf-a542-f32fe5fa0962 None admin] RBAC: Authorizing `identity:get_project(project_id=86b325231ef14af1b9223cffefd8d475)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:40.531988 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca5236b-28ab-4edf-a542-f32fe5fa0962 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:40.533620 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 87/168] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Aug 29 22:31:40 2022] GET /identity/v3/projects/86b325231ef14af1b9223cffefd8d475 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:40.534394 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca5236b-28ab-4edf-a542-f32fe5fa0962 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:40.541951 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bfe0c7-d5bf-4155-9bec-998b3ba354a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:40.542701 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bfe0c7-d5bf-4155-9bec-998b3ba354a0 None admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:40.543084 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bfe0c7-d5bf-4155-9bec-998b3ba354a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:40.543463 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bfe0c7-d5bf-4155-9bec-998b3ba354a0 None admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:40.544396 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bfe0c7-d5bf-4155-9bec-998b3ba354a0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:40.546220 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bfe0c7-d5bf-4155-9bec-998b3ba354a0 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:40.568825 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 82/169] 10.222.0.47 () {60 vars in 1132 bytes} [Mon Aug 29 22:31:40 2022] POST /identity/v3/users => generated 283 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:31:40.570318 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bfe0c7-d5bf-4155-9bec-998b3ba354a0 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:40.612878 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:40.664577 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca5236b-28ab-4edf-a542-f32fe5fa0962 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:40.694398 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bfe0c7-d5bf-4155-9bec-998b3ba354a0 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:40.704390 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca2dee2-618d-4bef-8a3d-f315626da93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:40.705036 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca2dee2-618d-4bef-8a3d-f315626da93a None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:40.705313 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca2dee2-618d-4bef-8a3d-f315626da93a None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:40.705620 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca2dee2-618d-4bef-8a3d-f315626da93a None admin] PATH_INFO: `/v3/users/d825c7992679472eaa3ad17d44674788` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:40.706780 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca2dee2-618d-4bef-8a3d-f315626da93a None admin] RBAC: Authorizing `identity:get_user(user_id=d825c7992679472eaa3ad17d44674788)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:40.708279 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca2dee2-618d-4bef-8a3d-f315626da93a None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:40.709842 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 88/170] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Aug 29 22:31:40 2022] GET /identity/v3/users/d825c7992679472eaa3ad17d44674788 => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:40.710610 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca2dee2-618d-4bef-8a3d-f315626da93a None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:40.724629 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:40.735211 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0693f7a7-814c-42a9-8276-71fd508890a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:40.735831 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693f7a7-814c-42a9-8276-71fd508890a3 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:40.736116 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693f7a7-814c-42a9-8276-71fd508890a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:40.736392 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693f7a7-814c-42a9-8276-71fd508890a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:40.737141 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0693f7a7-814c-42a9-8276-71fd508890a3 None admin] RBAC: Adding query filter params (role.id=d00eabaec96a4956aaec2c37a5819c25, scope.project.id=86b325231ef14af1b9223cffefd8d475, user.id=2844206a473948fca3069da17e9f5996) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:40.737898 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0693f7a7-814c-42a9-8276-71fd508890a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:40.739472 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0693f7a7-814c-42a9-8276-71fd508890a3 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:40.746825 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 83/171] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Aug 29 22:31:40 2022] GET /identity/v3/role_assignments?user.id=2844206a473948fca3069da17e9f5996&scope.project.id=86b325231ef14af1b9223cffefd8d475&role.id=d00eabaec96a4956aaec2c37a5819c25 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:40.749211 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0693f7a7-814c-42a9-8276-71fd508890a3 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:40.843868 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca2dee2-618d-4bef-8a3d-f315626da93a None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:40.887916 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:40.890549 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0693f7a7-814c-42a9-8276-71fd508890a3 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:40.892304 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ffd09-83c5-41ce-b5d5-91c5c44431f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:40.893139 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ffd09-83c5-41ce-b5d5-91c5c44431f4 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:40.893640 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ffd09-83c5-41ce-b5d5-91c5c44431f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:40.894144 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ffd09-83c5-41ce-b5d5-91c5c44431f4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:40.910707 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539ffd09-83c5-41ce-b5d5-91c5c44431f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:31:40.916637 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-539ffd09-83c5-41ce-b5d5-91c5c44431f4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 22:31:40.916637 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:40.916637 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:40.916637 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:40.916637 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:40.916637 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:40.916637 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:40.916637 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:40.916637 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:40.916637 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:40.916637 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:40.916637 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:40.916637 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:31:40.916637 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:31:40.916637 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:31:40.916637 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:31:40.917659 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:31:40.917659 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:31:40.917659 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:31:40.917659 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:31:40.917659 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:40.917659 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:40.917659 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:40.917659 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:40.917659 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:40.917659 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:40.917659 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:40.917659 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:40.917659 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:40.917659 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:40.917659 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:40.917659 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:40.918479 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:40.918479 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:40.918479 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:40.918479 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:40.918479 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:31:40.918479 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:31:40.918479 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:31:40.918479 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:31:40.918479 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:31:40.918479 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:31:40.918479 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 22:31:40.918479 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:31:40.919630 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 89/172] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Aug 29 22:31:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:40.920392 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ffd09-83c5-41ce-b5d5-91c5c44431f4 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:40.935659 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c2c721-aa1c-4183-887a-aac3e8ed2d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:40.937149 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2c721-aa1c-4183-887a-aac3e8ed2d67 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:40.937549 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2c721-aa1c-4183-887a-aac3e8ed2d67 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:40.937830 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2c721-aa1c-4183-887a-aac3e8ed2d67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:40.939084 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c2c721-aa1c-4183-887a-aac3e8ed2d67 None admin] RBAC: Adding query filter params (role.id=066c4a2915d247089e9df06936eb9a97, scope.project.id=86b325231ef14af1b9223cffefd8d475, user.id=d825c7992679472eaa3ad17d44674788) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:40.939403 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c2c721-aa1c-4183-887a-aac3e8ed2d67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:40.941144 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c2c721-aa1c-4183-887a-aac3e8ed2d67 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:40.948519 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 84/173] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Aug 29 22:31:40 2022] GET /identity/v3/role_assignments?user.id=d825c7992679472eaa3ad17d44674788&scope.project.id=86b325231ef14af1b9223cffefd8d475&role.id=066c4a2915d247089e9df06936eb9a97 => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:40.949496 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c2c721-aa1c-4183-887a-aac3e8ed2d67 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:41.026307 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:41.064692 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ffd09-83c5-41ce-b5d5-91c5c44431f4 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:41.077830 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c2c721-aa1c-4183-887a-aac3e8ed2d67 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:41.106528 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac6f80f-4a17-45f7-982a-81c3360bd9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:41.107158 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac6f80f-4a17-45f7-982a-81c3360bd9b2 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:41.107965 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac6f80f-4a17-45f7-982a-81c3360bd9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:41.108243 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac6f80f-4a17-45f7-982a-81c3360bd9b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:41.116480 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9859725-f859-4bab-ae0c-4ac982687c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:41.117115 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9859725-f859-4bab-ae0c-4ac982687c65 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:41.117431 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9859725-f859-4bab-ae0c-4ac982687c65 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:41.117722 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9859725-f859-4bab-ae0c-4ac982687c65 None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:41.118404 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9859725-f859-4bab-ae0c-4ac982687c65 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:41.118768 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9859725-f859-4bab-ae0c-4ac982687c65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:41.120192 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9859725-f859-4bab-ae0c-4ac982687c65 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:41.131434 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 85/174] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Aug 29 22:31:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:41.136796 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9859725-f859-4bab-ae0c-4ac982687c65 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:41.173734 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:41.195231 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac6f80f-4a17-45f7-982a-81c3360bd9b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:41.196691 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac6f80f-4a17-45f7-982a-81c3360bd9b2 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:41.276580 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9859725-f859-4bab-ae0c-4ac982687c65 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:41.298044 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:41.326969 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b342d6-9a38-4dfc-9c24-6c6fdc81cec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:41.327934 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b342d6-9a38-4dfc-9c24-6c6fdc81cec0 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:41.328448 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b342d6-9a38-4dfc-9c24-6c6fdc81cec0 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:41.328926 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b342d6-9a38-4dfc-9c24-6c6fdc81cec0 None admin] PATH_INFO: `/v3/users/e06003fdc1b44b718b28ae60cddaafcd` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:41.330502 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b342d6-9a38-4dfc-9c24-6c6fdc81cec0 None admin] RBAC: Authorizing `identity:get_user(user_id=e06003fdc1b44b718b28ae60cddaafcd)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:41.332243 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b342d6-9a38-4dfc-9c24-6c6fdc81cec0 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:41.334587 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 86/175] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Aug 29 22:31:41 2022] GET /identity/v3/users/e06003fdc1b44b718b28ae60cddaafcd => generated 289 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:31:41.337372 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 90/176] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Aug 29 22:31:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:31:41.343077 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b342d6-9a38-4dfc-9c24-6c6fdc81cec0 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:41.344790 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac6f80f-4a17-45f7-982a-81c3360bd9b2 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:41.478457 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:41.488865 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b342d6-9a38-4dfc-9c24-6c6fdc81cec0 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:41.495465 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac6f80f-4a17-45f7-982a-81c3360bd9b2 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:41.553349 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb88c9c-bb8d-4cbd-abdd-b2b4c91792d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:41.553927 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb88c9c-bb8d-4cbd-abdd-b2b4c91792d7 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:41.554214 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb88c9c-bb8d-4cbd-abdd-b2b4c91792d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:41.556488 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb88c9c-bb8d-4cbd-abdd-b2b4c91792d7 None admin] PATH_INFO: `/v3/projects/86b325231ef14af1b9223cffefd8d475` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:41.558406 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb88c9c-bb8d-4cbd-abdd-b2b4c91792d7 None admin] RBAC: Authorizing `identity:get_project(project_id=86b325231ef14af1b9223cffefd8d475)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:41.559868 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb88c9c-bb8d-4cbd-abdd-b2b4c91792d7 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:41.562110 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 87/177] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Aug 29 22:31:41 2022] GET /identity/v3/projects/86b325231ef14af1b9223cffefd8d475 => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:41.568180 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb88c9c-bb8d-4cbd-abdd-b2b4c91792d7 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:41.572274 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d5e5a4-cb6a-4a68-8fdd-d81717395216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:41.572923 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d5e5a4-cb6a-4a68-8fdd-d81717395216 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:41.573204 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d5e5a4-cb6a-4a68-8fdd-d81717395216 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:41.573521 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d5e5a4-cb6a-4a68-8fdd-d81717395216 None admin] PATH_INFO: `/v3/projects/1db1f2b43bf4404d8bea2f850a16fde2` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:41.575452 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d5e5a4-cb6a-4a68-8fdd-d81717395216 None admin] RBAC: Authorizing `identity:get_project(project_id=1db1f2b43bf4404d8bea2f850a16fde2)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:41.577366 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d5e5a4-cb6a-4a68-8fdd-d81717395216 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:41.579041 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 91/178] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Aug 29 22:31:41 2022] GET /identity/v3/projects/1db1f2b43bf4404d8bea2f850a16fde2 => generated 312 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:41.584991 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d5e5a4-cb6a-4a68-8fdd-d81717395216 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:41.674313 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:41.689927 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb88c9c-bb8d-4cbd-abdd-b2b4c91792d7 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:41.736007 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8799e22-ae5e-4834-9585-4ffe379adba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:41.736986 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8799e22-ae5e-4834-9585-4ffe379adba1 None admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:41.737575 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8799e22-ae5e-4834-9585-4ffe379adba1 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:41.737988 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8799e22-ae5e-4834-9585-4ffe379adba1 None admin] PATH_INFO: `/v3/projects/86b325231ef14af1b9223cffefd8d475/users/e06003fdc1b44b718b28ae60cddaafcd/roles/20d05bce224344d7b13c43a2e9de7abd` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:41.740840 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8799e22-ae5e-4834-9585-4ffe379adba1 None admin] RBAC: Authorizing `identity:create_grant(project_id=86b325231ef14af1b9223cffefd8d475, user_id=e06003fdc1b44b718b28ae60cddaafcd, role_id=20d05bce224344d7b13c43a2e9de7abd)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:41.743114 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8799e22-ae5e-4834-9585-4ffe379adba1 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:41.774059 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d5e5a4-cb6a-4a68-8fdd-d81717395216 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:41.774864 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 88/179] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Aug 29 22:31:41 2022] PUT /identity/v3/projects/86b325231ef14af1b9223cffefd8d475/users/e06003fdc1b44b718b28ae60cddaafcd/roles/20d05bce224344d7b13c43a2e9de7abd => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:31:41.845475 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a576febc-f89a-4db2-b30f-c564a7728991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:41.846538 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a576febc-f89a-4db2-b30f-c564a7728991 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:41.847029 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a576febc-f89a-4db2-b30f-c564a7728991 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:41.847534 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a576febc-f89a-4db2-b30f-c564a7728991 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:41.848521 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a576febc-f89a-4db2-b30f-c564a7728991 None admin] RBAC: Adding query filter params (role.id=0c67797d444d4c929b2ccab47c468848, scope.project.id=1db1f2b43bf4404d8bea2f850a16fde2, user.id=d825c7992679472eaa3ad17d44674788) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:41.849055 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a576febc-f89a-4db2-b30f-c564a7728991 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:41.850846 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a576febc-f89a-4db2-b30f-c564a7728991 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:41.862940 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 92/180] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Aug 29 22:31:41 2022] GET /identity/v3/role_assignments?user.id=d825c7992679472eaa3ad17d44674788&scope.project.id=1db1f2b43bf4404d8bea2f850a16fde2&role.id=0c67797d444d4c929b2ccab47c468848 => generated 608 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:43.015427 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad773bad-e430-41e6-a8e3-da7d1c3bf78b None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:43.016613 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad773bad-e430-41e6-a8e3-da7d1c3bf78b None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:43.017099 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad773bad-e430-41e6-a8e3-da7d1c3bf78b None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:43.019056 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 89/181] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:31:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:43.025527 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f58811-1277-496d-a6bc-5bce338a31a7 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:43.026505 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f58811-1277-496d-a6bc-5bce338a31a7 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:43.027026 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f58811-1277-496d-a6bc-5bce338a31a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:43.048348 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-a2f58811-1277-496d-a6bc-5bce338a31a7 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:43.049953 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-a2f58811-1277-496d-a6bc-5bce338a31a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:43.124445 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 93/182] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:31:43.301156 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24bf692-9afb-41d9-a39c-9a4882c76855 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:43.301485 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24bf692-9afb-41d9-a39c-9a4882c76855 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:43.301662 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24bf692-9afb-41d9-a39c-9a4882c76855 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:43.305025 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 90/183] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:31:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:43.313152 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02bd0e3-b11c-4ed1-918d-8cb2ffae4ad2 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:43.313766 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02bd0e3-b11c-4ed1-918d-8cb2ffae4ad2 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:43.314253 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02bd0e3-b11c-4ed1-918d-8cb2ffae4ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:43.334210 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-e02bd0e3-b11c-4ed1-918d-8cb2ffae4ad2 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:43.335800 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-e02bd0e3-b11c-4ed1-918d-8cb2ffae4ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:43.363365 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:43.397691 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24bf692-9afb-41d9-a39c-9a4882c76855 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:43.408850 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 94/184] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:31:43.427194 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:43.487280 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a8a30-a948-4aba-86b8-e8a89097a4a9 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:43.487646 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a8a30-a948-4aba-86b8-e8a89097a4a9 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:43.487832 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a8a30-a948-4aba-86b8-e8a89097a4a9 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:43.489355 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 95/185] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:31:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:31:43.494590 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f691e2-2d1f-4e10-baaf-24b63e22e149 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:43.494875 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f691e2-2d1f-4e10-baaf-24b63e22e149 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:43.495153 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f691e2-2d1f-4e10-baaf-24b63e22e149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:43.517223 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-d2f691e2-2d1f-4e10-baaf-24b63e22e149 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:43.518502 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-d2f691e2-2d1f-4e10-baaf-24b63e22e149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:43.520021 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24bf692-9afb-41d9-a39c-9a4882c76855 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:43.566900 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73ef245-c48a-482e-ad9c-97999ec3ed2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:43.568176 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ef245-c48a-482e-ad9c-97999ec3ed2a None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:43.569362 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ef245-c48a-482e-ad9c-97999ec3ed2a None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:43.570038 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ef245-c48a-482e-ad9c-97999ec3ed2a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:43.585882 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73ef245-c48a-482e-ad9c-97999ec3ed2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:31:43.594025 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-a73ef245-c48a-482e-ad9c-97999ec3ed2a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:31:43.594025 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:43.594025 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:43.594025 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:43.594025 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:43.594025 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:43.594025 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:43.594025 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:43.594025 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:43.594025 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:43.594025 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:43.594025 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:43.594025 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:31:43.594025 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:31:43.594025 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:31:43.594025 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:31:43.594937 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:31:43.594937 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:31:43.594937 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:31:43.594937 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:31:43.594937 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:43.594937 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:43.594937 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:43.594937 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:43.594937 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:43.594937 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:43.594937 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:43.594937 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:43.594937 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:43.594937 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:43.594937 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:43.594937 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:43.595751 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:43.595751 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:43.595751 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:43.595751 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:43.595751 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:31:43.595751 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:31:43.595751 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:31:43.595751 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:31:43.595751 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:31:43.595751 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:31:43.595751 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:31:43.595751 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:31:43.599080 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 91/186] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Aug 29 22:31:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:31:43.604859 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73ef245-c48a-482e-ad9c-97999ec3ed2a None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:43.606235 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 96/187] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:31:43.696198 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:43.710697 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f691e2-2d1f-4e10-baaf-24b63e22e149 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:43.715436 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73ef245-c48a-482e-ad9c-97999ec3ed2a None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:43.753103 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ccb030-6714-4a00-b919-740e05414d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:43.753821 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ccb030-6714-4a00-b919-740e05414d8d None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:43.754100 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ccb030-6714-4a00-b919-740e05414d8d None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:43.754369 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ccb030-6714-4a00-b919-740e05414d8d None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:43.755042 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ccb030-6714-4a00-b919-740e05414d8d None admin] RBAC: Adding query filter params (name=admin) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:43.755341 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ccb030-6714-4a00-b919-740e05414d8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:43.756724 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ccb030-6714-4a00-b919-740e05414d8d None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:43.765704 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 92/188] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Aug 29 22:31:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:31:43.771399 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ccb030-6714-4a00-b919-740e05414d8d None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:43.812752 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:43.824188 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f691e2-2d1f-4e10-baaf-24b63e22e149 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:43.863725 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9728f23-53aa-4439-905b-fb8a047338fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:43.864681 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9728f23-53aa-4439-905b-fb8a047338fc None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:43.865127 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9728f23-53aa-4439-905b-fb8a047338fc None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:43.865601 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9728f23-53aa-4439-905b-fb8a047338fc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:43.876944 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9728f23-53aa-4439-905b-fb8a047338fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:31:43.882163 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-f9728f23-53aa-4439-905b-fb8a047338fc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:31:43.882163 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:43.882163 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:43.882163 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:43.882163 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:43.882163 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:43.882163 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:43.882163 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:43.882163 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:43.882163 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:43.882163 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:43.882163 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:43.882163 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:31:43.882163 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:31:43.882163 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:31:43.882163 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:31:43.883013 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:31:43.883013 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:31:43.883013 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:31:43.883013 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:31:43.883013 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:43.883013 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:43.883013 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:43.883013 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:43.883013 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:43.883013 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:43.883013 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:43.883013 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:43.883013 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:43.883013 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:43.883013 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:43.883013 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:43.883783 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:43.883783 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:43.883783 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:43.883783 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:43.883783 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:31:43.883783 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:31:43.883783 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:31:43.883783 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:31:43.883783 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:31:43.883783 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:31:43.883783 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:31:43.883783 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:31:43.891271 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ccb030-6714-4a00-b919-740e05414d8d None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:43.891560 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 97/189] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Aug 29 22:31:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:43.892624 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9728f23-53aa-4439-905b-fb8a047338fc None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:43.925694 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1ec010-a035-485a-be97-4605cc905954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:43.926342 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ec010-a035-485a-be97-4605cc905954 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:43.926624 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ec010-a035-485a-be97-4605cc905954 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:43.926903 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ec010-a035-485a-be97-4605cc905954 None admin] PATH_INFO: `/v3/users/4253cc88955e4893bdae00e2361312d0` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:43.942991 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1ec010-a035-485a-be97-4605cc905954 None admin] RBAC: Authorizing `identity:get_user(user_id=4253cc88955e4893bdae00e2361312d0)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:43.944450 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1ec010-a035-485a-be97-4605cc905954 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:43.946171 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 93/190] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Aug 29 22:31:43 2022] GET /identity/v3/users/4253cc88955e4893bdae00e2361312d0 => generated 283 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:31:43.951488 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1ec010-a035-485a-be97-4605cc905954 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:43.951488 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:44.000903 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9728f23-53aa-4439-905b-fb8a047338fc None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:44.041171 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b28bc-20bb-4ff7-91c8-8cd15227af54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:44.041910 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b28bc-20bb-4ff7-91c8-8cd15227af54 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:44.042204 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b28bc-20bb-4ff7-91c8-8cd15227af54 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:44.042488 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b28bc-20bb-4ff7-91c8-8cd15227af54 None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:44.043245 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618b28bc-20bb-4ff7-91c8-8cd15227af54 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:44.043591 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618b28bc-20bb-4ff7-91c8-8cd15227af54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:44.045504 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618b28bc-20bb-4ff7-91c8-8cd15227af54 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:44.050744 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1ec010-a035-485a-be97-4605cc905954 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:44.053744 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 98/191] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Aug 29 22:31:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:44.058296 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14722db9-4891-46d3-a1cf-f3d65a182ff9 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:44.058296 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14722db9-4891-46d3-a1cf-f3d65a182ff9 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:44.058296 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14722db9-4891-46d3-a1cf-f3d65a182ff9 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:44.058296 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 99/192] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:31:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:44.058296 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14722db9-4891-46d3-a1cf-f3d65a182ff9 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:44.078531 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:44.089646 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac5c84-a0c6-4b1a-bb76-2a55e6f455d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:44.090291 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac5c84-a0c6-4b1a-bb76-2a55e6f455d1 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:44.090571 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac5c84-a0c6-4b1a-bb76-2a55e6f455d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:44.090848 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac5c84-a0c6-4b1a-bb76-2a55e6f455d1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:44.092622 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ac5c84-a0c6-4b1a-bb76-2a55e6f455d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:44.094096 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ac5c84-a0c6-4b1a-bb76-2a55e6f455d1 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:44.095662 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 94/193] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:31:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:44.096420 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac5c84-a0c6-4b1a-bb76-2a55e6f455d1 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:44.168613 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:44.168878 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14722db9-4891-46d3-a1cf-f3d65a182ff9 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:44.201507 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac5c84-a0c6-4b1a-bb76-2a55e6f455d1 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:44.203200 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c344e4e7-5572-46dc-a900-a737b6da099b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:44.203805 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344e4e7-5572-46dc-a900-a737b6da099b None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:44.204081 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344e4e7-5572-46dc-a900-a737b6da099b None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:44.204349 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344e4e7-5572-46dc-a900-a737b6da099b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:44.237415 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f279cb-8265-4d3a-8f56-dd5e5a8c240b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:44.238047 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f279cb-8265-4d3a-8f56-dd5e5a8c240b None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:44.238324 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f279cb-8265-4d3a-8f56-dd5e5a8c240b None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:44.238595 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f279cb-8265-4d3a-8f56-dd5e5a8c240b None admin] PATH_INFO: `/v3/users/4253cc88955e4893bdae00e2361312d0` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:44.239709 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f279cb-8265-4d3a-8f56-dd5e5a8c240b None admin] RBAC: Authorizing `identity:get_user(user_id=4253cc88955e4893bdae00e2361312d0)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:44.241162 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f279cb-8265-4d3a-8f56-dd5e5a8c240b None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:44.242766 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 95/194] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Aug 29 22:31:44 2022] GET /identity/v3/users/4253cc88955e4893bdae00e2361312d0 => generated 283 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:44.243937 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dea86f-83f2-4d8a-a7fa-a7c27dd9bf7d None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:44.244227 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dea86f-83f2-4d8a-a7fa-a7c27dd9bf7d None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:44.244495 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dea86f-83f2-4d8a-a7fa-a7c27dd9bf7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:44.264753 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-16dea86f-83f2-4d8a-a7fa-a7c27dd9bf7d None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:44.265997 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-16dea86f-83f2-4d8a-a7fa-a7c27dd9bf7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:44.277463 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c344e4e7-5572-46dc-a900-a737b6da099b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:44.279062 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c344e4e7-5572-46dc-a900-a737b6da099b None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:44.293830 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:44.339744 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 96/195] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:31:44.342409 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dea86f-83f2-4d8a-a7fa-a7c27dd9bf7d None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:44.387272 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 100/196] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Aug 29 22:31:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:31:44.387986 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c344e4e7-5572-46dc-a900-a737b6da099b None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:44.416521 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:44.458787 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dea86f-83f2-4d8a-a7fa-a7c27dd9bf7d None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:44.492538 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c344e4e7-5572-46dc-a900-a737b6da099b None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:44.494787 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b810a-e6a2-4266-a003-a6457fac7075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:44.495404 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b810a-e6a2-4266-a003-a6457fac7075 None admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:44.495686 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b810a-e6a2-4266-a003-a6457fac7075 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:44.495963 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b810a-e6a2-4266-a003-a6457fac7075 None admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:44.496610 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518b810a-e6a2-4266-a003-a6457fac7075 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:44.498625 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518b810a-e6a2-4266-a003-a6457fac7075 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:44.509101 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:44.524878 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 97/197] 10.222.0.47 () {60 vars in 1132 bytes} [Mon Aug 29 22:31:44 2022] POST /identity/v3/users => generated 297 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:31:44.526278 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b810a-e6a2-4266-a003-a6457fac7075 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:44.535889 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e769d8-e7c9-44a8-84c7-a2eb5c6f0aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:44.536676 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e769d8-e7c9-44a8-84c7-a2eb5c6f0aaf None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:44.537056 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e769d8-e7c9-44a8-84c7-a2eb5c6f0aaf None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:44.537480 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e769d8-e7c9-44a8-84c7-a2eb5c6f0aaf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:44.635912 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e769d8-e7c9-44a8-84c7-a2eb5c6f0aaf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:44.637437 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e769d8-e7c9-44a8-84c7-a2eb5c6f0aaf None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:44.656847 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b810a-e6a2-4266-a003-a6457fac7075 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:44.687151 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:44.702275 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82158e91-1e4c-41b6-92d4-7f25b36cd641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:44.702927 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82158e91-1e4c-41b6-92d4-7f25b36cd641 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:44.703215 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82158e91-1e4c-41b6-92d4-7f25b36cd641 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:44.703493 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82158e91-1e4c-41b6-92d4-7f25b36cd641 None admin] PATH_INFO: `/v3/projects/2d92e217cd6146f7910ea8e021e81cb4` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:44.704711 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82158e91-1e4c-41b6-92d4-7f25b36cd641 None admin] RBAC: Authorizing `identity:get_project(project_id=2d92e217cd6146f7910ea8e021e81cb4)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:44.706886 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82158e91-1e4c-41b6-92d4-7f25b36cd641 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:44.709144 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 98/198] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Aug 29 22:31:44 2022] GET /identity/v3/projects/2d92e217cd6146f7910ea8e021e81cb4 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:44.709144 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82158e91-1e4c-41b6-92d4-7f25b36cd641 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:44.782421 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 101/199] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Aug 29 22:31:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:31:44.783473 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e769d8-e7c9-44a8-84c7-a2eb5c6f0aaf None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:44.812237 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:44.853472 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82158e91-1e4c-41b6-92d4-7f25b36cd641 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:44.898139 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ea1a7-c793-4ae7-a41f-656d0d602b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:44.899249 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ea1a7-c793-4ae7-a41f-656d0d602b87 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:44.899840 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ea1a7-c793-4ae7-a41f-656d0d602b87 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:44.900301 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ea1a7-c793-4ae7-a41f-656d0d602b87 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:44.914640 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66ea1a7-c793-4ae7-a41f-656d0d602b87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:31:44.921183 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-b66ea1a7-c793-4ae7-a41f-656d0d602b87 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 22:31:44.921183 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:44.921183 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:44.921183 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:44.921183 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:44.921183 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:44.921183 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:44.921183 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:44.921183 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:44.921183 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:44.921183 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:44.921183 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:44.921183 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:31:44.921183 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:31:44.921183 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:31:44.921183 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:31:44.922137 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:31:44.922137 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:31:44.922137 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:31:44.922137 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:31:44.922137 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:44.922137 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:44.922137 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:44.922137 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:44.922137 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:44.922137 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:44.922137 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:44.922137 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:44.922137 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:44.922137 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:44.922137 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:44.922137 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:44.922917 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:44.922917 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:44.922917 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:44.922917 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:44.922917 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:31:44.922917 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:31:44.922917 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:31:44.922917 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:31:44.922917 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:31:44.922917 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:31:44.922917 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 22:31:44.922917 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:31:44.923585 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e769d8-e7c9-44a8-84c7-a2eb5c6f0aaf None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:44.925370 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 99/200] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Aug 29 22:31:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:44.926383 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ea1a7-c793-4ae7-a41f-656d0d602b87 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:44.970163 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f64b2c9-a1f3-4d11-9141-13690797aab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:44.970772 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f64b2c9-a1f3-4d11-9141-13690797aab2 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:44.971049 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f64b2c9-a1f3-4d11-9141-13690797aab2 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:44.971320 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f64b2c9-a1f3-4d11-9141-13690797aab2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:44.972050 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f64b2c9-a1f3-4d11-9141-13690797aab2 None admin] RBAC: Adding query filter params (role.id=d00eabaec96a4956aaec2c37a5819c25, scope.project.id=2d92e217cd6146f7910ea8e021e81cb4, user.id=4253cc88955e4893bdae00e2361312d0) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:44.972352 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f64b2c9-a1f3-4d11-9141-13690797aab2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:44.973833 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f64b2c9-a1f3-4d11-9141-13690797aab2 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:44.980063 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 102/201] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Aug 29 22:31:44 2022] GET /identity/v3/role_assignments?user.id=4253cc88955e4893bdae00e2361312d0&scope.project.id=2d92e217cd6146f7910ea8e021e81cb4&role.id=d00eabaec96a4956aaec2c37a5819c25 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:44.980703 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f64b2c9-a1f3-4d11-9141-13690797aab2 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:45.001407 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:45.059436 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ea1a7-c793-4ae7-a41f-656d0d602b87 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:45.071631 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:45.097993 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f64b2c9-a1f3-4d11-9141-13690797aab2 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:45.101887 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6987e69-afc9-4535-832c-3bb697138337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:45.102550 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6987e69-afc9-4535-832c-3bb697138337 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:45.102835 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6987e69-afc9-4535-832c-3bb697138337 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:45.103116 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6987e69-afc9-4535-832c-3bb697138337 None admin] PATH_INFO: `/v3/projects/2d92e217cd6146f7910ea8e021e81cb4` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:45.106069 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6987e69-afc9-4535-832c-3bb697138337 None admin] RBAC: Authorizing `identity:get_project(project_id=2d92e217cd6146f7910ea8e021e81cb4)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:45.110045 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6987e69-afc9-4535-832c-3bb697138337 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:45.113182 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 100/202] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Aug 29 22:31:44 2022] GET /identity/v3/projects/2d92e217cd6146f7910ea8e021e81cb4 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:45.118937 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6987e69-afc9-4535-832c-3bb697138337 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:45.170100 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1df0a2-60b9-4c12-a57b-bceb9dff0936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:45.170723 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1df0a2-60b9-4c12-a57b-bceb9dff0936 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:45.171094 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1df0a2-60b9-4c12-a57b-bceb9dff0936 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:45.171441 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1df0a2-60b9-4c12-a57b-bceb9dff0936 None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:45.172200 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1df0a2-60b9-4c12-a57b-bceb9dff0936 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:45.172585 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1df0a2-60b9-4c12-a57b-bceb9dff0936 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:45.174332 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1df0a2-60b9-4c12-a57b-bceb9dff0936 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:45.196907 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 103/203] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Aug 29 22:31:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:45.204154 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1df0a2-60b9-4c12-a57b-bceb9dff0936 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:45.279783 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6987e69-afc9-4535-832c-3bb697138337 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:45.304197 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:45.322106 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90934e7-32c7-45ee-afbf-708abfd33031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:45.322886 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90934e7-32c7-45ee-afbf-708abfd33031 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:45.323281 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90934e7-32c7-45ee-afbf-708abfd33031 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:45.323637 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90934e7-32c7-45ee-afbf-708abfd33031 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:45.324437 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90934e7-32c7-45ee-afbf-708abfd33031 None admin] RBAC: Adding query filter params (role.id=066c4a2915d247089e9df06936eb9a97, scope.project.id=2d92e217cd6146f7910ea8e021e81cb4, user.id=4253cc88955e4893bdae00e2361312d0) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:45.324815 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90934e7-32c7-45ee-afbf-708abfd33031 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:45.326631 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90934e7-32c7-45ee-afbf-708abfd33031 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:45.334605 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 101/204] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Aug 29 22:31:45 2022] GET /identity/v3/role_assignments?user.id=4253cc88955e4893bdae00e2361312d0&scope.project.id=2d92e217cd6146f7910ea8e021e81cb4&role.id=066c4a2915d247089e9df06936eb9a97 => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:45.375720 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1df0a2-60b9-4c12-a57b-bceb9dff0936 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:45.436437 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35750812-d57b-4579-8ca6-b1353e4064b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:45.437011 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35750812-d57b-4579-8ca6-b1353e4064b4 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:45.437293 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35750812-d57b-4579-8ca6-b1353e4064b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:45.437595 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35750812-d57b-4579-8ca6-b1353e4064b4 None admin] PATH_INFO: `/v3/users/e06003fdc1b44b718b28ae60cddaafcd` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:45.438788 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35750812-d57b-4579-8ca6-b1353e4064b4 None admin] RBAC: Authorizing `identity:get_user(user_id=e06003fdc1b44b718b28ae60cddaafcd)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:45.440270 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35750812-d57b-4579-8ca6-b1353e4064b4 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:45.441970 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 104/205] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Aug 29 22:31:45 2022] GET /identity/v3/users/e06003fdc1b44b718b28ae60cddaafcd => generated 289 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:31:45.447979 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90934e7-32c7-45ee-afbf-708abfd33031 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:45.574269 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90934e7-32c7-45ee-afbf-708abfd33031 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:45.620199 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d607d940-9f83-4e7b-8526-c92caa9b9366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:45.620868 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d607d940-9f83-4e7b-8526-c92caa9b9366 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:45.621153 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d607d940-9f83-4e7b-8526-c92caa9b9366 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:45.621449 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d607d940-9f83-4e7b-8526-c92caa9b9366 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:45.696350 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:45.717710 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d607d940-9f83-4e7b-8526-c92caa9b9366 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:45.719187 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d607d940-9f83-4e7b-8526-c92caa9b9366 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:45.854050 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 102/206] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Aug 29 22:31:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:31:45.859952 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35750812-d57b-4579-8ca6-b1353e4064b4 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:45.883447 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:46.018079 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35750812-d57b-4579-8ca6-b1353e4064b4 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:46.059526 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb24a03-2e4f-4b49-a66a-5064e39372c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:46.060409 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb24a03-2e4f-4b49-a66a-5064e39372c6 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:46.060892 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb24a03-2e4f-4b49-a66a-5064e39372c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:46.061169 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb24a03-2e4f-4b49-a66a-5064e39372c6 None admin] PATH_INFO: `/v3/projects/86b325231ef14af1b9223cffefd8d475` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:46.062332 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb24a03-2e4f-4b49-a66a-5064e39372c6 None admin] RBAC: Authorizing `identity:get_project(project_id=86b325231ef14af1b9223cffefd8d475)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:46.064294 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb24a03-2e4f-4b49-a66a-5064e39372c6 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:46.066009 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 105/207] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Aug 29 22:31:45 2022] GET /identity/v3/projects/86b325231ef14af1b9223cffefd8d475 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:46.072160 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d607d940-9f83-4e7b-8526-c92caa9b9366 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:46.191057 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:46.216638 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d607d940-9f83-4e7b-8526-c92caa9b9366 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:46.267028 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f1aaf-1a9d-412a-98c1-c097b00d90bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:46.267648 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f1aaf-1a9d-412a-98c1-c097b00d90bc None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:46.267927 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f1aaf-1a9d-412a-98c1-c097b00d90bc None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:46.268253 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f1aaf-1a9d-412a-98c1-c097b00d90bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:46.268931 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5f1aaf-1a9d-412a-98c1-c097b00d90bc None admin] RBAC: Adding query filter params (role.id=20d05bce224344d7b13c43a2e9de7abd, scope.project.id=86b325231ef14af1b9223cffefd8d475, user.id=e06003fdc1b44b718b28ae60cddaafcd) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:46.269235 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5f1aaf-1a9d-412a-98c1-c097b00d90bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:46.270700 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5f1aaf-1a9d-412a-98c1-c097b00d90bc None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:46.277916 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 103/208] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Aug 29 22:31:46 2022] GET /identity/v3/role_assignments?user.id=e06003fdc1b44b718b28ae60cddaafcd&scope.project.id=86b325231ef14af1b9223cffefd8d475&role.id=20d05bce224344d7b13c43a2e9de7abd => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:47.023114 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac39cf62-ee70-4892-9688-5b986f8ccd6e None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:47.023913 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac39cf62-ee70-4892-9688-5b986f8ccd6e None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:47.023913 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac39cf62-ee70-4892-9688-5b986f8ccd6e None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:47.025189 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 106/209] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:31:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:47.033761 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7da567-c9c7-481f-b6f3-99c0760f9c2f None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:47.034037 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7da567-c9c7-481f-b6f3-99c0760f9c2f None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:47.034318 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7da567-c9c7-481f-b6f3-99c0760f9c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:47.053264 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-3a7da567-c9c7-481f-b6f3-99c0760f9c2f None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:47.054510 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-3a7da567-c9c7-481f-b6f3-99c0760f9c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:47.091955 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267bbd9-0166-42bc-8525-343351825480 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:47.092268 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267bbd9-0166-42bc-8525-343351825480 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:47.092503 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267bbd9-0166-42bc-8525-343351825480 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:47.094423 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 107/210] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:31:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:31:47.100637 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da7d5f-7d6d-4f12-9ad9-cd947b66d66e None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:47.103894 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da7d5f-7d6d-4f12-9ad9-cd947b66d66e None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:47.103894 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da7d5f-7d6d-4f12-9ad9-cd947b66d66e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:47.121230 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-a3da7d5f-7d6d-4f12-9ad9-cd947b66d66e None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:47.122806 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-a3da7d5f-7d6d-4f12-9ad9-cd947b66d66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:47.136811 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 104/211] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:31:47.191830 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5511ff36-a77f-4c29-8950-53174bead3d5 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:47.192117 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5511ff36-a77f-4c29-8950-53174bead3d5 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:47.192452 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5511ff36-a77f-4c29-8950-53174bead3d5 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:47.193924 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 105/212] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:31:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:31:47.194517 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 108/213] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:31:47.199171 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3705869b-cf77-4bea-baa2-a3dca828ee65 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:47.199419 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3705869b-cf77-4bea-baa2-a3dca828ee65 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:47.199691 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3705869b-cf77-4bea-baa2-a3dca828ee65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:47.219879 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-3705869b-cf77-4bea-baa2-a3dca828ee65 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:47.221077 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-3705869b-cf77-4bea-baa2-a3dca828ee65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:47.301377 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 106/214] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:31:47.430389 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da7d5f-7d6d-4f12-9ad9-cd947b66d66e None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:47.440408 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:47.489314 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3705869b-cf77-4bea-baa2-a3dca828ee65 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:47.501139 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:47.539746 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da7d5f-7d6d-4f12-9ad9-cd947b66d66e None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:47.577971 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8214ca3e-b656-4230-b732-66a2b7f1624e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:47.579191 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8214ca3e-b656-4230-b732-66a2b7f1624e None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:47.579698 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8214ca3e-b656-4230-b732-66a2b7f1624e None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:47.580163 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8214ca3e-b656-4230-b732-66a2b7f1624e None admin] PATH_INFO: `/v3/roles/member` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:47.592030 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8214ca3e-b656-4230-b732-66a2b7f1624e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:31:47.597677 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-8214ca3e-b656-4230-b732-66a2b7f1624e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:31:47.597677 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:47.597677 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:47.597677 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:47.597677 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:47.597677 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:47.597677 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:47.597677 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:47.597677 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:47.597677 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:47.597677 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:47.597677 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:47.597677 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:31:47.597677 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:31:47.597677 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:31:47.597677 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:31:47.598548 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:31:47.598548 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:31:47.598548 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:31:47.598548 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:31:47.598548 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:47.598548 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:47.598548 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:47.598548 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:47.598548 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:47.598548 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:47.598548 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:47.598548 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:47.598548 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:47.598548 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:47.598548 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:47.598548 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:47.599316 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:47.599316 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:47.599316 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:47.599316 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:47.599316 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:31:47.599316 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:31:47.599316 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:31:47.599316 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:31:47.599316 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:31:47.599316 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:31:47.599316 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:31:47.599316 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:31:47.599908 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3705869b-cf77-4bea-baa2-a3dca828ee65 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:47.602020 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 109/215] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Aug 29 22:31:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:47.603756 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8214ca3e-b656-4230-b732-66a2b7f1624e None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:47.638163 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90554b7-be31-498a-a4e5-86e1d8be95a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:47.638968 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90554b7-be31-498a-a4e5-86e1d8be95a5 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:47.639258 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90554b7-be31-498a-a4e5-86e1d8be95a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:47.639866 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90554b7-be31-498a-a4e5-86e1d8be95a5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:47.641133 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90554b7-be31-498a-a4e5-86e1d8be95a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:47.642674 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90554b7-be31-498a-a4e5-86e1d8be95a5 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:47.644350 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 107/216] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:31:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:47.644968 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90554b7-be31-498a-a4e5-86e1d8be95a5 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:47.684138 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:47.723366 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8214ca3e-b656-4230-b732-66a2b7f1624e None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:47.731063 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:47.759855 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90554b7-be31-498a-a4e5-86e1d8be95a5 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:47.761233 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28f5f43-ba72-449a-95be-63fe1f9db75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:47.761896 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f5f43-ba72-449a-95be-63fe1f9db75d None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:47.762922 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f5f43-ba72-449a-95be-63fe1f9db75d None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:47.762922 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f5f43-ba72-449a-95be-63fe1f9db75d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:47.772737 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28f5f43-ba72-449a-95be-63fe1f9db75d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:31:47.777616 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-c28f5f43-ba72-449a-95be-63fe1f9db75d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:31:47.777616 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:47.777616 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:47.777616 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:47.777616 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:47.777616 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:47.777616 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:47.777616 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:47.777616 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:47.777616 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:47.777616 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:47.777616 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:47.777616 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:31:47.777616 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:31:47.777616 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:31:47.777616 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:31:47.778477 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:31:47.778477 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:31:47.778477 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:31:47.778477 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:31:47.778477 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:47.778477 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:47.778477 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:47.778477 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:47.778477 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:47.778477 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:47.778477 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:47.778477 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:47.778477 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:47.778477 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:47.778477 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:47.778477 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:47.779241 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:47.779241 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:47.779241 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:47.779241 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:47.779241 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:31:47.779241 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:31:47.779241 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:31:47.779241 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:31:47.779241 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:31:47.779241 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:31:47.779241 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:31:47.779241 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:31:47.779241 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 110/217] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Aug 29 22:31:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:47.779857 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28f5f43-ba72-449a-95be-63fe1f9db75d None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:47.795764 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e9934c-a35a-45e2-a068-16dbf9f1dfaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:47.796382 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e9934c-a35a-45e2-a068-16dbf9f1dfaf None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:47.796668 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e9934c-a35a-45e2-a068-16dbf9f1dfaf None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:47.796945 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e9934c-a35a-45e2-a068-16dbf9f1dfaf None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:47.797641 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e9934c-a35a-45e2-a068-16dbf9f1dfaf None admin] RBAC: Adding query filter params (name=member) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:47.797941 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e9934c-a35a-45e2-a068-16dbf9f1dfaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:47.799321 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e9934c-a35a-45e2-a068-16dbf9f1dfaf None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:47.807630 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 108/218] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Aug 29 22:31:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:47.810752 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f97813a-b040-4852-9e0c-32fcbc3277f9 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:47.811116 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f97813a-b040-4852-9e0c-32fcbc3277f9 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:47.811393 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f97813a-b040-4852-9e0c-32fcbc3277f9 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:47.812909 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 109/219] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:31:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:47.813700 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f97813a-b040-4852-9e0c-32fcbc3277f9 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:47.882337 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28f5f43-ba72-449a-95be-63fe1f9db75d None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:47.908257 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:47.914495 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f97813a-b040-4852-9e0c-32fcbc3277f9 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:47.918011 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1088c8-fe71-452a-9fed-2e7c2c38e376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:47.918619 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1088c8-fe71-452a-9fed-2e7c2c38e376 None admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:47.919425 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1088c8-fe71-452a-9fed-2e7c2c38e376 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:47.919854 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1088c8-fe71-452a-9fed-2e7c2c38e376 None admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:47.920685 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1088c8-fe71-452a-9fed-2e7c2c38e376 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:47.922187 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1088c8-fe71-452a-9fed-2e7c2c38e376 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:47.945732 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 111/220] 10.222.0.47 () {60 vars in 1132 bytes} [Mon Aug 29 22:31:47 2022] POST /identity/v3/users => generated 297 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:31:47.946657 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1088c8-fe71-452a-9fed-2e7c2c38e376 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:47.963216 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afa06e7-948b-4ef9-b4a4-f8bf4cb84e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:47.963868 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa06e7-948b-4ef9-b4a4-f8bf4cb84e9b None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:47.964149 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa06e7-948b-4ef9-b4a4-f8bf4cb84e9b None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:47.964706 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa06e7-948b-4ef9-b4a4-f8bf4cb84e9b None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:47.966637 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afa06e7-948b-4ef9-b4a4-f8bf4cb84e9b None admin] RBAC: Adding query filter params (name=admin) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:47.967255 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afa06e7-948b-4ef9-b4a4-f8bf4cb84e9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:47.969011 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afa06e7-948b-4ef9-b4a4-f8bf4cb84e9b None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:47.977413 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:47.984716 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 110/221] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Aug 29 22:31:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:47.986386 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767e757-f43f-4131-bd8c-78a599bb9283 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:47.987091 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767e757-f43f-4131-bd8c-78a599bb9283 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:47.987363 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767e757-f43f-4131-bd8c-78a599bb9283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:48.008820 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-4767e757-f43f-4131-bd8c-78a599bb9283 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:48.010196 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-4767e757-f43f-4131-bd8c-78a599bb9283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:48.074764 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1088c8-fe71-452a-9fed-2e7c2c38e376 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:48.105131 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 111/222] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:31:48.110268 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767e757-f43f-4131-bd8c-78a599bb9283 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:48.116741 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c92ce9-a1f6-487a-9c6d-3b0c417f9513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:48.117415 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c92ce9-a1f6-487a-9c6d-3b0c417f9513 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:48.117701 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c92ce9-a1f6-487a-9c6d-3b0c417f9513 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:48.117983 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c92ce9-a1f6-487a-9c6d-3b0c417f9513 None admin] PATH_INFO: `/v3/users/d9825efc443d4841a31a07214587cbdc` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:48.137159 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c92ce9-a1f6-487a-9c6d-3b0c417f9513 None admin] RBAC: Authorizing `identity:get_user(user_id=d9825efc443d4841a31a07214587cbdc)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:48.138985 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c92ce9-a1f6-487a-9c6d-3b0c417f9513 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:48.140856 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 112/223] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Aug 29 22:31:47 2022] GET /identity/v3/users/d9825efc443d4841a31a07214587cbdc => generated 297 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:48.146250 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c92ce9-a1f6-487a-9c6d-3b0c417f9513 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:48.193496 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:48.259325 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767e757-f43f-4131-bd8c-78a599bb9283 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:48.270299 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c92ce9-a1f6-487a-9c6d-3b0c417f9513 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:48.311299 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:48.315140 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea1bec9-f0ac-4ba2-a250-54154be1e732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:48.315825 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea1bec9-f0ac-4ba2-a250-54154be1e732 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:48.316169 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea1bec9-f0ac-4ba2-a250-54154be1e732 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:48.316504 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea1bec9-f0ac-4ba2-a250-54154be1e732 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:48.332785 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d75d7ca-d37f-4346-b4fa-3de0a91ba2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:48.335358 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75d7ca-d37f-4346-b4fa-3de0a91ba2a9 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:48.335643 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75d7ca-d37f-4346-b4fa-3de0a91ba2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:48.335922 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75d7ca-d37f-4346-b4fa-3de0a91ba2a9 None admin] PATH_INFO: `/v3/users/4253cc88955e4893bdae00e2361312d0` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:48.337902 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d75d7ca-d37f-4346-b4fa-3de0a91ba2a9 None admin] RBAC: Authorizing `identity:get_user(user_id=4253cc88955e4893bdae00e2361312d0)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:48.339373 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d75d7ca-d37f-4346-b4fa-3de0a91ba2a9 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:48.341183 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 112/224] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Aug 29 22:31:48 2022] GET /identity/v3/users/4253cc88955e4893bdae00e2361312d0 => generated 283 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:48.346813 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d75d7ca-d37f-4346-b4fa-3de0a91ba2a9 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:48.405097 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea1bec9-f0ac-4ba2-a250-54154be1e732 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:48.406649 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea1bec9-f0ac-4ba2-a250-54154be1e732 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:48.455771 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:48.488411 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d75d7ca-d37f-4346-b4fa-3de0a91ba2a9 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:48.527831 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239866f8-f346-4de6-9d42-55cdcfbd3227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:48.529227 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239866f8-f346-4de6-9d42-55cdcfbd3227 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:48.529822 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239866f8-f346-4de6-9d42-55cdcfbd3227 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:48.530198 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239866f8-f346-4de6-9d42-55cdcfbd3227 None admin] PATH_INFO: `/v3/projects/2d92e217cd6146f7910ea8e021e81cb4` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:48.532190 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239866f8-f346-4de6-9d42-55cdcfbd3227 None admin] RBAC: Authorizing `identity:get_project(project_id=2d92e217cd6146f7910ea8e021e81cb4)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:48.534527 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239866f8-f346-4de6-9d42-55cdcfbd3227 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:48.536575 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 113/225] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Aug 29 22:31:48 2022] GET /identity/v3/projects/2d92e217cd6146f7910ea8e021e81cb4 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:31:48.538044 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 113/226] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Aug 29 22:31:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 22:31:48.542123 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239866f8-f346-4de6-9d42-55cdcfbd3227 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:48.542249 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea1bec9-f0ac-4ba2-a250-54154be1e732 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:48.626840 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:48.672649 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea1bec9-f0ac-4ba2-a250-54154be1e732 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:48.674007 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239866f8-f346-4de6-9d42-55cdcfbd3227 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:48.717237 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9df4a97-98dd-4841-886a-8bb18910dda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:48.718017 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df4a97-98dd-4841-886a-8bb18910dda3 None admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:48.718235 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df4a97-98dd-4841-886a-8bb18910dda3 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:48.718533 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df4a97-98dd-4841-886a-8bb18910dda3 None admin] PATH_INFO: `/v3/projects/2d92e217cd6146f7910ea8e021e81cb4/users/4253cc88955e4893bdae00e2361312d0/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:48.718822 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d4678-9238-46fb-a349-9d2f019078bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:48.719749 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d4678-9238-46fb-a349-9d2f019078bf None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:48.720141 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d4678-9238-46fb-a349-9d2f019078bf None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:48.720424 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d4678-9238-46fb-a349-9d2f019078bf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:48.720612 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9df4a97-98dd-4841-886a-8bb18910dda3 None admin] RBAC: Authorizing `identity:create_grant(project_id=2d92e217cd6146f7910ea8e021e81cb4, user_id=4253cc88955e4893bdae00e2361312d0, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:48.722092 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9df4a97-98dd-4841-886a-8bb18910dda3 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:48.733387 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29d4678-9238-46fb-a349-9d2f019078bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:31:48.736348 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:48.739345 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-f29d4678-9238-46fb-a349-9d2f019078bf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:31:48.739345 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:48.739345 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:48.739345 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:48.739345 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:48.739345 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:48.739345 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:48.739345 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:48.739345 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:48.739345 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:48.739345 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:48.739345 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:48.739345 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:31:48.739345 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:31:48.739345 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:31:48.739345 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:31:48.740483 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:31:48.740483 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:31:48.740483 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:31:48.740483 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:31:48.740483 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:48.740483 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:48.740483 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:48.740483 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:48.740483 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:48.740483 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:48.740483 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:48.740483 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:48.740483 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:48.740483 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:48.740483 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:48.740483 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:48.741617 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:48.741617 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:48.741617 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:48.741617 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:48.741617 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:31:48.741617 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:31:48.741617 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:31:48.741617 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:31:48.741617 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:31:48.741617 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:31:48.741617 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:31:48.741617 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:31:48.741617 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 114/227] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Aug 29 22:31:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:48.744825 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 114/228] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Aug 29 22:31:48 2022] PUT /identity/v3/projects/2d92e217cd6146f7910ea8e021e81cb4/users/4253cc88955e4893bdae00e2361312d0/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:31:48.747322 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d4678-9238-46fb-a349-9d2f019078bf None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:48.749837 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9df4a97-98dd-4841-886a-8bb18910dda3 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:48.884505 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9df4a97-98dd-4841-886a-8bb18910dda3 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:48.929125 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00fc12f-1588-4692-bfad-e3350b767c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:48.930011 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00fc12f-1588-4692-bfad-e3350b767c65 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:48.930432 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00fc12f-1588-4692-bfad-e3350b767c65 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:48.930867 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00fc12f-1588-4692-bfad-e3350b767c65 None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:48.931698 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00fc12f-1588-4692-bfad-e3350b767c65 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:48.932155 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00fc12f-1588-4692-bfad-e3350b767c65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:48.933830 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00fc12f-1588-4692-bfad-e3350b767c65 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:48.945349 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 115/229] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Aug 29 22:31:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:48.953056 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00fc12f-1588-4692-bfad-e3350b767c65 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:49.013557 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d4678-9238-46fb-a349-9d2f019078bf None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:49.022458 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:49.045307 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:49.054966 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a479e-fec5-4558-96f5-69ec1a638bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:49.055790 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a479e-fec5-4558-96f5-69ec1a638bf2 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:49.056307 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a479e-fec5-4558-96f5-69ec1a638bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:49.056717 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a479e-fec5-4558-96f5-69ec1a638bf2 None admin] PATH_INFO: `/v3/projects/2d92e217cd6146f7910ea8e021e81cb4` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:49.063209 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156a479e-fec5-4558-96f5-69ec1a638bf2 None admin] RBAC: Authorizing `identity:get_project(project_id=2d92e217cd6146f7910ea8e021e81cb4)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:49.063209 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156a479e-fec5-4558-96f5-69ec1a638bf2 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:49.063209 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 115/230] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Aug 29 22:31:48 2022] GET /identity/v3/projects/2d92e217cd6146f7910ea8e021e81cb4 => generated 302 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:49.068157 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00fc12f-1588-4692-bfad-e3350b767c65 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:49.068652 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a479e-fec5-4558-96f5-69ec1a638bf2 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:49.109396 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a4b866-212f-473f-92c7-6d373b386901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:49.110042 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4b866-212f-473f-92c7-6d373b386901 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:49.110307 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4b866-212f-473f-92c7-6d373b386901 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:49.110580 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4b866-212f-473f-92c7-6d373b386901 None admin] PATH_INFO: `/v3/users/4253cc88955e4893bdae00e2361312d0` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:49.112399 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a4b866-212f-473f-92c7-6d373b386901 None admin] RBAC: Authorizing `identity:get_user(user_id=4253cc88955e4893bdae00e2361312d0)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:49.113876 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a4b866-212f-473f-92c7-6d373b386901 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:49.120949 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 116/231] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Aug 29 22:31:48 2022] GET /identity/v3/users/4253cc88955e4893bdae00e2361312d0 => generated 283 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:49.124066 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a4b866-212f-473f-92c7-6d373b386901 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:49.248532 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a479e-fec5-4558-96f5-69ec1a638bf2 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:49.303698 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a4b866-212f-473f-92c7-6d373b386901 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:49.325422 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d3a128-0a77-4220-a372-d3307506f05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:49.326120 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d3a128-0a77-4220-a372-d3307506f05c None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:49.326407 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d3a128-0a77-4220-a372-d3307506f05c None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:49.326618 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d3a128-0a77-4220-a372-d3307506f05c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:49.327376 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d3a128-0a77-4220-a372-d3307506f05c None admin] RBAC: Adding query filter params (role.id=0c67797d444d4c929b2ccab47c468848, scope.project.id=2d92e217cd6146f7910ea8e021e81cb4, user.id=d9825efc443d4841a31a07214587cbdc) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:49.328102 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d3a128-0a77-4220-a372-d3307506f05c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:49.329897 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d3a128-0a77-4220-a372-d3307506f05c None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:49.338679 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 116/232] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Aug 29 22:31:49 2022] GET /identity/v3/role_assignments?user.id=d9825efc443d4841a31a07214587cbdc&scope.project.id=2d92e217cd6146f7910ea8e021e81cb4&role.id=0c67797d444d4c929b2ccab47c468848 => generated 259 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:31:49.357809 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:49.368896 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b1cb27-f5a5-44b1-a5dc-56d30ef88a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:49.369575 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1cb27-f5a5-44b1-a5dc-56d30ef88a49 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:49.369856 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1cb27-f5a5-44b1-a5dc-56d30ef88a49 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:49.370135 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1cb27-f5a5-44b1-a5dc-56d30ef88a49 None admin] PATH_INFO: `/v3/projects/2d92e217cd6146f7910ea8e021e81cb4` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:49.371284 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b1cb27-f5a5-44b1-a5dc-56d30ef88a49 None admin] RBAC: Authorizing `identity:get_project(project_id=2d92e217cd6146f7910ea8e021e81cb4)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:49.373444 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b1cb27-f5a5-44b1-a5dc-56d30ef88a49 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:49.376091 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 117/233] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Aug 29 22:31:49 2022] GET /identity/v3/projects/2d92e217cd6146f7910ea8e021e81cb4 => generated 302 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:49.381182 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d3a128-0a77-4220-a372-d3307506f05c None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:49.464023 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:49.524522 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d3a128-0a77-4220-a372-d3307506f05c None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:49.568160 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01336b95-8397-4468-9bff-f75e06045e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:49.568826 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01336b95-8397-4468-9bff-f75e06045e8e None admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:49.569170 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01336b95-8397-4468-9bff-f75e06045e8e None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:49.569478 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01336b95-8397-4468-9bff-f75e06045e8e None admin] PATH_INFO: `/v3/projects/2d92e217cd6146f7910ea8e021e81cb4/users/4253cc88955e4893bdae00e2361312d0/roles/066c4a2915d247089e9df06936eb9a97` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:49.575900 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01336b95-8397-4468-9bff-f75e06045e8e None admin] RBAC: Authorizing `identity:create_grant(project_id=2d92e217cd6146f7910ea8e021e81cb4, user_id=4253cc88955e4893bdae00e2361312d0, role_id=066c4a2915d247089e9df06936eb9a97)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:49.577415 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01336b95-8397-4468-9bff-f75e06045e8e None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:49.601124 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 117/234] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Aug 29 22:31:49 2022] PUT /identity/v3/projects/2d92e217cd6146f7910ea8e021e81cb4/users/4253cc88955e4893bdae00e2361312d0/roles/066c4a2915d247089e9df06936eb9a97 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:31:50.209882 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9fd68e-b1c2-4961-bf9e-e50baa8eb8f6 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:50.210426 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9fd68e-b1c2-4961-bf9e-e50baa8eb8f6 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:50.210426 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9fd68e-b1c2-4961-bf9e-e50baa8eb8f6 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:50.211777 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 118/235] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:31:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:50.224670 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf2904b-85de-44f4-947a-e7e19b1027ad None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:50.224964 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf2904b-85de-44f4-947a-e7e19b1027ad None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:50.225243 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf2904b-85de-44f4-947a-e7e19b1027ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:50.243866 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-ddf2904b-85de-44f4-947a-e7e19b1027ad None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:50.245068 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-ddf2904b-85de-44f4-947a-e7e19b1027ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:50.350651 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 118/236] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:31:50.447926 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c1dc3-2b7a-4d6a-917d-0aadf36eb214 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:50.448253 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c1dc3-2b7a-4d6a-917d-0aadf36eb214 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:50.448487 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c1dc3-2b7a-4d6a-917d-0aadf36eb214 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:50.450930 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 119/237] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:31:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:50.455933 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f0777-38ca-4579-a395-00cb224b3019 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:50.456435 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f0777-38ca-4579-a395-00cb224b3019 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:50.456923 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f0777-38ca-4579-a395-00cb224b3019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:50.486365 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-974f0777-38ca-4579-a395-00cb224b3019 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:50.487850 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-974f0777-38ca-4579-a395-00cb224b3019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:50.549624 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:50.586843 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 119/238] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:31:50.711028 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800c1dc3-2b7a-4d6a-917d-0aadf36eb214 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:50.849272 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800c1dc3-2b7a-4d6a-917d-0aadf36eb214 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:50.886495 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f0777-38ca-4579-a395-00cb224b3019 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:50.892078 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b41b346-13e9-4c3c-b695-ed555772913d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:50.892723 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b41b346-13e9-4c3c-b695-ed555772913d None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:50.893002 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b41b346-13e9-4c3c-b695-ed555772913d None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:50.893274 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b41b346-13e9-4c3c-b695-ed555772913d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:50.911701 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b41b346-13e9-4c3c-b695-ed555772913d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:31:50.922766 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-1b41b346-13e9-4c3c-b695-ed555772913d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 22:31:50.922766 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:50.922766 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:50.922766 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:50.922766 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:50.922766 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:50.922766 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:50.922766 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:50.922766 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:50.922766 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:50.922766 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:50.922766 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:50.922766 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:31:50.922766 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:31:50.922766 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:31:50.922766 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:31:50.923644 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:31:50.923644 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:31:50.923644 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:31:50.923644 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:31:50.923644 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:50.923644 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:50.923644 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:50.923644 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:50.923644 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:50.923644 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:50.923644 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:50.923644 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:50.923644 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:50.923644 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:50.923644 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:50.923644 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:50.924420 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:50.924420 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:50.924420 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:50.924420 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:50.924420 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:31:50.924420 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:31:50.924420 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:31:50.924420 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:31:50.924420 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:31:50.924420 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:31:50.924420 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 22:31:50.924420 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:31:50.928605 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 120/239] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Aug 29 22:31:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:50.930210 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b41b346-13e9-4c3c-b695-ed555772913d None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:51.040180 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f0777-38ca-4579-a395-00cb224b3019 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:51.071283 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:51.080139 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112e2290-4c33-403a-a117-d0868972e671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:51.081016 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e2290-4c33-403a-a117-d0868972e671 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:51.081452 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e2290-4c33-403a-a117-d0868972e671 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:51.081854 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e2290-4c33-403a-a117-d0868972e671 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:51.083085 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112e2290-4c33-403a-a117-d0868972e671 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:51.084656 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112e2290-4c33-403a-a117-d0868972e671 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:51.086431 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 120/240] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:31:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:31:51.092882 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112e2290-4c33-403a-a117-d0868972e671 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:51.136024 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b41b346-13e9-4c3c-b695-ed555772913d None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:51.147235 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:51.176536 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed61439a-1e13-4f83-99e3-ef61f29f8ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:51.177558 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed61439a-1e13-4f83-99e3-ef61f29f8ae5 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:51.178056 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed61439a-1e13-4f83-99e3-ef61f29f8ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:51.178514 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed61439a-1e13-4f83-99e3-ef61f29f8ae5 None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:51.179474 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed61439a-1e13-4f83-99e3-ef61f29f8ae5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:51.179981 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed61439a-1e13-4f83-99e3-ef61f29f8ae5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:51.181676 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed61439a-1e13-4f83-99e3-ef61f29f8ae5 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:51.192065 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 121/241] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Aug 29 22:31:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:31:51.193757 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c77fe3d-73dd-43ff-bd1f-367e29293a56 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:51.194238 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c77fe3d-73dd-43ff-bd1f-367e29293a56 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:51.194755 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c77fe3d-73dd-43ff-bd1f-367e29293a56 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:51.196280 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 122/242] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:31:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:51.197301 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c77fe3d-73dd-43ff-bd1f-367e29293a56 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:51.207020 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112e2290-4c33-403a-a117-d0868972e671 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:51.247231 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8e4f48-3b59-47a2-83e8-a9e6b53d0f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:51.247850 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e4f48-3b59-47a2-83e8-a9e6b53d0f11 None admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:51.248165 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e4f48-3b59-47a2-83e8-a9e6b53d0f11 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:51.248451 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e4f48-3b59-47a2-83e8-a9e6b53d0f11 None admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:51.249299 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8e4f48-3b59-47a2-83e8-a9e6b53d0f11 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:51.250771 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8e4f48-3b59-47a2-83e8-a9e6b53d0f11 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:51.289536 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 121/243] 10.222.0.47 () {60 vars in 1132 bytes} [Mon Aug 29 22:31:51 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:31:51.291188 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee41fd6-08b8-424d-8839-22fa4ca2f259 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:51.291828 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee41fd6-08b8-424d-8839-22fa4ca2f259 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:51.291828 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee41fd6-08b8-424d-8839-22fa4ca2f259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:51.314320 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c77fe3d-73dd-43ff-bd1f-367e29293a56 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:51.328643 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-cee41fd6-08b8-424d-8839-22fa4ca2f259 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:51.329937 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-cee41fd6-08b8-424d-8839-22fa4ca2f259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:51.339520 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:51.356448 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9441458-9114-4ee3-8757-71036c84a79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:51.357722 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9441458-9114-4ee3-8757-71036c84a79e None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:51.358251 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9441458-9114-4ee3-8757-71036c84a79e None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:51.358741 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9441458-9114-4ee3-8757-71036c84a79e None admin] PATH_INFO: `/v3/users/1456d21f15a94b52b63dcff453fb7b7a` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:51.376016 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9441458-9114-4ee3-8757-71036c84a79e None admin] RBAC: Authorizing `identity:get_user(user_id=1456d21f15a94b52b63dcff453fb7b7a)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:51.377952 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9441458-9114-4ee3-8757-71036c84a79e None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:51.379975 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 123/244] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Aug 29 22:31:51 2022] GET /identity/v3/users/1456d21f15a94b52b63dcff453fb7b7a => generated 297 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:51.385636 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9441458-9114-4ee3-8757-71036c84a79e None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:51.482779 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 122/245] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:31:51.502741 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9441458-9114-4ee3-8757-71036c84a79e None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:51.542882 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ba1ab7-8561-4bf0-9536-f0509a85e0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:51.544509 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba1ab7-8561-4bf0-9536-f0509a85e0c2 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:51.545188 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba1ab7-8561-4bf0-9536-f0509a85e0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:51.545729 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba1ab7-8561-4bf0-9536-f0509a85e0c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:51.598188 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:51.621518 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ba1ab7-8561-4bf0-9536-f0509a85e0c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:51.623834 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ba1ab7-8561-4bf0-9536-f0509a85e0c2 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:51.728712 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 124/246] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Aug 29 22:31:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 22:31:51.737445 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee41fd6-08b8-424d-8839-22fa4ca2f259 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:51.779373 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ba1ab7-8561-4bf0-9536-f0509a85e0c2 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:51.783756 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:51.883787 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee41fd6-08b8-424d-8839-22fa4ca2f259 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:51.900094 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:51.933601 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ba1ab7-8561-4bf0-9536-f0509a85e0c2 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:51.940139 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b579c38-3335-43f8-9ffb-81a752fe8bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:51.940794 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b579c38-3335-43f8-9ffb-81a752fe8bb5 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:51.941073 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b579c38-3335-43f8-9ffb-81a752fe8bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:51.941362 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b579c38-3335-43f8-9ffb-81a752fe8bb5 None admin] PATH_INFO: `/v3/projects/2d92e217cd6146f7910ea8e021e81cb4` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:51.942623 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b579c38-3335-43f8-9ffb-81a752fe8bb5 None admin] RBAC: Authorizing `identity:get_project(project_id=2d92e217cd6146f7910ea8e021e81cb4)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:51.944076 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b579c38-3335-43f8-9ffb-81a752fe8bb5 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:51.952134 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 123/247] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Aug 29 22:31:51 2022] GET /identity/v3/projects/2d92e217cd6146f7910ea8e021e81cb4 => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:51.957109 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b579c38-3335-43f8-9ffb-81a752fe8bb5 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:51.993211 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f7ebe6-ca7d-416d-a86e-eec38dfec75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:51.994384 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7ebe6-ca7d-416d-a86e-eec38dfec75c None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:51.995268 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7ebe6-ca7d-416d-a86e-eec38dfec75c None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:51.995774 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7ebe6-ca7d-416d-a86e-eec38dfec75c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:52.012904 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f7ebe6-ca7d-416d-a86e-eec38dfec75c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:31:52.020211 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-04f7ebe6-ca7d-416d-a86e-eec38dfec75c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:31:52.020211 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:52.020211 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:52.020211 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:52.020211 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:52.020211 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:52.020211 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:52.020211 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:52.020211 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:52.020211 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:52.020211 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:52.020211 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:52.020211 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:31:52.020211 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:31:52.020211 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:31:52.020211 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:31:52.021129 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:31:52.021129 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:31:52.021129 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:31:52.021129 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:31:52.021129 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:52.021129 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:52.021129 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:52.021129 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:52.021129 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:52.021129 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:52.021129 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:52.021129 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:52.021129 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:52.021129 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:52.021129 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:52.021129 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:52.021957 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:52.021957 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:52.021957 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:52.021957 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:52.021957 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:31:52.021957 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:31:52.021957 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:31:52.021957 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:31:52.021957 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:31:52.021957 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:31:52.021957 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:31:52.021957 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:31:52.030278 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 125/248] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Aug 29 22:31:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:31:52.032747 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f7ebe6-ca7d-416d-a86e-eec38dfec75c None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:52.127726 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:52.133727 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b579c38-3335-43f8-9ffb-81a752fe8bb5 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:52.194534 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9be9271-3ee2-4996-b1b9-ae7754e585e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:52.195165 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be9271-3ee2-4996-b1b9-ae7754e585e3 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:52.195458 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be9271-3ee2-4996-b1b9-ae7754e585e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:52.195717 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be9271-3ee2-4996-b1b9-ae7754e585e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:52.196443 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9be9271-3ee2-4996-b1b9-ae7754e585e3 None admin] RBAC: Adding query filter params (role.id=20d05bce224344d7b13c43a2e9de7abd, scope.project.id=2d92e217cd6146f7910ea8e021e81cb4, user.id=1456d21f15a94b52b63dcff453fb7b7a) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:52.196746 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9be9271-3ee2-4996-b1b9-ae7754e585e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:52.198635 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9be9271-3ee2-4996-b1b9-ae7754e585e3 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:52.200771 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f7ebe6-ca7d-416d-a86e-eec38dfec75c None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:52.211286 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 124/249] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Aug 29 22:31:51 2022] GET /identity/v3/role_assignments?user.id=1456d21f15a94b52b63dcff453fb7b7a&scope.project.id=2d92e217cd6146f7910ea8e021e81cb4&role.id=20d05bce224344d7b13c43a2e9de7abd => generated 259 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:52.213086 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a18d7-8003-4a9a-8754-9bf68d977b5e None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:52.213395 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a18d7-8003-4a9a-8754-9bf68d977b5e None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:52.213671 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a18d7-8003-4a9a-8754-9bf68d977b5e None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:52.215945 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 125/250] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:31:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:52.217124 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36724dcb-a6f8-40de-84ae-68ee5e7f2755 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:52.217455 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36724dcb-a6f8-40de-84ae-68ee5e7f2755 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:52.217786 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36724dcb-a6f8-40de-84ae-68ee5e7f2755 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:52.220011 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 126/251] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:31:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:52.222752 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e717281-52a3-472a-a6a2-fab40bd9a7b5 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:52.222752 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e717281-52a3-472a-a6a2-fab40bd9a7b5 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:52.222752 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e717281-52a3-472a-a6a2-fab40bd9a7b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:52.243976 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-5e717281-52a3-472a-a6a2-fab40bd9a7b5 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:52.245132 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-5e717281-52a3-472a-a6a2-fab40bd9a7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:52.265123 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2325f12f-dfb5-44e9-8782-07b93875b63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:52.266839 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325f12f-dfb5-44e9-8782-07b93875b63d None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:52.267582 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325f12f-dfb5-44e9-8782-07b93875b63d None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:52.268265 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325f12f-dfb5-44e9-8782-07b93875b63d None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:52.269659 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2325f12f-dfb5-44e9-8782-07b93875b63d None admin] RBAC: Adding query filter params (name=admin) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:52.270192 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2325f12f-dfb5-44e9-8782-07b93875b63d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:52.277354 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2325f12f-dfb5-44e9-8782-07b93875b63d None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:52.285233 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:52.291555 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 126/252] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Aug 29 22:31:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:52.293456 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01abf95e-123e-49b7-a68a-6fb4820473d9 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:52.294162 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01abf95e-123e-49b7-a68a-6fb4820473d9 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:52.294721 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01abf95e-123e-49b7-a68a-6fb4820473d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:52.321605 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-01abf95e-123e-49b7-a68a-6fb4820473d9 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:52.323667 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-01abf95e-123e-49b7-a68a-6fb4820473d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:52.336496 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 127/253] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:31:52.337301 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e717281-52a3-472a-a6a2-fab40bd9a7b5 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:52.409803 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 127/254] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:31:52.458022 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:52.466742 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e717281-52a3-472a-a6a2-fab40bd9a7b5 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:52.510961 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15346ad-d6ec-4a65-9751-de87a2f6db3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:52.511575 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15346ad-d6ec-4a65-9751-de87a2f6db3e None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:52.512393 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15346ad-d6ec-4a65-9751-de87a2f6db3e None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:52.512650 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15346ad-d6ec-4a65-9751-de87a2f6db3e None admin] PATH_INFO: `/v3/users/4253cc88955e4893bdae00e2361312d0` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:52.513826 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15346ad-d6ec-4a65-9751-de87a2f6db3e None admin] RBAC: Authorizing `identity:get_user(user_id=4253cc88955e4893bdae00e2361312d0)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:52.515453 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15346ad-d6ec-4a65-9751-de87a2f6db3e None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:52.517480 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 128/255] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Aug 29 22:31:52 2022] GET /identity/v3/users/4253cc88955e4893bdae00e2361312d0 => generated 283 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:52.523600 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01abf95e-123e-49b7-a68a-6fb4820473d9 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:52.646259 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01abf95e-123e-49b7-a68a-6fb4820473d9 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:52.678244 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:52.685908 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b1e8bb-05fe-4378-8e97-0d9fee99dd74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:52.686845 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1e8bb-05fe-4378-8e97-0d9fee99dd74 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:52.687388 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1e8bb-05fe-4378-8e97-0d9fee99dd74 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:52.687877 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1e8bb-05fe-4378-8e97-0d9fee99dd74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:52.748601 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15346ad-d6ec-4a65-9751-de87a2f6db3e None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:52.764730 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b1e8bb-05fe-4378-8e97-0d9fee99dd74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:52.766671 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b1e8bb-05fe-4378-8e97-0d9fee99dd74 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:52.886245 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 128/256] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Aug 29 22:31:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:31:52.893805 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b1e8bb-05fe-4378-8e97-0d9fee99dd74 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:52.950022 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:52.990947 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15346ad-d6ec-4a65-9751-de87a2f6db3e None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:53.047093 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f409e-838c-4283-8e53-57959ede36e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:53.047664 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f409e-838c-4283-8e53-57959ede36e0 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:53.047941 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f409e-838c-4283-8e53-57959ede36e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:53.048209 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f409e-838c-4283-8e53-57959ede36e0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:53.051368 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b1e8bb-05fe-4378-8e97-0d9fee99dd74 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:53.087641 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85885c4a-fce8-4cdf-88bb-c08283cb34e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:53.088279 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85885c4a-fce8-4cdf-88bb-c08283cb34e8 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:53.088559 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85885c4a-fce8-4cdf-88bb-c08283cb34e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:53.088832 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85885c4a-fce8-4cdf-88bb-c08283cb34e8 None admin] PATH_INFO: `/v3/projects/2d92e217cd6146f7910ea8e021e81cb4` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:53.090683 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85885c4a-fce8-4cdf-88bb-c08283cb34e8 None admin] RBAC: Authorizing `identity:get_project(project_id=2d92e217cd6146f7910ea8e021e81cb4)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:53.092204 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85885c4a-fce8-4cdf-88bb-c08283cb34e8 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:53.094037 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 129/257] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Aug 29 22:31:52 2022] GET /identity/v3/projects/2d92e217cd6146f7910ea8e021e81cb4 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:31:53.094645 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85885c4a-fce8-4cdf-88bb-c08283cb34e8 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:53.095568 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176f409e-838c-4283-8e53-57959ede36e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:31:53.100629 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-176f409e-838c-4283-8e53-57959ede36e0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:31:53.100629 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:53.100629 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:53.100629 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:53.100629 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:53.100629 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:53.100629 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:53.100629 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:53.100629 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:53.100629 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:53.100629 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:53.100629 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:53.100629 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:31:53.100629 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:31:53.100629 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:31:53.100629 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:31:53.101519 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:31:53.101519 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:31:53.101519 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:31:53.101519 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:31:53.101519 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:53.101519 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:53.101519 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:53.101519 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:53.101519 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:53.101519 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:53.101519 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:53.101519 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:53.101519 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:53.101519 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:53.101519 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:53.101519 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:53.102293 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:53.102293 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:53.102293 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:53.102293 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:53.102293 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:31:53.102293 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:31:53.102293 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:31:53.102293 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:31:53.102293 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:31:53.102293 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:31:53.102293 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:31:53.102293 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:31:53.104463 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 129/258] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Aug 29 22:31:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:31:53.105255 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f409e-838c-4283-8e53-57959ede36e0 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:53.135441 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:53.278878 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:53.283558 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85885c4a-fce8-4cdf-88bb-c08283cb34e8 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:53.312338 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f409e-838c-4283-8e53-57959ede36e0 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:53.335992 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6a6603-56f1-478c-aaa6-750da6a38b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:53.337195 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a6603-56f1-478c-aaa6-750da6a38b60 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:53.337657 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a6603-56f1-478c-aaa6-750da6a38b60 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:53.338318 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a6603-56f1-478c-aaa6-750da6a38b60 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:53.366658 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6a6603-56f1-478c-aaa6-750da6a38b60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:31:53.375009 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-af6a6603-56f1-478c-aaa6-750da6a38b60 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:31:53.375009 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:53.375009 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:53.375009 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:53.375009 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:53.375009 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:53.375009 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:53.375009 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:53.375009 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:53.375009 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:53.375009 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:53.375009 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:53.375009 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:31:53.375009 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:31:53.375009 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:31:53.375009 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:31:53.376067 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:31:53.376067 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:31:53.376067 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:31:53.376067 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:31:53.376067 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:53.376067 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:53.376067 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:53.376067 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:53.376067 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:53.376067 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:53.376067 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:53.376067 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:53.376067 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:53.376067 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:53.376067 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:53.376067 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:53.377120 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:53.377120 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:53.377120 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:53.377120 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:53.377120 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:31:53.377120 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:31:53.377120 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:31:53.377120 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:31:53.377120 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:31:53.377120 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:31:53.377120 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:31:53.377120 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:31:53.378455 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6770f5cd-9c89-46a4-949c-6c97ddf8a233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:53.379217 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770f5cd-9c89-46a4-949c-6c97ddf8a233 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:53.379682 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770f5cd-9c89-46a4-949c-6c97ddf8a233 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:53.380092 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770f5cd-9c89-46a4-949c-6c97ddf8a233 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:53.381031 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6770f5cd-9c89-46a4-949c-6c97ddf8a233 None admin] RBAC: Adding query filter params (role.id=d00eabaec96a4956aaec2c37a5819c25, scope.project.id=2d92e217cd6146f7910ea8e021e81cb4, user.id=4253cc88955e4893bdae00e2361312d0) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:53.381501 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6770f5cd-9c89-46a4-949c-6c97ddf8a233 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:53.383104 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6770f5cd-9c89-46a4-949c-6c97ddf8a233 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:53.384442 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 130/259] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Aug 29 22:31:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:53.386170 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6a6603-56f1-478c-aaa6-750da6a38b60 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:53.397837 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 130/260] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Aug 29 22:31:53 2022] GET /identity/v3/role_assignments?user.id=4253cc88955e4893bdae00e2361312d0&scope.project.id=2d92e217cd6146f7910ea8e021e81cb4&role.id=d00eabaec96a4956aaec2c37a5819c25 => generated 608 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:53.401676 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6770f5cd-9c89-46a4-949c-6c97ddf8a233 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:53.611717 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6a6603-56f1-478c-aaa6-750da6a38b60 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:53.670418 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:53.673964 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba5072e-955d-4c03-9c74-957cc34dd09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:53.675304 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5072e-955d-4c03-9c74-957cc34dd09a None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:53.675590 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5072e-955d-4c03-9c74-957cc34dd09a None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:53.675868 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5072e-955d-4c03-9c74-957cc34dd09a None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:53.676551 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba5072e-955d-4c03-9c74-957cc34dd09a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:53.676857 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba5072e-955d-4c03-9c74-957cc34dd09a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:53.679018 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba5072e-955d-4c03-9c74-957cc34dd09a None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:53.690031 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 131/261] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Aug 29 22:31:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:53.696269 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba5072e-955d-4c03-9c74-957cc34dd09a None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:53.711803 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6770f5cd-9c89-46a4-949c-6c97ddf8a233 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:53.734599 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:53.779888 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ce371-c449-4c6c-aa3e-4c974f1dbe0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:53.780520 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ce371-c449-4c6c-aa3e-4c974f1dbe0a None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:53.780810 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ce371-c449-4c6c-aa3e-4c974f1dbe0a None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:53.781086 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ce371-c449-4c6c-aa3e-4c974f1dbe0a None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:53.781792 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18ce371-c449-4c6c-aa3e-4c974f1dbe0a None admin] RBAC: Adding query filter params (name=member) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:53.782098 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18ce371-c449-4c6c-aa3e-4c974f1dbe0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:53.783496 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18ce371-c449-4c6c-aa3e-4c974f1dbe0a None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:53.803672 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 131/262] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Aug 29 22:31:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:53.810574 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ce371-c449-4c6c-aa3e-4c974f1dbe0a None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:53.906912 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba5072e-955d-4c03-9c74-957cc34dd09a None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:53.977765 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ce371-c449-4c6c-aa3e-4c974f1dbe0a None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:54.006826 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a0a8d9-ae92-4d1a-9ee9-8be649560bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:54.007478 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a0a8d9-ae92-4d1a-9ee9-8be649560bea None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:54.007762 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a0a8d9-ae92-4d1a-9ee9-8be649560bea None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:54.008038 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a0a8d9-ae92-4d1a-9ee9-8be649560bea None admin] PATH_INFO: `/v3/users/4253cc88955e4893bdae00e2361312d0` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:54.009182 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a0a8d9-ae92-4d1a-9ee9-8be649560bea None admin] RBAC: Authorizing `identity:get_user(user_id=4253cc88955e4893bdae00e2361312d0)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:54.014955 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a0a8d9-ae92-4d1a-9ee9-8be649560bea None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:54.016905 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 132/263] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Aug 29 22:31:53 2022] GET /identity/v3/users/4253cc88955e4893bdae00e2361312d0 => generated 283 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:54.022369 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a0a8d9-ae92-4d1a-9ee9-8be649560bea None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:54.024603 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7847907-77f5-4d39-a2f6-6de95395aa0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:54.025507 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7847907-77f5-4d39-a2f6-6de95395aa0d None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:54.025790 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7847907-77f5-4d39-a2f6-6de95395aa0d None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:54.026070 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7847907-77f5-4d39-a2f6-6de95395aa0d None admin] PATH_INFO: `/v3/users/d9825efc443d4841a31a07214587cbdc` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:54.030084 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7847907-77f5-4d39-a2f6-6de95395aa0d None admin] RBAC: Authorizing `identity:get_user(user_id=d9825efc443d4841a31a07214587cbdc)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:54.034327 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7847907-77f5-4d39-a2f6-6de95395aa0d None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:54.039062 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 132/264] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Aug 29 22:31:53 2022] GET /identity/v3/users/d9825efc443d4841a31a07214587cbdc => generated 297 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:54.043523 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7847907-77f5-4d39-a2f6-6de95395aa0d None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:54.075465 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:54.201940 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:54.224734 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a0a8d9-ae92-4d1a-9ee9-8be649560bea None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:54.241234 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7847907-77f5-4d39-a2f6-6de95395aa0d None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:54.289700 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2815e8a8-d0bc-4cc9-8aac-d63c08aa6c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:54.290555 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e077ced-ae49-4bfe-aa8e-27dc9f0dbd18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:54.291359 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2815e8a8-d0bc-4cc9-8aac-d63c08aa6c14 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:54.292111 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e077ced-ae49-4bfe-aa8e-27dc9f0dbd18 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:54.292524 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2815e8a8-d0bc-4cc9-8aac-d63c08aa6c14 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:54.293016 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e077ced-ae49-4bfe-aa8e-27dc9f0dbd18 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:54.293510 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2815e8a8-d0bc-4cc9-8aac-d63c08aa6c14 None admin] PATH_INFO: `/v3/projects/2d92e217cd6146f7910ea8e021e81cb4` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:54.293917 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e077ced-ae49-4bfe-aa8e-27dc9f0dbd18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:54.295764 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2815e8a8-d0bc-4cc9-8aac-d63c08aa6c14 None admin] RBAC: Authorizing `identity:get_project(project_id=2d92e217cd6146f7910ea8e021e81cb4)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:54.297705 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2815e8a8-d0bc-4cc9-8aac-d63c08aa6c14 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:54.305013 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 133/265] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Aug 29 22:31:54 2022] GET /identity/v3/projects/2d92e217cd6146f7910ea8e021e81cb4 => generated 302 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:31:54.307118 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2815e8a8-d0bc-4cc9-8aac-d63c08aa6c14 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:54.425472 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e077ced-ae49-4bfe-aa8e-27dc9f0dbd18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:54.426948 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e077ced-ae49-4bfe-aa8e-27dc9f0dbd18 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:54.436088 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:54.454843 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2815e8a8-d0bc-4cc9-8aac-d63c08aa6c14 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:54.502473 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9868a55c-fa95-4bdb-b10c-725b0f0e3e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:54.503153 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9868a55c-fa95-4bdb-b10c-725b0f0e3e0f None admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:54.503428 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9868a55c-fa95-4bdb-b10c-725b0f0e3e0f None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:54.503697 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9868a55c-fa95-4bdb-b10c-725b0f0e3e0f None admin] PATH_INFO: `/v3/projects/2d92e217cd6146f7910ea8e021e81cb4/users/d9825efc443d4841a31a07214587cbdc/roles/0c67797d444d4c929b2ccab47c468848` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:54.510047 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9868a55c-fa95-4bdb-b10c-725b0f0e3e0f None admin] RBAC: Authorizing `identity:create_grant(project_id=2d92e217cd6146f7910ea8e021e81cb4, user_id=d9825efc443d4841a31a07214587cbdc, role_id=0c67797d444d4c929b2ccab47c468848)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:54.512040 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9868a55c-fa95-4bdb-b10c-725b0f0e3e0f None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:54.538365 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 134/266] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Aug 29 22:31:54 2022] PUT /identity/v3/projects/2d92e217cd6146f7910ea8e021e81cb4/users/d9825efc443d4841a31a07214587cbdc/roles/0c67797d444d4c929b2ccab47c468848 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:31:54.555150 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:54.577145 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 133/267] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Aug 29 22:31:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 22:31:54.583312 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9868a55c-fa95-4bdb-b10c-725b0f0e3e0f None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:54.635300 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336daea5-7452-432d-8e71-f06d1ebd1216 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:54.635624 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336daea5-7452-432d-8e71-f06d1ebd1216 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:54.635865 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336daea5-7452-432d-8e71-f06d1ebd1216 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:54.637800 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 134/268] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:31:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:54.643185 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b7621-cdc9-4220-9b22-b92dea5707ee None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:54.643475 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b7621-cdc9-4220-9b22-b92dea5707ee None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:54.643750 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b7621-cdc9-4220-9b22-b92dea5707ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:54.674216 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-769b7621-cdc9-4220-9b22-b92dea5707ee None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:54.675466 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-769b7621-cdc9-4220-9b22-b92dea5707ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:54.733201 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9868a55c-fa95-4bdb-b10c-725b0f0e3e0f None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:54.762868 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 135/269] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:31:54.763940 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f05d8-61b9-4f35-bc57-2ed32d64ab0a None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:54.764250 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f05d8-61b9-4f35-bc57-2ed32d64ab0a None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:54.764484 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f05d8-61b9-4f35-bc57-2ed32d64ab0a None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:54.770668 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 136/270] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:31:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:54.772134 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49774b10-8600-415f-be49-a9d4e9b76706 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:54.772688 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49774b10-8600-415f-be49-a9d4e9b76706 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:54.773157 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49774b10-8600-415f-be49-a9d4e9b76706 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:54.775087 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 137/271] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:31:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:54.780218 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f4ecc-389b-4f2f-8d91-22b7fb899c59 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:54.780863 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f4ecc-389b-4f2f-8d91-22b7fb899c59 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:54.781498 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f4ecc-389b-4f2f-8d91-22b7fb899c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:54.784874 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e6d86f-85a0-4738-896b-84decb6dfcaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:54.785556 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e6d86f-85a0-4738-896b-84decb6dfcaf None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:54.785836 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e6d86f-85a0-4738-896b-84decb6dfcaf None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:54.786116 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e6d86f-85a0-4738-896b-84decb6dfcaf None admin] PATH_INFO: `/v3/projects/2d92e217cd6146f7910ea8e021e81cb4` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:54.787236 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e6d86f-85a0-4738-896b-84decb6dfcaf None admin] RBAC: Authorizing `identity:get_project(project_id=2d92e217cd6146f7910ea8e021e81cb4)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:54.790325 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e6d86f-85a0-4738-896b-84decb6dfcaf None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:54.793627 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 135/272] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Aug 29 22:31:54 2022] GET /identity/v3/projects/2d92e217cd6146f7910ea8e021e81cb4 => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:54.794973 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78709b8-caa7-4cc9-ba8e-676b48451b88 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:54.795261 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78709b8-caa7-4cc9-ba8e-676b48451b88 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:54.795537 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78709b8-caa7-4cc9-ba8e-676b48451b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:54.810338 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-f30f4ecc-389b-4f2f-8d91-22b7fb899c59 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:54.812539 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-f30f4ecc-389b-4f2f-8d91-22b7fb899c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:54.817811 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-c78709b8-caa7-4cc9-ba8e-676b48451b88 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:54.818992 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-c78709b8-caa7-4cc9-ba8e-676b48451b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:54.828074 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:54.897124 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 136/274] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:31:54.905415 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 138/274] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:31:54.906625 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78709b8-caa7-4cc9-ba8e-676b48451b88 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:55.047326 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f4ecc-389b-4f2f-8d91-22b7fb899c59 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:55.065044 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78709b8-caa7-4cc9-ba8e-676b48451b88 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:55.104832 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:55.129602 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bf5085-4e89-4943-b468-e5a8b03f919e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:55.130216 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf5085-4e89-4943-b468-e5a8b03f919e None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:55.130489 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf5085-4e89-4943-b468-e5a8b03f919e None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:55.130759 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf5085-4e89-4943-b468-e5a8b03f919e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:55.131490 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bf5085-4e89-4943-b468-e5a8b03f919e None admin] RBAC: Adding query filter params (role.id=066c4a2915d247089e9df06936eb9a97, scope.project.id=2d92e217cd6146f7910ea8e021e81cb4, user.id=4253cc88955e4893bdae00e2361312d0) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:55.131792 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bf5085-4e89-4943-b468-e5a8b03f919e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:55.133236 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bf5085-4e89-4943-b468-e5a8b03f919e None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:55.140378 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 137/275] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Aug 29 22:31:54 2022] GET /identity/v3/role_assignments?user.id=4253cc88955e4893bdae00e2361312d0&scope.project.id=2d92e217cd6146f7910ea8e021e81cb4&role.id=066c4a2915d247089e9df06936eb9a97 => generated 608 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:55.176713 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bf5085-4e89-4943-b468-e5a8b03f919e None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:55.192288 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:55.226967 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f4ecc-389b-4f2f-8d91-22b7fb899c59 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:55.298308 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d735e526-bdd5-42af-b08f-4875e22de74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:55.299194 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735e526-bdd5-42af-b08f-4875e22de74c None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:55.299481 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735e526-bdd5-42af-b08f-4875e22de74c None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:55.299895 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735e526-bdd5-42af-b08f-4875e22de74c None admin] PATH_INFO: `/v3/roles/member` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:55.321636 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d735e526-bdd5-42af-b08f-4875e22de74c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:31:55.328095 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-d735e526-bdd5-42af-b08f-4875e22de74c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:31:55.328095 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:55.328095 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:55.328095 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:55.328095 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:55.328095 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:55.328095 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:55.328095 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:55.328095 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:55.328095 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:55.328095 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:55.328095 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:55.328095 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:31:55.328095 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:31:55.328095 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:31:55.328095 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:31:55.328977 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:31:55.328977 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:31:55.328977 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:31:55.328977 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:31:55.328977 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:55.328977 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:55.328977 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:55.328977 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:55.328977 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:55.328977 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:55.328977 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:55.328977 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:55.328977 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:55.328977 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:55.328977 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:55.328977 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:55.329936 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:55.329936 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:55.329936 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:55.329936 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:55.329936 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:31:55.329936 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:31:55.329936 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:31:55.329936 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:31:55.329936 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:31:55.329936 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:31:55.329936 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:31:55.329936 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:31:55.329936 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 139/276] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Aug 29 22:31:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:31:55.331156 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d735e526-bdd5-42af-b08f-4875e22de74c None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:55.358484 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bf5085-4e89-4943-b468-e5a8b03f919e None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:55.405261 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3ff9e4-9d76-4e24-b1f6-870c5eb0e959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:55.406281 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ff9e4-9d76-4e24-b1f6-870c5eb0e959 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:55.406780 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ff9e4-9d76-4e24-b1f6-870c5eb0e959 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:55.407252 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ff9e4-9d76-4e24-b1f6-870c5eb0e959 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:55.408859 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3ff9e4-9d76-4e24-b1f6-870c5eb0e959 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:55.410552 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3ff9e4-9d76-4e24-b1f6-870c5eb0e959 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:55.412294 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 138/277] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:31:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:31:55.412896 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3ff9e4-9d76-4e24-b1f6-870c5eb0e959 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:55.454117 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d735e526-bdd5-42af-b08f-4875e22de74c None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:55.465860 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:55.494609 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b379eb-d68a-4833-896b-ef3a9e446407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:55.495236 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b379eb-d68a-4833-896b-ef3a9e446407 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:55.495514 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b379eb-d68a-4833-896b-ef3a9e446407 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:55.496431 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b379eb-d68a-4833-896b-ef3a9e446407 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:55.497055 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:55.508583 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b379eb-d68a-4833-896b-ef3a9e446407 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:31:55.514137 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-15b379eb-d68a-4833-896b-ef3a9e446407 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 22:31:55.514137 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:55.514137 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:55.514137 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:55.514137 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:55.514137 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:55.514137 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:55.514137 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:55.514137 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:55.514137 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:55.514137 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:55.514137 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:55.514137 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:31:55.514137 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:31:55.514137 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:31:55.514137 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:31:55.515014 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:31:55.515014 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:31:55.515014 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:31:55.515014 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:31:55.515014 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:55.515014 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:55.515014 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:55.515014 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:55.515014 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:55.515014 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:55.515014 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:55.515014 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:55.515014 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:55.515014 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:55.515014 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:55.515014 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:55.515778 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:55.515778 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:55.515778 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:55.515778 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:55.515778 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:31:55.515778 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:31:55.515778 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:31:55.515778 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:31:55.515778 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:31:55.515778 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:31:55.515778 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 22:31:55.515778 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:31:55.515778 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 140/278] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Aug 29 22:31:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:55.516403 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b379eb-d68a-4833-896b-ef3a9e446407 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:55.528595 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3ff9e4-9d76-4e24-b1f6-870c5eb0e959 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:55.565006 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdedf4d-3217-4cb6-9ffa-7a0f25488f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:55.565644 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdedf4d-3217-4cb6-9ffa-7a0f25488f81 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:55.566172 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdedf4d-3217-4cb6-9ffa-7a0f25488f81 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:55.566172 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdedf4d-3217-4cb6-9ffa-7a0f25488f81 None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:55.566825 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdedf4d-3217-4cb6-9ffa-7a0f25488f81 None admin] RBAC: Adding query filter params (name=member) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:55.567214 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdedf4d-3217-4cb6-9ffa-7a0f25488f81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:55.568481 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdedf4d-3217-4cb6-9ffa-7a0f25488f81 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:55.577810 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 139/279] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Aug 29 22:31:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:55.578563 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdedf4d-3217-4cb6-9ffa-7a0f25488f81 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:55.631689 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b379eb-d68a-4833-896b-ef3a9e446407 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:55.667202 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fa1b5e-9ab4-4cb5-96df-c7c1611a08a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:55.668024 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa1b5e-9ab4-4cb5-96df-c7c1611a08a0 None admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:55.668173 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa1b5e-9ab4-4cb5-96df-c7c1611a08a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:55.668442 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa1b5e-9ab4-4cb5-96df-c7c1611a08a0 None admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:55.669267 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fa1b5e-9ab4-4cb5-96df-c7c1611a08a0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:55.670630 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fa1b5e-9ab4-4cb5-96df-c7c1611a08a0 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:55.685932 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdedf4d-3217-4cb6-9ffa-7a0f25488f81 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:55.695700 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 141/280] 10.222.0.47 () {60 vars in 1132 bytes} [Mon Aug 29 22:31:55 2022] POST /identity/v3/users => generated 293 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:31:55.696699 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fa1b5e-9ab4-4cb5-96df-c7c1611a08a0 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:55.737962 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:55.742790 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4578cfe-6ff1-42b2-9b30-37b38dd6002d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:55.744418 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4578cfe-6ff1-42b2-9b30-37b38dd6002d None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:55.744922 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4578cfe-6ff1-42b2-9b30-37b38dd6002d None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:55.745441 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4578cfe-6ff1-42b2-9b30-37b38dd6002d None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:55.747016 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4578cfe-6ff1-42b2-9b30-37b38dd6002d None admin] RBAC: Adding query filter params (name=reader) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:55.747535 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4578cfe-6ff1-42b2-9b30-37b38dd6002d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:55.749276 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4578cfe-6ff1-42b2-9b30-37b38dd6002d None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:55.752530 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:55.760820 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 140/281] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Aug 29 22:31:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:55.774454 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4578cfe-6ff1-42b2-9b30-37b38dd6002d None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:55.849643 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fa1b5e-9ab4-4cb5-96df-c7c1611a08a0 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:55.893662 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1677f869-b397-44b8-aa04-eca60f54974b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:55.894305 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677f869-b397-44b8-aa04-eca60f54974b None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:55.894582 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677f869-b397-44b8-aa04-eca60f54974b None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:55.894853 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677f869-b397-44b8-aa04-eca60f54974b None admin] PATH_INFO: `/v3/users/e8e7b95cf42e460dbba4c05ae3a80626` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:55.909314 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4578cfe-6ff1-42b2-9b30-37b38dd6002d None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:55.911349 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1677f869-b397-44b8-aa04-eca60f54974b None admin] RBAC: Authorizing `identity:get_user(user_id=e8e7b95cf42e460dbba4c05ae3a80626)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:55.912817 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1677f869-b397-44b8-aa04-eca60f54974b None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:55.914751 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 142/282] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Aug 29 22:31:55 2022] GET /identity/v3/users/e8e7b95cf42e460dbba4c05ae3a80626 => generated 293 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:55.922408 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1677f869-b397-44b8-aa04-eca60f54974b None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:55.950506 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171ee7fa-3351-4eef-89f4-6d81d89a6ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:55.952146 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ee7fa-3351-4eef-89f4-6d81d89a6ae5 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:55.952444 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ee7fa-3351-4eef-89f4-6d81d89a6ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:55.952721 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ee7fa-3351-4eef-89f4-6d81d89a6ae5 None admin] PATH_INFO: `/v3/users/1456d21f15a94b52b63dcff453fb7b7a` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:55.954812 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171ee7fa-3351-4eef-89f4-6d81d89a6ae5 None admin] RBAC: Authorizing `identity:get_user(user_id=1456d21f15a94b52b63dcff453fb7b7a)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:55.956247 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171ee7fa-3351-4eef-89f4-6d81d89a6ae5 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:55.958155 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 141/283] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Aug 29 22:31:55 2022] GET /identity/v3/users/1456d21f15a94b52b63dcff453fb7b7a => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:55.963361 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171ee7fa-3351-4eef-89f4-6d81d89a6ae5 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:56.040970 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:56.050130 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:56.070331 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1677f869-b397-44b8-aa04-eca60f54974b None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:56.099638 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171ee7fa-3351-4eef-89f4-6d81d89a6ae5 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:56.116869 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c884cd28-b4db-4c42-a63c-39a40adb0b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:56.117783 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c884cd28-b4db-4c42-a63c-39a40adb0b89 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:56.118238 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c884cd28-b4db-4c42-a63c-39a40adb0b89 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:56.118713 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c884cd28-b4db-4c42-a63c-39a40adb0b89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:56.119522 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c884cd28-b4db-4c42-a63c-39a40adb0b89 None admin] RBAC: Adding query filter params (role.id=0c67797d444d4c929b2ccab47c468848, user.id=e8e7b95cf42e460dbba4c05ae3a80626, scope.system=all) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:56.119899 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c884cd28-b4db-4c42-a63c-39a40adb0b89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:56.122564 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c884cd28-b4db-4c42-a63c-39a40adb0b89 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:56.128923 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 143/284] 10.222.0.47 () {56 vars in 1308 bytes} [Mon Aug 29 22:31:55 2022] GET /identity/v3/role_assignments?user.id=e8e7b95cf42e460dbba4c05ae3a80626&scope.system=all&role.id=0c67797d444d4c929b2ccab47c468848 => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:56.141655 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1097aa-0ae0-48d5-a316-5ecbe64ec2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:56.142560 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1097aa-0ae0-48d5-a316-5ecbe64ec2f3 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:56.142993 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1097aa-0ae0-48d5-a316-5ecbe64ec2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:56.143405 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1097aa-0ae0-48d5-a316-5ecbe64ec2f3 None admin] PATH_INFO: `/v3/projects/2d92e217cd6146f7910ea8e021e81cb4` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:56.145853 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1097aa-0ae0-48d5-a316-5ecbe64ec2f3 None admin] RBAC: Authorizing `identity:get_project(project_id=2d92e217cd6146f7910ea8e021e81cb4)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:56.147740 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1097aa-0ae0-48d5-a316-5ecbe64ec2f3 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:56.150065 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 142/285] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Aug 29 22:31:55 2022] GET /identity/v3/projects/2d92e217cd6146f7910ea8e021e81cb4 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:56.158661 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c884cd28-b4db-4c42-a63c-39a40adb0b89 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:56.293543 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c884cd28-b4db-4c42-a63c-39a40adb0b89 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:56.352198 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61fa824-a6ed-4a81-8fd9-ab63bae81b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:56.352882 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61fa824-a6ed-4a81-8fd9-ab63bae81b24 None admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:56.353167 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61fa824-a6ed-4a81-8fd9-ab63bae81b24 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:56.353472 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61fa824-a6ed-4a81-8fd9-ab63bae81b24 None admin] PATH_INFO: `/v3/projects/2d92e217cd6146f7910ea8e021e81cb4/users/1456d21f15a94b52b63dcff453fb7b7a/roles/20d05bce224344d7b13c43a2e9de7abd` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:56.355520 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61fa824-a6ed-4a81-8fd9-ab63bae81b24 None admin] RBAC: Authorizing `identity:create_grant(project_id=2d92e217cd6146f7910ea8e021e81cb4, user_id=1456d21f15a94b52b63dcff453fb7b7a, role_id=20d05bce224344d7b13c43a2e9de7abd)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:56.356948 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61fa824-a6ed-4a81-8fd9-ab63bae81b24 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:56.379352 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 144/286] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Aug 29 22:31:56 2022] PUT /identity/v3/projects/2d92e217cd6146f7910ea8e021e81cb4/users/1456d21f15a94b52b63dcff453fb7b7a/roles/20d05bce224344d7b13c43a2e9de7abd => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:31:56.763812 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992306d-8656-4c4d-b592-22e5911a5909 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:56.764284 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992306d-8656-4c4d-b592-22e5911a5909 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:56.764284 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992306d-8656-4c4d-b592-22e5911a5909 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:56.765937 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 143/287] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:31:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:56.772991 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021bf18d-fc6e-48af-9f08-1afea8a7e2ff None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:56.773626 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021bf18d-fc6e-48af-9f08-1afea8a7e2ff None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:56.773626 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021bf18d-fc6e-48af-9f08-1afea8a7e2ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:56.789003 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:56.796868 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-021bf18d-fc6e-48af-9f08-1afea8a7e2ff None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:56.798162 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-021bf18d-fc6e-48af-9f08-1afea8a7e2ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:56.899179 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 145/288] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:31:57.301861 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5992306d-8656-4c4d-b592-22e5911a5909 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:57.446563 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5992306d-8656-4c4d-b592-22e5911a5909 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:57.491465 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdbb32c-6780-40ce-b0e9-ad9a5ce4633c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:57.492102 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdbb32c-6780-40ce-b0e9-ad9a5ce4633c None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:57.492384 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdbb32c-6780-40ce-b0e9-ad9a5ce4633c None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:57.492655 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdbb32c-6780-40ce-b0e9-ad9a5ce4633c None admin] PATH_INFO: `/v3/roles/member` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:57.494672 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:57.510720 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdbb32c-6780-40ce-b0e9-ad9a5ce4633c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:31:57.516956 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-bfdbb32c-6780-40ce-b0e9-ad9a5ce4633c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:31:57.516956 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:57.516956 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:57.516956 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:57.516956 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:57.516956 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:57.516956 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:57.516956 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:57.516956 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:57.516956 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:57.516956 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:57.516956 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:57.516956 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:31:57.516956 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:31:57.516956 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:31:57.516956 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:31:57.518371 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:31:57.518371 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:31:57.518371 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:31:57.518371 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:31:57.518371 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:57.518371 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:57.518371 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:57.518371 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:57.518371 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:57.518371 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:57.518371 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:57.518371 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:57.518371 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:57.518371 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:57.518371 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:57.518371 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:57.519804 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:57.519804 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:57.519804 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:57.519804 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:57.519804 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:31:57.519804 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:31:57.519804 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:31:57.519804 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:31:57.519804 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:31:57.519804 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:31:57.519804 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:31:57.519804 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:31:57.525354 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 144/289] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Aug 29 22:31:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:31:57.531025 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021bf18d-fc6e-48af-9f08-1afea8a7e2ff None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:57.696931 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021bf18d-fc6e-48af-9f08-1afea8a7e2ff None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:57.751444 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36e31d2-17fd-4244-894d-897fb278d9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:57.752055 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e31d2-17fd-4244-894d-897fb278d9d7 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:57.752337 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e31d2-17fd-4244-894d-897fb278d9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:57.752611 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e31d2-17fd-4244-894d-897fb278d9d7 None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:57.753288 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36e31d2-17fd-4244-894d-897fb278d9d7 None admin] RBAC: Adding query filter params (name=member) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:57.753616 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36e31d2-17fd-4244-894d-897fb278d9d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:57.755002 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36e31d2-17fd-4244-894d-897fb278d9d7 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:57.762789 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:57.771745 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 146/290] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Aug 29 22:31:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:57.777764 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdbb32c-6780-40ce-b0e9-ad9a5ce4633c None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:57.930169 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdbb32c-6780-40ce-b0e9-ad9a5ce4633c None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:57.981257 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a5b071-1021-4e96-a8ba-0fe4dc1091a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:57.981848 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5b071-1021-4e96-a8ba-0fe4dc1091a8 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:57.982385 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5b071-1021-4e96-a8ba-0fe4dc1091a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:57.982668 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5b071-1021-4e96-a8ba-0fe4dc1091a8 None admin] PATH_INFO: `/v3/users/d9825efc443d4841a31a07214587cbdc` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:57.983871 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a5b071-1021-4e96-a8ba-0fe4dc1091a8 None admin] RBAC: Authorizing `identity:get_user(user_id=d9825efc443d4841a31a07214587cbdc)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:57.985337 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a5b071-1021-4e96-a8ba-0fe4dc1091a8 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:57.987321 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 145/291] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Aug 29 22:31:57 2022] GET /identity/v3/users/d9825efc443d4841a31a07214587cbdc => generated 297 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:57.992858 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36e31d2-17fd-4244-894d-897fb278d9d7 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:58.130599 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36e31d2-17fd-4244-894d-897fb278d9d7 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:58.176373 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4476f0bb-6d50-4432-b619-6d87ef15f871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:58.177354 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476f0bb-6d50-4432-b619-6d87ef15f871 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:58.177828 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476f0bb-6d50-4432-b619-6d87ef15f871 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:58.178287 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476f0bb-6d50-4432-b619-6d87ef15f871 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:58.245444 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d1c5fd-372d-4be9-a6de-b6fd7ba2ada2 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:58.245885 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d1c5fd-372d-4be9-a6de-b6fd7ba2ada2 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:58.246295 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d1c5fd-372d-4be9-a6de-b6fd7ba2ada2 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:58.248426 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 146/292] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:31:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:58.253529 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e158c02-62f7-49ee-8c6a-d9c939328134 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:58.253815 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e158c02-62f7-49ee-8c6a-d9c939328134 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:58.254094 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e158c02-62f7-49ee-8c6a-d9c939328134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:58.257736 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:58.262227 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4476f0bb-6d50-4432-b619-6d87ef15f871 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:58.264029 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4476f0bb-6d50-4432-b619-6d87ef15f871 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:58.289358 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-9e158c02-62f7-49ee-8c6a-d9c939328134 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:58.290832 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-9e158c02-62f7-49ee-8c6a-d9c939328134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:58.367038 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:58.371534 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 147/293] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Aug 29 22:31:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:31:58.372651 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79d46d-2ef7-4cc4-916f-dec49c5730c0 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:58.372931 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79d46d-2ef7-4cc4-916f-dec49c5730c0 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:58.373196 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79d46d-2ef7-4cc4-916f-dec49c5730c0 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:58.377489 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 147/294] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:31:58.381373 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 148/295] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:31:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:58.382465 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e158c02-62f7-49ee-8c6a-d9c939328134 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:58.384204 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567dc48d-b6dd-474c-9389-60b14ae3b490 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:58.384631 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567dc48d-b6dd-474c-9389-60b14ae3b490 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:58.385020 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567dc48d-b6dd-474c-9389-60b14ae3b490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:58.418548 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-567dc48d-b6dd-474c-9389-60b14ae3b490 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:58.420813 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-567dc48d-b6dd-474c-9389-60b14ae3b490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:58.543503 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 149/296] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:31:58.557657 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e158c02-62f7-49ee-8c6a-d9c939328134 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:58.600400 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11522f30-0acf-4d1f-9d2b-29ef7593976d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:58.601311 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11522f30-0acf-4d1f-9d2b-29ef7593976d None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:58.601755 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11522f30-0acf-4d1f-9d2b-29ef7593976d None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:58.602167 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11522f30-0acf-4d1f-9d2b-29ef7593976d None admin] PATH_INFO: `/v3/projects/2d92e217cd6146f7910ea8e021e81cb4` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:58.606309 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11522f30-0acf-4d1f-9d2b-29ef7593976d None admin] RBAC: Authorizing `identity:get_project(project_id=2d92e217cd6146f7910ea8e021e81cb4)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:58.607933 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11522f30-0acf-4d1f-9d2b-29ef7593976d None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:58.610087 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 148/297] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Aug 29 22:31:58 2022] GET /identity/v3/projects/2d92e217cd6146f7910ea8e021e81cb4 => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:58.616104 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567dc48d-b6dd-474c-9389-60b14ae3b490 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:58.662368 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:58.673503 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11522f30-0acf-4d1f-9d2b-29ef7593976d None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:58.739673 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:58.794437 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567dc48d-b6dd-474c-9389-60b14ae3b490 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:58.842120 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11522f30-0acf-4d1f-9d2b-29ef7593976d None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:58.843095 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7bad44-242a-4ac5-ad67-00ed0dadd3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:58.843952 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7bad44-242a-4ac5-ad67-00ed0dadd3a0 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:58.844440 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7bad44-242a-4ac5-ad67-00ed0dadd3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:58.844909 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7bad44-242a-4ac5-ad67-00ed0dadd3a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:58.847509 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7bad44-242a-4ac5-ad67-00ed0dadd3a0 None admin] RBAC: Adding query filter params (role.id=0c67797d444d4c929b2ccab47c468848, scope.project.id=2d92e217cd6146f7910ea8e021e81cb4, user.id=d9825efc443d4841a31a07214587cbdc) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:58.847831 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7bad44-242a-4ac5-ad67-00ed0dadd3a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:58.849502 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7bad44-242a-4ac5-ad67-00ed0dadd3a0 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:58.856768 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 150/298] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Aug 29 22:31:58 2022] GET /identity/v3/role_assignments?user.id=d9825efc443d4841a31a07214587cbdc&scope.project.id=2d92e217cd6146f7910ea8e021e81cb4&role.id=0c67797d444d4c929b2ccab47c468848 => generated 608 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:58.861351 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7bad44-242a-4ac5-ad67-00ed0dadd3a0 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:58.922116 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd80133-016c-4199-9724-c83b41be33e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:58.923000 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd80133-016c-4199-9724-c83b41be33e5 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:58.923283 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd80133-016c-4199-9724-c83b41be33e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:58.923558 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd80133-016c-4199-9724-c83b41be33e5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:58.948096 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd80133-016c-4199-9724-c83b41be33e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:31:58.954899 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-3cd80133-016c-4199-9724-c83b41be33e5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 22:31:58.954899 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:58.954899 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:58.954899 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:58.954899 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:58.954899 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:58.954899 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:58.954899 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:58.954899 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:58.954899 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:58.954899 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:58.954899 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:58.954899 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:31:58.954899 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:31:58.954899 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:31:58.954899 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:31:58.955830 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:31:58.955830 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:31:58.955830 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:31:58.955830 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:31:58.955830 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:58.955830 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:58.955830 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:58.955830 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:58.955830 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:58.955830 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:58.955830 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:58.955830 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:58.955830 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:58.955830 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:58.955830 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:58.955830 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:58.956593 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:58.956593 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:58.956593 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:58.956593 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:58.956593 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:31:58.956593 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:31:58.956593 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:31:58.956593 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:31:58.956593 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:31:58.956593 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:31:58.956593 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 22:31:58.956593 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:31:58.957173 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 149/299] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Aug 29 22:31:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:31:58.965937 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd80133-016c-4199-9724-c83b41be33e5 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:59.013984 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:59.025851 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7bad44-242a-4ac5-ad67-00ed0dadd3a0 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:59.070080 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e56a191-9bd0-4e7d-927c-83919e3555be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:59.070719 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e56a191-9bd0-4e7d-927c-83919e3555be None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:59.070998 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e56a191-9bd0-4e7d-927c-83919e3555be None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:59.071273 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e56a191-9bd0-4e7d-927c-83919e3555be None admin] PATH_INFO: `/v3/domains/default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:59.072404 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e56a191-9bd0-4e7d-927c-83919e3555be None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:59.074577 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e56a191-9bd0-4e7d-927c-83919e3555be None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:59.076422 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 151/300] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:31:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:59.078268 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b078e-97e5-4f95-aefa-316b2e22a970 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:59.078268 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b078e-97e5-4f95-aefa-316b2e22a970 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:59.078268 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b078e-97e5-4f95-aefa-316b2e22a970 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:59.081384 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 152/301] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:31:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:59.081384 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88396e83-a47e-44ca-9b24-7d181d250a17 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:59.081384 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88396e83-a47e-44ca-9b24-7d181d250a17 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:59.081384 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88396e83-a47e-44ca-9b24-7d181d250a17 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:59.086477 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 153/302] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:31:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:31:59.087234 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88396e83-a47e-44ca-9b24-7d181d250a17 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:59.098710 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd80133-016c-4199-9724-c83b41be33e5 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:59.125455 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:59.145170 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc6d211-63d8-4585-9b38-40c2e844127a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:59.146130 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6d211-63d8-4585-9b38-40c2e844127a None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:59.146531 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6d211-63d8-4585-9b38-40c2e844127a None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:59.146923 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6d211-63d8-4585-9b38-40c2e844127a None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:59.147908 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc6d211-63d8-4585-9b38-40c2e844127a None admin] RBAC: Adding query filter params (name=reader) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:59.148415 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc6d211-63d8-4585-9b38-40c2e844127a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:59.150133 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc6d211-63d8-4585-9b38-40c2e844127a None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:59.160553 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 150/303] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Aug 29 22:31:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:59.162222 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133394e-1e34-425a-8a0f-63993fff06f0 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:59.162680 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133394e-1e34-425a-8a0f-63993fff06f0 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:59.163123 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133394e-1e34-425a-8a0f-63993fff06f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:59.184413 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-a133394e-1e34-425a-8a0f-63993fff06f0 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:59.185671 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-a133394e-1e34-425a-8a0f-63993fff06f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:59.206804 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88396e83-a47e-44ca-9b24-7d181d250a17 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:59.240568 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee17ae5-0767-4537-a83f-745a43f9f241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:59.241238 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee17ae5-0767-4537-a83f-745a43f9f241 None admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:59.241550 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee17ae5-0767-4537-a83f-745a43f9f241 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:59.241823 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee17ae5-0767-4537-a83f-745a43f9f241 None admin] PATH_INFO: `/v3/groups` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:59.242448 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee17ae5-0767-4537-a83f-745a43f9f241 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:59.243892 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee17ae5-0767-4537-a83f-745a43f9f241 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:59.253952 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 151/304] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:31:59.255237 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499bcbcc-ff3d-46e0-88a6-f0f5d8d542cd None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:59.255546 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499bcbcc-ff3d-46e0-88a6-f0f5d8d542cd None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:59.255855 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499bcbcc-ff3d-46e0-88a6-f0f5d8d542cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:59.262631 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 154/305] 10.222.0.47 () {60 vars in 1134 bytes} [Mon Aug 29 22:31:59 2022] POST /identity/v3/groups => generated 229 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:31:59.264043 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee17ae5-0767-4537-a83f-745a43f9f241 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:59.288549 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-499bcbcc-ff3d-46e0-88a6-f0f5d8d542cd None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:31:59.289928 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-499bcbcc-ff3d-46e0-88a6-f0f5d8d542cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:31:59.291434 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:59.398969 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee17ae5-0767-4537-a83f-745a43f9f241 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:59.412068 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 152/306] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:31:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:31:59.448498 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49882471-34ee-4ea8-899e-93eee4664653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:59.449139 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49882471-34ee-4ea8-899e-93eee4664653 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:59.449575 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49882471-34ee-4ea8-899e-93eee4664653 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:59.449851 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49882471-34ee-4ea8-899e-93eee4664653 None admin] PATH_INFO: `/v3/users/0435482e96844c88941ef5cddff626ec` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:59.465616 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49882471-34ee-4ea8-899e-93eee4664653 None admin] RBAC: Authorizing `identity:get_user(user_id=0435482e96844c88941ef5cddff626ec)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:59.467162 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49882471-34ee-4ea8-899e-93eee4664653 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:59.468888 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 155/307] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Aug 29 22:31:59 2022] GET /identity/v3/users/0435482e96844c88941ef5cddff626ec => generated 293 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:59.474944 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499bcbcc-ff3d-46e0-88a6-f0f5d8d542cd None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:59.520192 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:59.528271 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49882471-34ee-4ea8-899e-93eee4664653 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:59.585113 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499bcbcc-ff3d-46e0-88a6-f0f5d8d542cd None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:59.618160 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:59.624640 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea0846-d129-4b91-8ed8-9c1d7b054d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:59.625250 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea0846-d129-4b91-8ed8-9c1d7b054d89 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:59.625563 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea0846-d129-4b91-8ed8-9c1d7b054d89 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:59.625837 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea0846-d129-4b91-8ed8-9c1d7b054d89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:59.626569 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ea0846-d129-4b91-8ed8-9c1d7b054d89 None admin] RBAC: Adding query filter params (role.id=20d05bce224344d7b13c43a2e9de7abd, user.id=0435482e96844c88941ef5cddff626ec, scope.system=all) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:59.626881 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ea0846-d129-4b91-8ed8-9c1d7b054d89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:59.628313 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ea0846-d129-4b91-8ed8-9c1d7b054d89 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:59.638884 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 153/308] 10.222.0.47 () {56 vars in 1308 bytes} [Mon Aug 29 22:31:59 2022] GET /identity/v3/role_assignments?user.id=0435482e96844c88941ef5cddff626ec&scope.system=all&role.id=20d05bce224344d7b13c43a2e9de7abd => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:59.649877 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49882471-34ee-4ea8-899e-93eee4664653 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:59.690865 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39485465-93d7-4034-906a-101c8a28c845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:59.691528 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39485465-93d7-4034-906a-101c8a28c845 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:59.691803 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39485465-93d7-4034-906a-101c8a28c845 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:59.692072 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39485465-93d7-4034-906a-101c8a28c845 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:59.705205 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39485465-93d7-4034-906a-101c8a28c845 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:31:59.706806 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea0846-d129-4b91-8ed8-9c1d7b054d89 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:59.711405 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-39485465-93d7-4034-906a-101c8a28c845 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:31:59.711405 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:59.711405 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:59.711405 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:59.711405 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:59.711405 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:59.711405 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:59.711405 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:59.711405 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:59.711405 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:59.711405 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:59.711405 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:59.711405 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:31:59.711405 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:31:59.711405 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:31:59.711405 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:31:59.712347 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:31:59.712347 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:31:59.712347 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:31:59.712347 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:31:59.712347 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:59.712347 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:59.712347 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:59.712347 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:59.712347 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:59.712347 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:59.712347 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:59.712347 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:59.712347 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:59.712347 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:59.712347 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:59.712347 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:59.713107 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:59.713107 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:59.713107 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:59.713107 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:59.713107 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:31:59.713107 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:31:59.713107 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:31:59.713107 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:31:59.713107 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:31:59.713107 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:31:59.713107 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:31:59.713107 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:31:59.713107 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 156/309] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Aug 29 22:31:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:31:59.719726 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39485465-93d7-4034-906a-101c8a28c845 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:59.840160 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea0846-d129-4b91-8ed8-9c1d7b054d89 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:59.852979 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39485465-93d7-4034-906a-101c8a28c845 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:31:59.853719 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:59.891309 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95334863-f05c-4756-8e03-ee2133edac62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:59.891956 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95334863-f05c-4756-8e03-ee2133edac62 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:59.892237 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95334863-f05c-4756-8e03-ee2133edac62 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:59.892510 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95334863-f05c-4756-8e03-ee2133edac62 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:59.895438 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea16007-d610-4e9f-9e25-5f2094c2dfbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:31:59.896147 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea16007-d610-4e9f-9e25-5f2094c2dfbe None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:31:59.896526 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea16007-d610-4e9f-9e25-5f2094c2dfbe None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:31:59.896896 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea16007-d610-4e9f-9e25-5f2094c2dfbe None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:31:59.897734 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea16007-d610-4e9f-9e25-5f2094c2dfbe None admin] RBAC: Adding query filter params (name=member) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:31:59.898135 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea16007-d610-4e9f-9e25-5f2094c2dfbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:31:59.899865 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea16007-d610-4e9f-9e25-5f2094c2dfbe None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:31:59.906231 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:31:59.907456 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95334863-f05c-4756-8e03-ee2133edac62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:31:59.914006 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-95334863-f05c-4756-8e03-ee2133edac62 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 22:31:59.914006 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:31:59.914006 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:31:59.914006 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:31:59.914006 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:31:59.914006 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:31:59.914006 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:31:59.914006 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:31:59.914006 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:31:59.914006 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:31:59.914006 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:31:59.914006 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:31:59.914006 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:31:59.914006 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:31:59.914006 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:31:59.914006 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:31:59.914879 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:31:59.914879 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:31:59.914879 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:31:59.914879 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:31:59.914879 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:31:59.914879 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:31:59.914879 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:31:59.914879 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:31:59.914879 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:31:59.914879 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:31:59.914879 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:31:59.914879 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:31:59.914879 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:31:59.914879 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:31:59.914879 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:31:59.914879 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:31:59.915653 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:31:59.915653 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:31:59.915653 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:31:59.915653 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:31:59.915653 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:31:59.915653 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:31:59.915653 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:31:59.915653 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:31:59.915653 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:31:59.915653 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:31:59.915653 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 22:31:59.915653 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:31:59.916232 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 157/310] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Aug 29 22:31:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:31:59.917861 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea16007-d610-4e9f-9e25-5f2094c2dfbe None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:31:59.918969 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 154/311] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Aug 29 22:31:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:31:59.924568 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95334863-f05c-4756-8e03-ee2133edac62 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:00.033864 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea16007-d610-4e9f-9e25-5f2094c2dfbe None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:00.065625 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95334863-f05c-4756-8e03-ee2133edac62 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:00.073279 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db208be-5066-436e-9a60-b05ffc4b0cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:00.074188 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db208be-5066-436e-9a60-b05ffc4b0cf0 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:00.074538 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db208be-5066-436e-9a60-b05ffc4b0cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:00.074885 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db208be-5066-436e-9a60-b05ffc4b0cf0 None admin] PATH_INFO: `/v3/users/e8e7b95cf42e460dbba4c05ae3a80626` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:00.076137 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db208be-5066-436e-9a60-b05ffc4b0cf0 None admin] RBAC: Authorizing `identity:get_user(user_id=e8e7b95cf42e460dbba4c05ae3a80626)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:00.077700 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db208be-5066-436e-9a60-b05ffc4b0cf0 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:00.079518 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 158/312] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Aug 29 22:31:59 2022] GET /identity/v3/users/e8e7b95cf42e460dbba4c05ae3a80626 => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:00.085003 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db208be-5066-436e-9a60-b05ffc4b0cf0 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:00.113900 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e36013e-033a-4fe7-b018-d7ae897c7e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:00.114615 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36013e-033a-4fe7-b018-d7ae897c7e11 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:00.114957 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36013e-033a-4fe7-b018-d7ae897c7e11 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:00.115295 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36013e-033a-4fe7-b018-d7ae897c7e11 None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:00.116120 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e36013e-033a-4fe7-b018-d7ae897c7e11 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:00.116490 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e36013e-033a-4fe7-b018-d7ae897c7e11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:00.118067 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e36013e-033a-4fe7-b018-d7ae897c7e11 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:00.128146 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 155/313] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Aug 29 22:31:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:00.133796 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e36013e-033a-4fe7-b018-d7ae897c7e11 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:00.162793 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:00.169747 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:00.200097 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db208be-5066-436e-9a60-b05ffc4b0cf0 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:00.246545 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dd8c1a-5d26-4f00-a76a-e7f6b93a7079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:00.247732 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd8c1a-5d26-4f00-a76a-e7f6b93a7079 None admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:00.248092 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd8c1a-5d26-4f00-a76a-e7f6b93a7079 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:00.248722 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd8c1a-5d26-4f00-a76a-e7f6b93a7079 None admin] PATH_INFO: `/v3/system/users/e8e7b95cf42e460dbba4c05ae3a80626/roles/0c67797d444d4c929b2ccab47c468848` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:00.250728 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dd8c1a-5d26-4f00-a76a-e7f6b93a7079 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e8e7b95cf42e460dbba4c05ae3a80626, role_id=0c67797d444d4c929b2ccab47c468848)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:00.252840 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dd8c1a-5d26-4f00-a76a-e7f6b93a7079 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:00.259072 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e36013e-033a-4fe7-b018-d7ae897c7e11 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:00.274356 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 159/314] 10.222.0.47 () {58 vars in 1334 bytes} [Mon Aug 29 22:32:00 2022] PUT /identity/v3/system/users/e8e7b95cf42e460dbba4c05ae3a80626/roles/0c67797d444d4c929b2ccab47c468848 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:32:00.316369 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eb2d8d-c1a6-4fd1-889e-1a167261ea33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:00.317544 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb2d8d-c1a6-4fd1-889e-1a167261ea33 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:00.318035 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb2d8d-c1a6-4fd1-889e-1a167261ea33 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:00.318517 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb2d8d-c1a6-4fd1-889e-1a167261ea33 None admin] PATH_INFO: `/v3/users/1456d21f15a94b52b63dcff453fb7b7a` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:00.320121 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eb2d8d-c1a6-4fd1-889e-1a167261ea33 None admin] RBAC: Authorizing `identity:get_user(user_id=1456d21f15a94b52b63dcff453fb7b7a)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:00.322231 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eb2d8d-c1a6-4fd1-889e-1a167261ea33 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:00.325257 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 156/315] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Aug 29 22:32:00 2022] GET /identity/v3/users/1456d21f15a94b52b63dcff453fb7b7a => generated 297 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:32:00.331054 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dd8c1a-5d26-4f00-a76a-e7f6b93a7079 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:00.459529 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dd8c1a-5d26-4f00-a76a-e7f6b93a7079 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:00.496124 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:00.503539 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd494fe2-c6ce-4e8d-a5a0-a0d34210b3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:00.504936 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd494fe2-c6ce-4e8d-a5a0-a0d34210b3c8 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:00.505640 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd494fe2-c6ce-4e8d-a5a0-a0d34210b3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:00.506118 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd494fe2-c6ce-4e8d-a5a0-a0d34210b3c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:00.582352 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd494fe2-c6ce-4e8d-a5a0-a0d34210b3c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:00.584181 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd494fe2-c6ce-4e8d-a5a0-a0d34210b3c8 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:00.694366 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 160/316] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Aug 29 22:32:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:32:00.702398 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eb2d8d-c1a6-4fd1-889e-1a167261ea33 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:00.832412 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:00.839992 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eb2d8d-c1a6-4fd1-889e-1a167261ea33 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:00.879144 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373a28fa-55f0-4517-b4fd-ebfc1978bd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:00.879906 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a28fa-55f0-4517-b4fd-ebfc1978bd24 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:00.880094 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a28fa-55f0-4517-b4fd-ebfc1978bd24 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:00.880341 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a28fa-55f0-4517-b4fd-ebfc1978bd24 None admin] PATH_INFO: `/v3/projects/2d92e217cd6146f7910ea8e021e81cb4` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:00.881538 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373a28fa-55f0-4517-b4fd-ebfc1978bd24 None admin] RBAC: Authorizing `identity:get_project(project_id=2d92e217cd6146f7910ea8e021e81cb4)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:00.883227 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373a28fa-55f0-4517-b4fd-ebfc1978bd24 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:00.891836 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 157/317] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Aug 29 22:32:00 2022] GET /identity/v3/projects/2d92e217cd6146f7910ea8e021e81cb4 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:00.894186 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd494fe2-c6ce-4e8d-a5a0-a0d34210b3c8 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:00.927437 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:01.005441 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd494fe2-c6ce-4e8d-a5a0-a0d34210b3c8 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:01.042370 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29decd9-4db0-4820-99d3-fd2341bc23d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:01.042991 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29decd9-4db0-4820-99d3-fd2341bc23d5 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:01.043282 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29decd9-4db0-4820-99d3-fd2341bc23d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:01.043523 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29decd9-4db0-4820-99d3-fd2341bc23d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:01.044261 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29decd9-4db0-4820-99d3-fd2341bc23d5 None admin] RBAC: Adding query filter params (role.id=20d05bce224344d7b13c43a2e9de7abd, scope.project.id=2d92e217cd6146f7910ea8e021e81cb4, user.id=1456d21f15a94b52b63dcff453fb7b7a) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:01.044572 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29decd9-4db0-4820-99d3-fd2341bc23d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:01.046052 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29decd9-4db0-4820-99d3-fd2341bc23d5 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:01.052199 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 161/318] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Aug 29 22:32:00 2022] GET /identity/v3/role_assignments?user.id=1456d21f15a94b52b63dcff453fb7b7a&scope.project.id=2d92e217cd6146f7910ea8e021e81cb4&role.id=20d05bce224344d7b13c43a2e9de7abd => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:01.380940 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50d451-9287-41da-93ff-d4c968710179 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:01.381252 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50d451-9287-41da-93ff-d4c968710179 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:01.381528 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50d451-9287-41da-93ff-d4c968710179 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:01.382921 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 158/319] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:32:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:32:01.388643 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c8bcb-96e7-444e-9a4f-307dad780023 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:01.388936 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c8bcb-96e7-444e-9a4f-307dad780023 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:01.389215 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c8bcb-96e7-444e-9a4f-307dad780023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:01.408127 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-a27c8bcb-96e7-444e-9a4f-307dad780023 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:32:01.409351 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-a27c8bcb-96e7-444e-9a4f-307dad780023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:01.483749 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 162/320] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:32:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:32:01.686270 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cfe18e-6680-45f6-b1ce-a0dac4defa00 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:01.686634 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cfe18e-6680-45f6-b1ce-a0dac4defa00 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:01.686832 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cfe18e-6680-45f6-b1ce-a0dac4defa00 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:01.688305 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 159/321] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:32:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:32:01.693346 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f1767-0809-4e39-8659-ff866716d41f None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:01.693650 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f1767-0809-4e39-8659-ff866716d41f None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:01.693924 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f1767-0809-4e39-8659-ff866716d41f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:01.714128 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-c08f1767-0809-4e39-8659-ff866716d41f None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:32:01.715342 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-c08f1767-0809-4e39-8659-ff866716d41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:01.736904 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:01.763452 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cfe18e-6680-45f6-b1ce-a0dac4defa00 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:01.787553 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 163/322] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:32:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:32:01.879086 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cfe18e-6680-45f6-b1ce-a0dac4defa00 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:01.929724 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d23aee4-b4ef-40b1-9156-e3a39e606fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:01.930700 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23aee4-b4ef-40b1-9156-e3a39e606fda None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:01.930700 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23aee4-b4ef-40b1-9156-e3a39e606fda None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:01.930980 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23aee4-b4ef-40b1-9156-e3a39e606fda None admin] PATH_INFO: `/v3/domains/default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:01.932066 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d23aee4-b4ef-40b1-9156-e3a39e606fda None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:01.934407 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d23aee4-b4ef-40b1-9156-e3a39e606fda None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:01.936665 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 160/323] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:32:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:32:01.942014 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f1767-0809-4e39-8659-ff866716d41f None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:02.060557 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f1767-0809-4e39-8659-ff866716d41f None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:02.065397 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d23aee4-b4ef-40b1-9156-e3a39e606fda None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:02.096732 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:02.098456 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a561c207-47fc-462c-847f-b1043d6890d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:02.099230 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561c207-47fc-462c-847f-b1043d6890d2 None admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:02.099595 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561c207-47fc-462c-847f-b1043d6890d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:02.099885 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561c207-47fc-462c-847f-b1043d6890d2 None admin] PATH_INFO: `/v3/groups` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:02.100576 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a561c207-47fc-462c-847f-b1043d6890d2 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:02.102237 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a561c207-47fc-462c-847f-b1043d6890d2 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:02.121144 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 164/324] 10.222.0.47 () {60 vars in 1134 bytes} [Mon Aug 29 22:32:01 2022] POST /identity/v3/groups => generated 226 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:32:02.180335 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d23aee4-b4ef-40b1-9156-e3a39e606fda None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:02.219172 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd0c6f-aec9-4093-9424-14cfcc4b4215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:02.219728 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd0c6f-aec9-4093-9424-14cfcc4b4215 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:02.220012 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd0c6f-aec9-4093-9424-14cfcc4b4215 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:02.220288 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd0c6f-aec9-4093-9424-14cfcc4b4215 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:02.233033 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cd0c6f-aec9-4093-9424-14cfcc4b4215 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:32:02.239071 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-c1cd0c6f-aec9-4093-9424-14cfcc4b4215 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 22:32:02.239071 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:02.239071 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:02.239071 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:02.239071 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:02.239071 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:02.239071 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:02.239071 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:02.239071 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:02.239071 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:02.239071 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:02.239071 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:02.239071 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:32:02.239071 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:32:02.239071 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:32:02.239071 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:32:02.239976 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:32:02.239976 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:32:02.239976 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:32:02.239976 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:32:02.239976 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:02.239976 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:02.239976 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:02.239976 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:02.239976 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:02.239976 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:02.239976 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:02.239976 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:02.239976 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:02.239976 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:02.239976 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:02.239976 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:02.240743 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:02.240743 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:02.240743 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:02.240743 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:02.240743 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:32:02.240743 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:32:02.240743 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:32:02.240743 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:32:02.240743 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:32:02.240743 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:32:02.240743 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 22:32:02.240743 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:32:02.240743 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 161/325] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Aug 29 22:32:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:32:02.247897 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a561c207-47fc-462c-847f-b1043d6890d2 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:02.268691 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:02.316143 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069edeb0-c890-4730-8de1-c77557607123 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:02.316419 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069edeb0-c890-4730-8de1-c77557607123 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:02.316689 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069edeb0-c890-4730-8de1-c77557607123 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:02.318211 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 162/326] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:32:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:32:02.323095 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b129855-f29d-4dee-a0f8-e062fcc29176 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:02.323579 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b129855-f29d-4dee-a0f8-e062fcc29176 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:02.323928 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b129855-f29d-4dee-a0f8-e062fcc29176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:02.345925 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-6b129855-f29d-4dee-a0f8-e062fcc29176 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:32:02.347164 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-6b129855-f29d-4dee-a0f8-e062fcc29176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:02.374603 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a561c207-47fc-462c-847f-b1043d6890d2 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:02.427256 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa79619f-1bf4-477a-a836-3a41fc7eb736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:02.427874 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79619f-1bf4-477a-a836-3a41fc7eb736 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:02.428155 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79619f-1bf4-477a-a836-3a41fc7eb736 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:02.428424 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79619f-1bf4-477a-a836-3a41fc7eb736 None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:02.429099 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa79619f-1bf4-477a-a836-3a41fc7eb736 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:02.429444 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa79619f-1bf4-477a-a836-3a41fc7eb736 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:02.430789 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa79619f-1bf4-477a-a836-3a41fc7eb736 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:02.439273 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 163/327] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:32:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:32:02.440259 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 165/328] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Aug 29 22:32:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:02.447010 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b129855-f29d-4dee-a0f8-e062fcc29176 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:02.473872 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:02.561991 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b129855-f29d-4dee-a0f8-e062fcc29176 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:02.599703 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22afe148-c91d-416f-8a3b-19378c1bae6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:02.600340 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22afe148-c91d-416f-8a3b-19378c1bae6d None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:02.600616 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22afe148-c91d-416f-8a3b-19378c1bae6d None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:02.600886 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22afe148-c91d-416f-8a3b-19378c1bae6d None admin] PATH_INFO: `/v3/users/0435482e96844c88941ef5cddff626ec` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:02.602977 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22afe148-c91d-416f-8a3b-19378c1bae6d None admin] RBAC: Authorizing `identity:get_user(user_id=0435482e96844c88941ef5cddff626ec)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:02.605003 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22afe148-c91d-416f-8a3b-19378c1bae6d None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:02.607457 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 164/329] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Aug 29 22:32:02 2022] GET /identity/v3/users/0435482e96844c88941ef5cddff626ec => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:02.613477 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa79619f-1bf4-477a-a836-3a41fc7eb736 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:02.716907 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:02.719152 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22afe148-c91d-416f-8a3b-19378c1bae6d None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:02.746832 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa79619f-1bf4-477a-a836-3a41fc7eb736 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:02.785611 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c966eb94-471d-420b-930a-844f7634f3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:02.786283 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966eb94-471d-420b-930a-844f7634f3e0 None admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:02.786564 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966eb94-471d-420b-930a-844f7634f3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:02.786843 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966eb94-471d-420b-930a-844f7634f3e0 None admin] PATH_INFO: `/v3/system/users/0435482e96844c88941ef5cddff626ec/roles/20d05bce224344d7b13c43a2e9de7abd` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:02.788343 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c966eb94-471d-420b-930a-844f7634f3e0 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0435482e96844c88941ef5cddff626ec, role_id=20d05bce224344d7b13c43a2e9de7abd)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:02.789799 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c966eb94-471d-420b-930a-844f7634f3e0 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:02.802772 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 166/330] 10.222.0.47 () {58 vars in 1334 bytes} [Mon Aug 29 22:32:02 2022] PUT /identity/v3/system/users/0435482e96844c88941ef5cddff626ec/roles/20d05bce224344d7b13c43a2e9de7abd => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:32:02.849028 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:02.862247 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22afe148-c91d-416f-8a3b-19378c1bae6d None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:02.904121 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be3bd9-7f48-49f2-83d9-f8529eadf63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:02.904773 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be3bd9-7f48-49f2-83d9-f8529eadf63c None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:02.905046 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be3bd9-7f48-49f2-83d9-f8529eadf63c None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:02.905317 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be3bd9-7f48-49f2-83d9-f8529eadf63c None admin] PATH_INFO: `/v3/roles/member` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:02.918771 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70be3bd9-7f48-49f2-83d9-f8529eadf63c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:32:02.923902 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-70be3bd9-7f48-49f2-83d9-f8529eadf63c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:32:02.923902 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:02.923902 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:02.923902 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:02.923902 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:02.923902 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:02.923902 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:02.923902 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:02.923902 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:02.923902 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:02.923902 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:02.923902 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:02.923902 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:32:02.923902 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:32:02.923902 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:32:02.923902 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:32:02.924802 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:32:02.924802 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:32:02.924802 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:32:02.924802 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:32:02.924802 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:02.924802 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:02.924802 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:02.924802 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:02.924802 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:02.924802 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:02.924802 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:02.924802 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:02.924802 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:02.924802 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:02.924802 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:02.924802 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:02.925620 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:02.925620 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:02.925620 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:02.925620 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:02.925620 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:32:02.925620 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:32:02.925620 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:32:02.925620 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:32:02.925620 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:32:02.925620 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:32:02.925620 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:32:02.925620 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:32:02.925620 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 165/331] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Aug 29 22:32:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:32:02.931849 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c966eb94-471d-420b-930a-844f7634f3e0 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:03.056484 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c966eb94-471d-420b-930a-844f7634f3e0 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:03.092458 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3f4416-219b-46a8-aef7-ff6f77f440b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:03.093263 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f4416-219b-46a8-aef7-ff6f77f440b0 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:03.093441 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f4416-219b-46a8-aef7-ff6f77f440b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:03.093760 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f4416-219b-46a8-aef7-ff6f77f440b0 None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:03.094381 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3f4416-219b-46a8-aef7-ff6f77f440b0 None admin] RBAC: Adding query filter params (name=member) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:03.094838 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3f4416-219b-46a8-aef7-ff6f77f440b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:03.097141 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3f4416-219b-46a8-aef7-ff6f77f440b0 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:03.110600 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 167/332] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Aug 29 22:32:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:03.116794 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be3bd9-7f48-49f2-83d9-f8529eadf63c None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:03.233014 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be3bd9-7f48-49f2-83d9-f8529eadf63c None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:03.278572 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f1b474-6afb-4de8-a64f-be6fe92b2c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:03.279583 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f1b474-6afb-4de8-a64f-be6fe92b2c9b None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:03.280088 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f1b474-6afb-4de8-a64f-be6fe92b2c9b None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:03.280558 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f1b474-6afb-4de8-a64f-be6fe92b2c9b None admin] PATH_INFO: `/v3/users/e8e7b95cf42e460dbba4c05ae3a80626` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:03.286013 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f1b474-6afb-4de8-a64f-be6fe92b2c9b None admin] RBAC: Authorizing `identity:get_user(user_id=e8e7b95cf42e460dbba4c05ae3a80626)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:03.287790 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f1b474-6afb-4de8-a64f-be6fe92b2c9b None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:03.289762 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 166/333] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Aug 29 22:32:03 2022] GET /identity/v3/users/e8e7b95cf42e460dbba4c05ae3a80626 => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:03.296285 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3f4416-219b-46a8-aef7-ff6f77f440b0 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:03.303437 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:03.458665 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3f4416-219b-46a8-aef7-ff6f77f440b0 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:03.506158 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930aaa81-ce6c-4568-8f38-e99fe35062d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:03.506778 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930aaa81-ce6c-4568-8f38-e99fe35062d4 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:03.507057 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930aaa81-ce6c-4568-8f38-e99fe35062d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:03.507328 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930aaa81-ce6c-4568-8f38-e99fe35062d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:03.508070 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930aaa81-ce6c-4568-8f38-e99fe35062d4 None admin] RBAC: Adding query filter params (role.id=0c67797d444d4c929b2ccab47c468848, user.id=e8e7b95cf42e460dbba4c05ae3a80626, scope.system=all) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:03.508379 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930aaa81-ce6c-4568-8f38-e99fe35062d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:03.509840 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930aaa81-ce6c-4568-8f38-e99fe35062d4 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:03.530052 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 168/334] 10.222.0.47 () {56 vars in 1308 bytes} [Mon Aug 29 22:32:03 2022] GET /identity/v3/role_assignments?user.id=e8e7b95cf42e460dbba4c05ae3a80626&scope.system=all&role.id=0c67797d444d4c929b2ccab47c468848 => generated 510 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:04.563989 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d3589-c97b-46a1-b157-0e3754884c3f None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:04.564922 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d3589-c97b-46a1-b157-0e3754884c3f None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:04.565448 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d3589-c97b-46a1-b157-0e3754884c3f None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:04.567278 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 167/335] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:32:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:32:04.573362 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed77109-7782-4267-af27-0122f87a2f81 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:04.573788 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed77109-7782-4267-af27-0122f87a2f81 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:04.573985 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed77109-7782-4267-af27-0122f87a2f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:04.602714 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-8ed77109-7782-4267-af27-0122f87a2f81 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:32:04.603924 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-8ed77109-7782-4267-af27-0122f87a2f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:04.671880 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:04.683125 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 169/336] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:32:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:32:05.001526 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2fd26e-7cf0-4f90-a599-88ab8329cd79 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:05.002175 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2fd26e-7cf0-4f90-a599-88ab8329cd79 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:05.002677 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2fd26e-7cf0-4f90-a599-88ab8329cd79 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:05.004495 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 168/337] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:32:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:32:05.009745 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a9311-fc33-4a4b-8299-6416c648cf2e None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:05.010812 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a9311-fc33-4a4b-8299-6416c648cf2e None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:05.011288 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a9311-fc33-4a4b-8299-6416c648cf2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:05.036939 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-f58a9311-fc33-4a4b-8299-6416c648cf2e None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:32:05.038823 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-f58a9311-fc33-4a4b-8299-6416c648cf2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:05.129265 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 170/338] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:32:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:32:05.220350 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2fd26e-7cf0-4f90-a599-88ab8329cd79 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:05.243197 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:05.366046 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2fd26e-7cf0-4f90-a599-88ab8329cd79 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:05.410730 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284d80a6-0645-44d2-8b77-91b1d27f0660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:05.411372 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d80a6-0645-44d2-8b77-91b1d27f0660 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:05.411654 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d80a6-0645-44d2-8b77-91b1d27f0660 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:05.411930 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d80a6-0645-44d2-8b77-91b1d27f0660 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:05.428258 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284d80a6-0645-44d2-8b77-91b1d27f0660 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:32:05.433631 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-284d80a6-0645-44d2-8b77-91b1d27f0660 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:32:05.433631 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:05.433631 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:05.433631 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:05.433631 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:05.433631 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:05.433631 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:05.433631 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:05.433631 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:05.433631 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:05.433631 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:05.433631 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:05.433631 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:32:05.433631 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:32:05.433631 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:32:05.433631 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:32:05.434506 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:32:05.434506 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:32:05.434506 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:32:05.434506 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:32:05.434506 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:05.434506 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:05.434506 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:05.434506 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:05.434506 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:05.434506 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:05.434506 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:05.434506 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:05.434506 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:05.434506 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:05.434506 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:05.434506 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:05.435293 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:05.435293 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:05.435293 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:05.435293 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:05.435293 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:32:05.435293 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:32:05.435293 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:32:05.435293 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:32:05.435293 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:32:05.435293 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:32:05.435293 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:32:05.435293 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:32:05.435293 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 169/339] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Aug 29 22:32:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:05.440913 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a9311-fc33-4a4b-8299-6416c648cf2e None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:05.538983 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd07295d-b723-41b5-ba2b-1679ab0c377e None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:05.539301 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd07295d-b723-41b5-ba2b-1679ab0c377e None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:05.539534 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd07295d-b723-41b5-ba2b-1679ab0c377e None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:05.541128 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 170/340] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:32:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:32:05.548335 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951c67a-bcb0-4503-8d2b-554038bcd0b4 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:05.548923 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951c67a-bcb0-4503-8d2b-554038bcd0b4 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:05.549464 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951c67a-bcb0-4503-8d2b-554038bcd0b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:05.590339 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-4951c67a-bcb0-4503-8d2b-554038bcd0b4 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:32:05.592341 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-4951c67a-bcb0-4503-8d2b-554038bcd0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:05.617217 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a9311-fc33-4a4b-8299-6416c648cf2e None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:05.659753 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:05.680740 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98bf5d5-bc2d-424f-87b6-e4f87f7c9479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:05.681476 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98bf5d5-bc2d-424f-87b6-e4f87f7c9479 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:05.681800 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98bf5d5-bc2d-424f-87b6-e4f87f7c9479 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:05.682198 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98bf5d5-bc2d-424f-87b6-e4f87f7c9479 None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:05.683153 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98bf5d5-bc2d-424f-87b6-e4f87f7c9479 None admin] RBAC: Adding query filter params (name=member) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:05.683461 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98bf5d5-bc2d-424f-87b6-e4f87f7c9479 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:05.684896 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98bf5d5-bc2d-424f-87b6-e4f87f7c9479 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:05.694988 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 171/341] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Aug 29 22:32:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:05.698803 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98bf5d5-bc2d-424f-87b6-e4f87f7c9479 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:05.739809 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 171/342] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:32:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:32:05.740615 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4951c67a-bcb0-4503-8d2b-554038bcd0b4 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:05.758820 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:05.813113 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98bf5d5-bc2d-424f-87b6-e4f87f7c9479 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:05.856138 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82445fb-ef82-4617-85d6-fd0c1ab152e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:05.856697 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82445fb-ef82-4617-85d6-fd0c1ab152e1 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:05.856980 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82445fb-ef82-4617-85d6-fd0c1ab152e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:05.857255 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82445fb-ef82-4617-85d6-fd0c1ab152e1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:05.886559 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82445fb-ef82-4617-85d6-fd0c1ab152e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:32:05.893537 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-d82445fb-ef82-4617-85d6-fd0c1ab152e1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:32:05.893537 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:05.893537 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:05.893537 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:05.893537 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:05.893537 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:05.893537 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:05.893537 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:05.893537 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:05.893537 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:05.893537 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:05.893537 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:05.893537 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:32:05.893537 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:32:05.893537 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:32:05.893537 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:32:05.894658 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:32:05.894658 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:32:05.894658 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:32:05.894658 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:32:05.894658 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:05.894658 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:05.894658 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:05.894658 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:05.894658 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:05.894658 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:05.894658 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:05.894658 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:05.894658 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:05.894658 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:05.894658 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:05.894658 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:05.895507 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:05.895507 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:05.895507 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:05.895507 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:05.895507 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:32:05.895507 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:32:05.895507 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:32:05.895507 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:32:05.895507 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:32:05.895507 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:32:05.895507 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:32:05.895507 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:32:05.903734 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 172/343] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Aug 29 22:32:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:05.905359 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc208d-bbc7-47fb-8c28-9a2799418352 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:05.905791 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc208d-bbc7-47fb-8c28-9a2799418352 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:05.906340 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc208d-bbc7-47fb-8c28-9a2799418352 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:05.908447 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 173/344] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:32:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:32:05.909723 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfc208d-bbc7-47fb-8c28-9a2799418352 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:05.931713 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4951c67a-bcb0-4503-8d2b-554038bcd0b4 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:05.968241 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb8c710-5664-4d4a-afbb-7077146d2a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:05.968863 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb8c710-5664-4d4a-afbb-7077146d2a50 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:05.969199 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb8c710-5664-4d4a-afbb-7077146d2a50 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:05.969535 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb8c710-5664-4d4a-afbb-7077146d2a50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:05.988056 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:06.051969 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb8c710-5664-4d4a-afbb-7077146d2a50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:06.054931 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb8c710-5664-4d4a-afbb-7077146d2a50 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:06.076338 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:06.096870 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfc208d-bbc7-47fb-8c28-9a2799418352 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:06.150653 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bd2259-9e9d-4b2d-9cdb-2e45f59def70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:06.151878 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd2259-9e9d-4b2d-9cdb-2e45f59def70 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:06.152185 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd2259-9e9d-4b2d-9cdb-2e45f59def70 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:06.153852 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd2259-9e9d-4b2d-9cdb-2e45f59def70 None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:06.154596 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bd2259-9e9d-4b2d-9cdb-2e45f59def70 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:06.154905 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bd2259-9e9d-4b2d-9cdb-2e45f59def70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:06.158411 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bd2259-9e9d-4b2d-9cdb-2e45f59def70 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:06.171950 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 174/345] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Aug 29 22:32:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:32:06.173369 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b70cb-adb7-425d-b294-439bdbc6aa80 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:06.173659 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b70cb-adb7-425d-b294-439bdbc6aa80 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:06.173928 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b70cb-adb7-425d-b294-439bdbc6aa80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:06.196742 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-ce8b70cb-adb7-425d-b294-439bdbc6aa80 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:32:06.197090 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 172/346] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Aug 29 22:32:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:32:06.198272 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb8c710-5664-4d4a-afbb-7077146d2a50 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:06.198379 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-ce8b70cb-adb7-425d-b294-439bdbc6aa80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:06.274645 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 175/347] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:32:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:32:06.275302 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b70cb-adb7-425d-b294-439bdbc6aa80 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:06.323769 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb8c710-5664-4d4a-afbb-7077146d2a50 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:06.334047 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:06.355336 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:06.366344 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff180071-4b67-4ddf-a4d7-8ead43d0884a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:06.366996 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff180071-4b67-4ddf-a4d7-8ead43d0884a None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:06.367270 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff180071-4b67-4ddf-a4d7-8ead43d0884a None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:06.367626 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff180071-4b67-4ddf-a4d7-8ead43d0884a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:06.379370 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff180071-4b67-4ddf-a4d7-8ead43d0884a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:32:06.384532 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-ff180071-4b67-4ddf-a4d7-8ead43d0884a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 22:32:06.384532 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:06.384532 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:06.384532 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:06.384532 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:06.384532 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:06.384532 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:06.384532 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:06.384532 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:06.384532 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:06.384532 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:06.384532 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:06.384532 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:32:06.384532 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:32:06.384532 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:32:06.384532 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:32:06.386177 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:32:06.386177 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:32:06.386177 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:32:06.386177 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:32:06.386177 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:06.386177 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:06.386177 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:06.386177 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:06.386177 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:06.386177 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:06.386177 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:06.386177 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:06.386177 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:06.386177 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:06.386177 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:06.386177 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:06.387421 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:06.387421 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:06.387421 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:06.387421 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:06.387421 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:32:06.387421 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:32:06.387421 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:32:06.387421 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:32:06.387421 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:32:06.387421 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:32:06.387421 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 22:32:06.387421 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:32:06.387421 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 173/348] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Aug 29 22:32:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:06.388313 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff180071-4b67-4ddf-a4d7-8ead43d0884a None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:06.477018 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b70cb-adb7-425d-b294-439bdbc6aa80 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:06.498102 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff180071-4b67-4ddf-a4d7-8ead43d0884a None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:06.538919 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7dd273-d45b-4047-b869-db0222331cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:06.539257 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8f4dfa-0826-4e07-962d-dd462d46693b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:06.539781 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7dd273-d45b-4047-b869-db0222331cef None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:06.540093 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f4dfa-0826-4e07-962d-dd462d46693b None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:06.540369 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f4dfa-0826-4e07-962d-dd462d46693b None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:06.540605 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7dd273-d45b-4047-b869-db0222331cef None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:06.540702 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f4dfa-0826-4e07-962d-dd462d46693b None admin] PATH_INFO: `/v3/projects/86b325231ef14af1b9223cffefd8d475` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:06.541262 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7dd273-d45b-4047-b869-db0222331cef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:06.542400 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8f4dfa-0826-4e07-962d-dd462d46693b None admin] RBAC: Authorizing `identity:get_project(project_id=86b325231ef14af1b9223cffefd8d475)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:06.544158 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8f4dfa-0826-4e07-962d-dd462d46693b None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:06.545989 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 174/349] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Aug 29 22:32:06 2022] GET /identity/v3/projects/86b325231ef14af1b9223cffefd8d475 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:06.546897 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8f4dfa-0826-4e07-962d-dd462d46693b None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:06.586335 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:06.652534 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7dd273-d45b-4047-b869-db0222331cef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:06.654907 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7dd273-d45b-4047-b869-db0222331cef None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:06.658480 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8f4dfa-0826-4e07-962d-dd462d46693b None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:06.700502 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b345dd3-5c88-4317-ad3d-d321969ddf7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:06.701495 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b345dd3-5c88-4317-ad3d-d321969ddf7c None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:06.702155 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b345dd3-5c88-4317-ad3d-d321969ddf7c None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:06.703690 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b345dd3-5c88-4317-ad3d-d321969ddf7c None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:06.704553 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b345dd3-5c88-4317-ad3d-d321969ddf7c None admin] RBAC: Adding query filter params (name=reader) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:06.705228 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b345dd3-5c88-4317-ad3d-d321969ddf7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:06.707431 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b345dd3-5c88-4317-ad3d-d321969ddf7c None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:06.722734 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 175/350] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Aug 29 22:32:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:06.726136 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b345dd3-5c88-4317-ad3d-d321969ddf7c None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:06.727244 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:06.840718 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 176/351] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Aug 29 22:32:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:32:06.841939 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7dd273-d45b-4047-b869-db0222331cef None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:06.867084 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:06.873833 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b345dd3-5c88-4317-ad3d-d321969ddf7c None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:06.921938 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a14da6a-fb75-4c5f-9d22-bc838473f092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:06.923404 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14da6a-fb75-4c5f-9d22-bc838473f092 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:06.924349 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14da6a-fb75-4c5f-9d22-bc838473f092 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:06.924349 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14da6a-fb75-4c5f-9d22-bc838473f092 None admin] PATH_INFO: `/v3/groups/8e571cf4cc194744ad7e2ffc83cd65b8` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:06.931776 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a14da6a-fb75-4c5f-9d22-bc838473f092 None admin] RBAC: Authorizing `identity:get_group(group_id=8e571cf4cc194744ad7e2ffc83cd65b8)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:06.934207 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a14da6a-fb75-4c5f-9d22-bc838473f092 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:06.937489 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 176/352] 10.222.0.47 () {56 vars in 1180 bytes} [Mon Aug 29 22:32:06 2022] GET /identity/v3/groups/8e571cf4cc194744ad7e2ffc83cd65b8 => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:06.938346 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a14da6a-fb75-4c5f-9d22-bc838473f092 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:06.968579 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7dd273-d45b-4047-b869-db0222331cef None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:07.016678 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f589f577-2110-45ba-8dc4-a4c40f9643fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:07.017251 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589f577-2110-45ba-8dc4-a4c40f9643fd None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:07.017619 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589f577-2110-45ba-8dc4-a4c40f9643fd None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:07.017898 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589f577-2110-45ba-8dc4-a4c40f9643fd None admin] PATH_INFO: `/v3/users/0435482e96844c88941ef5cddff626ec` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:07.019054 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f589f577-2110-45ba-8dc4-a4c40f9643fd None admin] RBAC: Authorizing `identity:get_user(user_id=0435482e96844c88941ef5cddff626ec)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:07.020505 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f589f577-2110-45ba-8dc4-a4c40f9643fd None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:07.022712 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 177/353] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Aug 29 22:32:06 2022] GET /identity/v3/users/0435482e96844c88941ef5cddff626ec => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:07.022872 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f589f577-2110-45ba-8dc4-a4c40f9643fd None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:07.028656 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:07.083041 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a14da6a-fb75-4c5f-9d22-bc838473f092 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:07.142956 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84883414-0350-4ada-98d6-0bc93dca8155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:07.143743 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84883414-0350-4ada-98d6-0bc93dca8155 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:07.144097 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84883414-0350-4ada-98d6-0bc93dca8155 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:07.144445 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84883414-0350-4ada-98d6-0bc93dca8155 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:07.157238 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84883414-0350-4ada-98d6-0bc93dca8155 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:32:07.163156 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-84883414-0350-4ada-98d6-0bc93dca8155 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:32:07.163156 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:07.163156 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:07.163156 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:07.163156 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:07.163156 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:07.163156 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:07.163156 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:07.163156 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:07.163156 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:07.163156 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:07.163156 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:07.163156 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:32:07.163156 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:32:07.163156 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:32:07.163156 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:32:07.164029 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:32:07.164029 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:32:07.164029 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:32:07.164029 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:32:07.164029 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:07.164029 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:07.164029 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:07.164029 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:07.164029 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:07.164029 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:07.164029 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:07.164029 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:07.164029 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:07.164029 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:07.164029 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:07.164029 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:07.164830 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:07.164830 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:07.164830 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:07.164830 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:07.164830 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:32:07.164830 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:32:07.164830 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:32:07.164830 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:32:07.164830 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:32:07.164830 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:32:07.164830 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:32:07.164830 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:32:07.164830 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 177/354] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Aug 29 22:32:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:07.165490 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1732ea3-1c8c-4e27-b124-ce0bf8295fbf None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:07.169878 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1732ea3-1c8c-4e27-b124-ce0bf8295fbf None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:07.169878 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1732ea3-1c8c-4e27-b124-ce0bf8295fbf None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:07.169878 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 178/355] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:32:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:32:07.174238 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1732ea3-1c8c-4e27-b124-ce0bf8295fbf None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:07.176788 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f589f577-2110-45ba-8dc4-a4c40f9643fd None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:07.207729 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:07.218233 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb1151-e790-49c0-827f-a5b433d7d095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:07.219209 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb1151-e790-49c0-827f-a5b433d7d095 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:07.219641 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb1151-e790-49c0-827f-a5b433d7d095 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:07.221464 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb1151-e790-49c0-827f-a5b433d7d095 None admin] PATH_INFO: `/v3/projects/86b325231ef14af1b9223cffefd8d475` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:07.222761 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfb1151-e790-49c0-827f-a5b433d7d095 None admin] RBAC: Authorizing `identity:get_project(project_id=86b325231ef14af1b9223cffefd8d475)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:07.224302 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfb1151-e790-49c0-827f-a5b433d7d095 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:07.226277 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 178/356] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Aug 29 22:32:07 2022] GET /identity/v3/projects/86b325231ef14af1b9223cffefd8d475 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:07.226842 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb1151-e790-49c0-827f-a5b433d7d095 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:07.303677 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1732ea3-1c8c-4e27-b124-ce0bf8295fbf None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:07.342856 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:07.376065 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d67e42-56f3-4bc9-9913-d3b09850a6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:07.377206 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d67e42-56f3-4bc9-9913-d3b09850a6e0 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:07.377692 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d67e42-56f3-4bc9-9913-d3b09850a6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:07.378347 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d67e42-56f3-4bc9-9913-d3b09850a6e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:07.379100 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d67e42-56f3-4bc9-9913-d3b09850a6e0 None admin] RBAC: Adding query filter params (group.id=8e571cf4cc194744ad7e2ffc83cd65b8, role.id=0c67797d444d4c929b2ccab47c468848, scope.project.id=86b325231ef14af1b9223cffefd8d475) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:07.379416 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d67e42-56f3-4bc9-9913-d3b09850a6e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:07.380881 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d67e42-56f3-4bc9-9913-d3b09850a6e0 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:07.391367 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb1151-e790-49c0-827f-a5b433d7d095 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:07.394562 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 179/357] 10.222.0.47 () {56 vars in 1376 bytes} [Mon Aug 29 22:32:07 2022] GET /identity/v3/role_assignments?group.id=8e571cf4cc194744ad7e2ffc83cd65b8&scope.project.id=86b325231ef14af1b9223cffefd8d475&role.id=0c67797d444d4c929b2ccab47c468848 => generated 260 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:07.396088 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc7a8c-0577-409d-ba51-62ce46b360bf None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:07.396382 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc7a8c-0577-409d-ba51-62ce46b360bf None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:07.396657 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc7a8c-0577-409d-ba51-62ce46b360bf None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:07.403635 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 180/358] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:32:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:32:07.403635 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc7a8c-0577-409d-ba51-62ce46b360bf None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:07.472286 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604c510c-d2b1-47dc-9b2d-c85ded0e9b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:07.472915 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c510c-d2b1-47dc-9b2d-c85ded0e9b9b None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:07.473221 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c510c-d2b1-47dc-9b2d-c85ded0e9b9b None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:07.473499 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c510c-d2b1-47dc-9b2d-c85ded0e9b9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:07.474363 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604c510c-d2b1-47dc-9b2d-c85ded0e9b9b None admin] RBAC: Adding query filter params (role.id=20d05bce224344d7b13c43a2e9de7abd, user.id=0435482e96844c88941ef5cddff626ec, scope.system=all) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:07.474659 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604c510c-d2b1-47dc-9b2d-c85ded0e9b9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:07.476144 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604c510c-d2b1-47dc-9b2d-c85ded0e9b9b None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:07.494726 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 179/359] 10.222.0.47 () {56 vars in 1308 bytes} [Mon Aug 29 22:32:07 2022] GET /identity/v3/role_assignments?user.id=0435482e96844c88941ef5cddff626ec&scope.system=all&role.id=20d05bce224344d7b13c43a2e9de7abd => generated 510 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:07.496112 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756d9f1-a919-4770-9d15-e5ac7db4307f None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:07.496398 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756d9f1-a919-4770-9d15-e5ac7db4307f None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:07.496683 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756d9f1-a919-4770-9d15-e5ac7db4307f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:07.523813 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-2756d9f1-a919-4770-9d15-e5ac7db4307f None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:32:07.525232 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-2756d9f1-a919-4770-9d15-e5ac7db4307f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:07.550275 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:07.574557 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc7a8c-0577-409d-ba51-62ce46b360bf None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:07.624494 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe69364-6bc4-4058-bec8-6dd8243deee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:07.625308 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe69364-6bc4-4058-bec8-6dd8243deee1 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:07.625756 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe69364-6bc4-4058-bec8-6dd8243deee1 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:07.625868 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 180/360] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:32:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:32:07.626167 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe69364-6bc4-4058-bec8-6dd8243deee1 None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:07.626958 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe69364-6bc4-4058-bec8-6dd8243deee1 None admin] RBAC: Adding query filter params (name=member) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:07.627093 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2756d9f1-a919-4770-9d15-e5ac7db4307f None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:07.627441 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe69364-6bc4-4058-bec8-6dd8243deee1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:07.628931 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe69364-6bc4-4058-bec8-6dd8243deee1 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:07.642908 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 181/361] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Aug 29 22:32:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:07.644190 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c2add-85fc-485e-a6c1-d41290c03edb None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:07.644474 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c2add-85fc-485e-a6c1-d41290c03edb None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:07.644744 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c2add-85fc-485e-a6c1-d41290c03edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:07.676945 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-061c2add-85fc-485e-a6c1-d41290c03edb None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:32:07.678226 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-061c2add-85fc-485e-a6c1-d41290c03edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:07.729617 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:07.780188 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 182/362] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:32:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:32:07.780854 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c2add-85fc-485e-a6c1-d41290c03edb None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:07.804559 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2756d9f1-a919-4770-9d15-e5ac7db4307f None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:07.878270 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9a9069-e816-4b7a-93d8-29b63002bf95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:07.879164 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a9069-e816-4b7a-93d8-29b63002bf95 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:07.879511 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a9069-e816-4b7a-93d8-29b63002bf95 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:07.879791 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a9069-e816-4b7a-93d8-29b63002bf95 None admin] PATH_INFO: `/v3/groups/8e571cf4cc194744ad7e2ffc83cd65b8` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:07.882461 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9a9069-e816-4b7a-93d8-29b63002bf95 None admin] RBAC: Authorizing `identity:get_group(group_id=8e571cf4cc194744ad7e2ffc83cd65b8)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:07.885942 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9a9069-e816-4b7a-93d8-29b63002bf95 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:07.887196 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 181/363] 10.222.0.47 () {56 vars in 1180 bytes} [Mon Aug 29 22:32:07 2022] GET /identity/v3/groups/8e571cf4cc194744ad7e2ffc83cd65b8 => generated 226 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:07.893099 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9a9069-e816-4b7a-93d8-29b63002bf95 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:07.931486 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:07.988429 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c2add-85fc-485e-a6c1-d41290c03edb None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:08.055661 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48043e30-9abe-4cec-9ae8-e8ffb2028f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:08.056297 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48043e30-9abe-4cec-9ae8-e8ffb2028f19 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:08.056577 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48043e30-9abe-4cec-9ae8-e8ffb2028f19 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:08.057310 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48043e30-9abe-4cec-9ae8-e8ffb2028f19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:08.130374 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9a9069-e816-4b7a-93d8-29b63002bf95 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:08.168101 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:08.174296 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48043e30-9abe-4cec-9ae8-e8ffb2028f19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:08.175801 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48043e30-9abe-4cec-9ae8-e8ffb2028f19 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:08.191999 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d6c3cb-e526-49a6-8c9e-f473c0bec7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:08.192428 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d6c3cb-e526-49a6-8c9e-f473c0bec7d7 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:08.192711 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d6c3cb-e526-49a6-8c9e-f473c0bec7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:08.192991 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d6c3cb-e526-49a6-8c9e-f473c0bec7d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:08.195288 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d6c3cb-e526-49a6-8c9e-f473c0bec7d7 None admin] RBAC: Adding query filter params (group.id=8e571cf4cc194744ad7e2ffc83cd65b8, role.id=066c4a2915d247089e9df06936eb9a97, scope.project.id=86b325231ef14af1b9223cffefd8d475) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:08.195288 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d6c3cb-e526-49a6-8c9e-f473c0bec7d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:08.195484 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d6c3cb-e526-49a6-8c9e-f473c0bec7d7 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:08.212270 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 182/364] 10.222.0.47 () {56 vars in 1376 bytes} [Mon Aug 29 22:32:07 2022] GET /identity/v3/role_assignments?group.id=8e571cf4cc194744ad7e2ffc83cd65b8&scope.project.id=86b325231ef14af1b9223cffefd8d475&role.id=066c4a2915d247089e9df06936eb9a97 => generated 260 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:08.216071 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d6c3cb-e526-49a6-8c9e-f473c0bec7d7 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:08.299033 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:08.328877 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 183/365] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Aug 29 22:32:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:32:08.329600 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48043e30-9abe-4cec-9ae8-e8ffb2028f19 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:08.353674 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d6c3cb-e526-49a6-8c9e-f473c0bec7d7 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:08.409500 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d925f8dd-7701-481f-8dc1-7d801d59ce53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:08.410509 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d925f8dd-7701-481f-8dc1-7d801d59ce53 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:08.410989 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d925f8dd-7701-481f-8dc1-7d801d59ce53 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:08.411459 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d925f8dd-7701-481f-8dc1-7d801d59ce53 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:08.427295 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d925f8dd-7701-481f-8dc1-7d801d59ce53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:32:08.434168 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-d925f8dd-7701-481f-8dc1-7d801d59ce53 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:32:08.434168 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:08.434168 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:08.434168 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:08.434168 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:08.434168 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:08.434168 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:08.434168 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:08.434168 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:08.434168 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:08.434168 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:08.434168 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:08.434168 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:32:08.434168 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:32:08.434168 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:32:08.434168 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:32:08.435090 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:32:08.435090 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:32:08.435090 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:32:08.435090 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:32:08.435090 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:08.435090 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:08.435090 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:08.435090 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:08.435090 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:08.435090 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:08.435090 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:08.435090 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:08.435090 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:08.435090 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:08.435090 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:08.435090 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:08.435878 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:08.435878 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:08.435878 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:08.435878 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:08.435878 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:32:08.435878 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:32:08.435878 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:32:08.435878 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:32:08.435878 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:32:08.435878 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:32:08.435878 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:32:08.435878 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:32:08.437699 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 183/366] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Aug 29 22:32:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:08.437802 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d925f8dd-7701-481f-8dc1-7d801d59ce53 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:08.453535 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48043e30-9abe-4cec-9ae8-e8ffb2028f19 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:08.499308 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844a8eb6-267b-468b-a44b-dda3ea5b84ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:08.503242 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a8eb6-267b-468b-a44b-dda3ea5b84ce None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:08.503527 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a8eb6-267b-468b-a44b-dda3ea5b84ce None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:08.503887 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a8eb6-267b-468b-a44b-dda3ea5b84ce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:08.526910 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844a8eb6-267b-468b-a44b-dda3ea5b84ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:32:08.534090 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-844a8eb6-267b-468b-a44b-dda3ea5b84ce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:32:08.534090 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:08.534090 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:08.534090 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:08.534090 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:08.534090 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:08.534090 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:08.534090 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:08.534090 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:08.534090 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:08.534090 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:08.534090 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:08.534090 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:32:08.534090 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:32:08.534090 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:32:08.534090 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:32:08.535051 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:32:08.535051 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:32:08.535051 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:32:08.535051 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:32:08.535051 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:08.535051 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:08.535051 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:08.535051 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:08.535051 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:08.535051 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:08.535051 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:08.535051 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:08.535051 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:08.535051 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:08.535051 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:08.535051 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:08.535851 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:08.535851 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:08.535851 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:08.535851 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:08.535851 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:32:08.535851 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:32:08.535851 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:32:08.535851 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:32:08.535851 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:32:08.535851 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:32:08.535851 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:32:08.535851 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:32:08.535851 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 184/367] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Aug 29 22:32:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:08.536505 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:08.537100 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844a8eb6-267b-468b-a44b-dda3ea5b84ce None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:08.591721 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d925f8dd-7701-481f-8dc1-7d801d59ce53 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:08.621572 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:08.645035 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd43e99-df6e-438f-a483-87f906c14d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:08.647026 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd43e99-df6e-438f-a483-87f906c14d9d None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:08.647526 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd43e99-df6e-438f-a483-87f906c14d9d None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:08.648002 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd43e99-df6e-438f-a483-87f906c14d9d None admin] PATH_INFO: `/v3/projects/2d92e217cd6146f7910ea8e021e81cb4` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:08.650804 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd43e99-df6e-438f-a483-87f906c14d9d None admin] RBAC: Authorizing `identity:get_project(project_id=2d92e217cd6146f7910ea8e021e81cb4)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:08.652616 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd43e99-df6e-438f-a483-87f906c14d9d None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:08.655134 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 184/368] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Aug 29 22:32:08 2022] GET /identity/v3/projects/2d92e217cd6146f7910ea8e021e81cb4 => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:08.656224 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd43e99-df6e-438f-a483-87f906c14d9d None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:08.744397 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844a8eb6-267b-468b-a44b-dda3ea5b84ce None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:08.795408 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd43e99-df6e-438f-a483-87f906c14d9d None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:08.798107 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61bbab4-290a-427f-b711-b60fcb744ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:08.798908 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61bbab4-290a-427f-b711-b60fcb744ed3 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:08.799187 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61bbab4-290a-427f-b711-b60fcb744ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:08.799459 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61bbab4-290a-427f-b711-b60fcb744ed3 None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:08.800133 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61bbab4-290a-427f-b711-b60fcb744ed3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:08.800432 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61bbab4-290a-427f-b711-b60fcb744ed3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:08.801865 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61bbab4-290a-427f-b711-b60fcb744ed3 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:08.815996 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 185/369] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Aug 29 22:32:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:08.816174 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61bbab4-290a-427f-b711-b60fcb744ed3 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:08.843892 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:08.858194 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd1bf20-93ac-421b-b6ae-2ceed348064f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:08.858816 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1bf20-93ac-421b-b6ae-2ceed348064f None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:08.859154 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1bf20-93ac-421b-b6ae-2ceed348064f None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:08.859429 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1bf20-93ac-421b-b6ae-2ceed348064f None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:08.860155 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd1bf20-93ac-421b-b6ae-2ceed348064f None admin] RBAC: Adding query filter params (name=admin) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:08.860469 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd1bf20-93ac-421b-b6ae-2ceed348064f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:08.863459 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd1bf20-93ac-421b-b6ae-2ceed348064f None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:08.881111 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 185/370] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Aug 29 22:32:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:08.884411 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd1bf20-93ac-421b-b6ae-2ceed348064f None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:08.965752 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:08.969450 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61bbab4-290a-427f-b711-b60fcb744ed3 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:09.053436 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995dc05d-305c-48cc-9cac-a7f5c018df44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:09.053436 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995dc05d-305c-48cc-9cac-a7f5c018df44 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:09.053436 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995dc05d-305c-48cc-9cac-a7f5c018df44 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:09.053436 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995dc05d-305c-48cc-9cac-a7f5c018df44 None admin] PATH_INFO: `/v3/groups/8e571cf4cc194744ad7e2ffc83cd65b8` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:09.053867 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995dc05d-305c-48cc-9cac-a7f5c018df44 None admin] RBAC: Authorizing `identity:get_group(group_id=8e571cf4cc194744ad7e2ffc83cd65b8)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:09.054307 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995dc05d-305c-48cc-9cac-a7f5c018df44 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:09.060613 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 186/371] 10.222.0.47 () {56 vars in 1180 bytes} [Mon Aug 29 22:32:08 2022] GET /identity/v3/groups/8e571cf4cc194744ad7e2ffc83cd65b8 => generated 226 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:09.060613 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995dc05d-305c-48cc-9cac-a7f5c018df44 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:09.101356 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd1bf20-93ac-421b-b6ae-2ceed348064f None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:09.164960 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d73b4b-fa1c-4ae6-82a8-52909931bf63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:09.165912 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d73b4b-fa1c-4ae6-82a8-52909931bf63 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:09.166267 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d73b4b-fa1c-4ae6-82a8-52909931bf63 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:09.166827 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d73b4b-fa1c-4ae6-82a8-52909931bf63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:09.245477 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995dc05d-305c-48cc-9cac-a7f5c018df44 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:09.248932 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:09.273474 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d73b4b-fa1c-4ae6-82a8-52909931bf63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:09.273838 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d73b4b-fa1c-4ae6-82a8-52909931bf63 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:09.332497 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b19919-7006-4249-b932-c00b98bc56fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:09.334394 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b19919-7006-4249-b932-c00b98bc56fa None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:09.335651 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b19919-7006-4249-b932-c00b98bc56fa None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:09.336143 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b19919-7006-4249-b932-c00b98bc56fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:09.426862 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:09.430858 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 186/372] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Aug 29 22:32:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:32:09.432045 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d73b4b-fa1c-4ae6-82a8-52909931bf63 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:09.498503 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b19919-7006-4249-b932-c00b98bc56fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:09.500002 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b19919-7006-4249-b932-c00b98bc56fa None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:09.555634 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:09.567114 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d73b4b-fa1c-4ae6-82a8-52909931bf63 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:09.626508 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ccef0f-9c3b-4d47-a32e-5877484c9982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:09.627178 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ccef0f-9c3b-4d47-a32e-5877484c9982 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:09.627397 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ccef0f-9c3b-4d47-a32e-5877484c9982 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:09.627663 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ccef0f-9c3b-4d47-a32e-5877484c9982 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:09.628402 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ccef0f-9c3b-4d47-a32e-5877484c9982 None admin] RBAC: Adding query filter params (group.id=8e571cf4cc194744ad7e2ffc83cd65b8, role.id=0c67797d444d4c929b2ccab47c468848, scope.project.id=2d92e217cd6146f7910ea8e021e81cb4) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:09.628706 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ccef0f-9c3b-4d47-a32e-5877484c9982 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:09.630181 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ccef0f-9c3b-4d47-a32e-5877484c9982 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:09.637389 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 187/373] 10.222.0.47 () {56 vars in 1376 bytes} [Mon Aug 29 22:32:09 2022] GET /identity/v3/role_assignments?group.id=8e571cf4cc194744ad7e2ffc83cd65b8&scope.project.id=2d92e217cd6146f7910ea8e021e81cb4&role.id=0c67797d444d4c929b2ccab47c468848 => generated 260 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:09.642455 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ccef0f-9c3b-4d47-a32e-5877484c9982 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:09.725444 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 187/374] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Aug 29 22:32:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 669 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:32:09.739155 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b19919-7006-4249-b932-c00b98bc56fa None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:09.809388 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ccef0f-9c3b-4d47-a32e-5877484c9982 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:09.851749 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1717bd8-6c96-4c08-9c54-48c5a46cd509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:09.852337 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1717bd8-6c96-4c08-9c54-48c5a46cd509 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:09.852614 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1717bd8-6c96-4c08-9c54-48c5a46cd509 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:09.852882 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1717bd8-6c96-4c08-9c54-48c5a46cd509 None admin] PATH_INFO: `/v3/projects/2d92e217cd6146f7910ea8e021e81cb4` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:09.854196 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1717bd8-6c96-4c08-9c54-48c5a46cd509 None admin] RBAC: Authorizing `identity:get_project(project_id=2d92e217cd6146f7910ea8e021e81cb4)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:09.855671 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1717bd8-6c96-4c08-9c54-48c5a46cd509 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:09.860908 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 188/375] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Aug 29 22:32:09 2022] GET /identity/v3/projects/2d92e217cd6146f7910ea8e021e81cb4 => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:09.870912 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1717bd8-6c96-4c08-9c54-48c5a46cd509 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:09.897766 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:10.003985 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:10.007798 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1717bd8-6c96-4c08-9c54-48c5a46cd509 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:10.050660 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d8e4f7-86de-4300-8004-295314c880bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:10.051598 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8e4f7-86de-4300-8004-295314c880bc None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:10.052056 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8e4f7-86de-4300-8004-295314c880bc None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:10.052492 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8e4f7-86de-4300-8004-295314c880bc None admin] PATH_INFO: `/v3/groups/8e571cf4cc194744ad7e2ffc83cd65b8` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:10.053895 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d8e4f7-86de-4300-8004-295314c880bc None admin] RBAC: Authorizing `identity:get_group(group_id=8e571cf4cc194744ad7e2ffc83cd65b8)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:10.055520 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d8e4f7-86de-4300-8004-295314c880bc None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:10.058140 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 189/376] 10.222.0.47 () {56 vars in 1180 bytes} [Mon Aug 29 22:32:09 2022] GET /identity/v3/groups/8e571cf4cc194744ad7e2ffc83cd65b8 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:10.065846 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d8e4f7-86de-4300-8004-295314c880bc None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:10.096146 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b19919-7006-4249-b932-c00b98bc56fa None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:10.168990 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189e5a32-d978-475d-b121-f50da65105dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:10.169959 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e5a32-d978-475d-b121-f50da65105dc None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:10.170411 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e5a32-d978-475d-b121-f50da65105dc None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:10.170977 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e5a32-d978-475d-b121-f50da65105dc None admin] PATH_INFO: `/v3/projects/8ad4679521624f7c95e5cca6de7bc365` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:10.172328 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189e5a32-d978-475d-b121-f50da65105dc None admin] RBAC: Authorizing `identity:get_project(project_id=8ad4679521624f7c95e5cca6de7bc365)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:10.179230 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189e5a32-d978-475d-b121-f50da65105dc None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:10.183554 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 188/377] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Aug 29 22:32:09 2022] GET /identity/v3/projects/8ad4679521624f7c95e5cca6de7bc365 => generated 344 bytes in 444 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:10.190215 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189e5a32-d978-475d-b121-f50da65105dc None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:10.260937 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:10.286300 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d8e4f7-86de-4300-8004-295314c880bc None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:10.382089 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c130915-4d14-47d0-b1ca-5dfcafad195f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:10.382737 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c130915-4d14-47d0-b1ca-5dfcafad195f None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:10.383002 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c130915-4d14-47d0-b1ca-5dfcafad195f None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:10.383288 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c130915-4d14-47d0-b1ca-5dfcafad195f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:10.384044 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c130915-4d14-47d0-b1ca-5dfcafad195f None admin] RBAC: Adding query filter params (group.id=8e571cf4cc194744ad7e2ffc83cd65b8, role.id=066c4a2915d247089e9df06936eb9a97, scope.project.id=2d92e217cd6146f7910ea8e021e81cb4) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:10.384352 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c130915-4d14-47d0-b1ca-5dfcafad195f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:10.387042 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c130915-4d14-47d0-b1ca-5dfcafad195f None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:10.395514 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 190/378] 10.222.0.47 () {56 vars in 1376 bytes} [Mon Aug 29 22:32:10 2022] GET /identity/v3/role_assignments?group.id=8e571cf4cc194744ad7e2ffc83cd65b8&scope.project.id=2d92e217cd6146f7910ea8e021e81cb4&role.id=066c4a2915d247089e9df06936eb9a97 => generated 260 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:10.396624 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64465b3-7bf5-4bad-aaeb-412aac9e425b None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:10.396892 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64465b3-7bf5-4bad-aaeb-412aac9e425b None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:10.397182 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64465b3-7bf5-4bad-aaeb-412aac9e425b None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:10.403588 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 191/379] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:32:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:32:10.411206 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95bbbc7-a200-44d5-86a8-d5b586a4244e None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:10.411522 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95bbbc7-a200-44d5-86a8-d5b586a4244e None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:10.411747 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95bbbc7-a200-44d5-86a8-d5b586a4244e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:10.421723 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189e5a32-d978-475d-b121-f50da65105dc None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:10.466638 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-c95bbbc7-a200-44d5-86a8-d5b586a4244e None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:32:10.467871 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-c95bbbc7-a200-44d5-86a8-d5b586a4244e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:10.478162 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd798952-183b-458c-94e1-d37a5cf422b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:10.479879 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd798952-183b-458c-94e1-d37a5cf422b8 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:10.480359 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd798952-183b-458c-94e1-d37a5cf422b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:10.480826 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd798952-183b-458c-94e1-d37a5cf422b8 None admin] PATH_INFO: `/v3/groups/526ae832c9c04ba48b6abd9363b1fa60` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:10.492168 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:10.498168 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd798952-183b-458c-94e1-d37a5cf422b8 None admin] RBAC: Authorizing `identity:get_group(group_id=526ae832c9c04ba48b6abd9363b1fa60)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:10.500098 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd798952-183b-458c-94e1-d37a5cf422b8 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:10.507259 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 189/380] 10.222.0.47 () {56 vars in 1180 bytes} [Mon Aug 29 22:32:10 2022] GET /identity/v3/groups/526ae832c9c04ba48b6abd9363b1fa60 => generated 229 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:10.509100 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd798952-183b-458c-94e1-d37a5cf422b8 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:10.571784 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 192/381] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:32:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:32:10.709758 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd798952-183b-458c-94e1-d37a5cf422b8 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:10.753393 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a690e27-734c-4d7c-9250-4094c9127a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:10.755007 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a690e27-734c-4d7c-9250-4094c9127a33 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:10.755007 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a690e27-734c-4d7c-9250-4094c9127a33 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:10.755007 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a690e27-734c-4d7c-9250-4094c9127a33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:10.755223 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a690e27-734c-4d7c-9250-4094c9127a33 None admin] RBAC: Adding query filter params (group.id=526ae832c9c04ba48b6abd9363b1fa60, role.id=d00eabaec96a4956aaec2c37a5819c25, scope.project.id=8ad4679521624f7c95e5cca6de7bc365) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:10.758219 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a690e27-734c-4d7c-9250-4094c9127a33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:10.758219 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a690e27-734c-4d7c-9250-4094c9127a33 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:10.769481 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 190/382] 10.222.0.47 () {56 vars in 1376 bytes} [Mon Aug 29 22:32:10 2022] GET /identity/v3/role_assignments?group.id=526ae832c9c04ba48b6abd9363b1fa60&scope.project.id=8ad4679521624f7c95e5cca6de7bc365&role.id=d00eabaec96a4956aaec2c37a5819c25 => generated 260 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:10.799938 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9710215e-8b0b-4514-b964-50a5fee2ca5a None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:10.800745 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9710215e-8b0b-4514-b964-50a5fee2ca5a None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:10.801249 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9710215e-8b0b-4514-b964-50a5fee2ca5a None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:10.806421 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 193/383] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:32:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:32:10.814239 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5993f54e-7625-4470-9087-36a2179cef9c None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:10.814515 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5993f54e-7625-4470-9087-36a2179cef9c None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:10.814789 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5993f54e-7625-4470-9087-36a2179cef9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:10.849997 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-5993f54e-7625-4470-9087-36a2179cef9c None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:32:10.852431 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-5993f54e-7625-4470-9087-36a2179cef9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:10.931446 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:10.943566 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 191/384] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:32:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:32:10.992113 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9710215e-8b0b-4514-b964-50a5fee2ca5a None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:11.106113 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:11.125113 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9710215e-8b0b-4514-b964-50a5fee2ca5a None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:11.168223 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09734ddc-00ab-4ca2-8f93-564fb73a593d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:11.168974 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09734ddc-00ab-4ca2-8f93-564fb73a593d None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:11.169247 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09734ddc-00ab-4ca2-8f93-564fb73a593d None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:11.169538 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09734ddc-00ab-4ca2-8f93-564fb73a593d None admin] PATH_INFO: `/v3/roles/member` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:11.181569 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09734ddc-00ab-4ca2-8f93-564fb73a593d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:32:11.186812 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-09734ddc-00ab-4ca2-8f93-564fb73a593d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:32:11.186812 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:11.186812 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:11.186812 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:11.186812 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:11.186812 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:11.186812 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:11.186812 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:11.186812 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:11.186812 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:11.186812 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:11.186812 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:11.186812 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:32:11.186812 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:32:11.186812 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:32:11.186812 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:32:11.187702 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:32:11.187702 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:32:11.187702 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:32:11.187702 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:32:11.187702 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:11.187702 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:11.187702 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:11.187702 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:11.187702 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:11.187702 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:11.187702 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:11.187702 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:11.187702 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:11.187702 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:11.187702 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:11.187702 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:11.188480 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:11.188480 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:11.188480 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:11.188480 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:11.188480 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:32:11.188480 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:32:11.188480 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:32:11.188480 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:32:11.188480 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:32:11.188480 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:32:11.188480 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:32:11.188480 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:32:11.188480 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 194/385] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Aug 29 22:32:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:11.194626 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5993f54e-7625-4470-9087-36a2179cef9c None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:11.312202 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5993f54e-7625-4470-9087-36a2179cef9c None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:11.347625 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae05c3df-12f2-4f7e-ad14-1d2068a07e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:11.348248 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05c3df-12f2-4f7e-ad14-1d2068a07e47 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:11.348523 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05c3df-12f2-4f7e-ad14-1d2068a07e47 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:11.348812 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05c3df-12f2-4f7e-ad14-1d2068a07e47 None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:11.349481 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae05c3df-12f2-4f7e-ad14-1d2068a07e47 None admin] RBAC: Adding query filter params (name=member) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:11.349781 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae05c3df-12f2-4f7e-ad14-1d2068a07e47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:11.351157 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae05c3df-12f2-4f7e-ad14-1d2068a07e47 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:11.361286 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 192/386] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Aug 29 22:32:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:11.366805 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09734ddc-00ab-4ca2-8f93-564fb73a593d None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:11.373708 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae05c3df-12f2-4f7e-ad14-1d2068a07e47 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:11.504386 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:11.569372 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09734ddc-00ab-4ca2-8f93-564fb73a593d None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:11.620246 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae05c3df-12f2-4f7e-ad14-1d2068a07e47 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:11.653612 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d273f2e4-aa87-47ab-8fe9-7c8bcc775244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:11.654635 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273f2e4-aa87-47ab-8fe9-7c8bcc775244 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:11.655140 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273f2e4-aa87-47ab-8fe9-7c8bcc775244 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:11.655617 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273f2e4-aa87-47ab-8fe9-7c8bcc775244 None admin] PATH_INFO: `/v3/groups/8e571cf4cc194744ad7e2ffc83cd65b8` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:11.658378 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d273f2e4-aa87-47ab-8fe9-7c8bcc775244 None admin] RBAC: Authorizing `identity:get_group(group_id=8e571cf4cc194744ad7e2ffc83cd65b8)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:11.660106 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d273f2e4-aa87-47ab-8fe9-7c8bcc775244 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:11.665530 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 195/387] 10.222.0.47 () {56 vars in 1180 bytes} [Mon Aug 29 22:32:11 2022] GET /identity/v3/groups/8e571cf4cc194744ad7e2ffc83cd65b8 => generated 226 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:11.671757 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d273f2e4-aa87-47ab-8fe9-7c8bcc775244 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:11.676515 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:11.701155 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9900d621-1cd1-4ecb-9101-649b539def62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:11.702223 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900d621-1cd1-4ecb-9101-649b539def62 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:11.702710 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900d621-1cd1-4ecb-9101-649b539def62 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:11.703385 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900d621-1cd1-4ecb-9101-649b539def62 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:11.729665 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9900d621-1cd1-4ecb-9101-649b539def62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:32:11.743440 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-9900d621-1cd1-4ecb-9101-649b539def62 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:32:11.743440 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:11.743440 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:11.743440 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:11.743440 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:11.743440 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:11.743440 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:11.743440 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:11.743440 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:11.743440 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:11.743440 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:11.743440 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:11.743440 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:32:11.743440 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:32:11.743440 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:32:11.743440 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:32:11.745047 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:32:11.745047 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:32:11.745047 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:32:11.745047 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:32:11.745047 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:11.745047 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:11.745047 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:11.745047 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:11.745047 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:11.745047 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:11.745047 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:11.745047 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:11.745047 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:11.745047 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:11.745047 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:11.745047 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:11.745915 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:11.745915 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:11.745915 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:11.745915 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:11.745915 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:32:11.745915 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:32:11.745915 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:32:11.745915 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:32:11.745915 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:32:11.745915 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:32:11.745915 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:32:11.745915 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:32:11.749747 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 193/388] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Aug 29 22:32:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:32:11.755173 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9900d621-1cd1-4ecb-9101-649b539def62 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:11.846844 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d273f2e4-aa87-47ab-8fe9-7c8bcc775244 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:11.893356 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2323cddd-a9cf-4a9a-995c-f2760ab770a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:11.896274 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323cddd-a9cf-4a9a-995c-f2760ab770a2 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:11.896274 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323cddd-a9cf-4a9a-995c-f2760ab770a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:11.896274 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323cddd-a9cf-4a9a-995c-f2760ab770a2 None admin] PATH_INFO: `/v3/projects/86b325231ef14af1b9223cffefd8d475` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:11.897366 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2323cddd-a9cf-4a9a-995c-f2760ab770a2 None admin] RBAC: Authorizing `identity:get_project(project_id=86b325231ef14af1b9223cffefd8d475)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:11.904059 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2323cddd-a9cf-4a9a-995c-f2760ab770a2 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:11.904059 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 196/389] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Aug 29 22:32:11 2022] GET /identity/v3/projects/86b325231ef14af1b9223cffefd8d475 => generated 298 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:11.909649 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2323cddd-a9cf-4a9a-995c-f2760ab770a2 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:12.021209 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9900d621-1cd1-4ecb-9101-649b539def62 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:12.054911 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:12.082106 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:12.098215 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac08b465-3864-46f0-8631-5898c5706a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:12.098695 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac08b465-3864-46f0-8631-5898c5706a2f None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:12.098971 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac08b465-3864-46f0-8631-5898c5706a2f None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:12.099240 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac08b465-3864-46f0-8631-5898c5706a2f None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:12.099910 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac08b465-3864-46f0-8631-5898c5706a2f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:12.100211 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac08b465-3864-46f0-8631-5898c5706a2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:12.101602 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac08b465-3864-46f0-8631-5898c5706a2f None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:12.125350 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 194/390] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Aug 29 22:32:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:12.132177 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac08b465-3864-46f0-8631-5898c5706a2f None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:12.157361 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2323cddd-a9cf-4a9a-995c-f2760ab770a2 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:12.278740 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1daeea5-4394-44ae-8384-72134f529480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:12.279435 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1daeea5-4394-44ae-8384-72134f529480 None admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:12.279742 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1daeea5-4394-44ae-8384-72134f529480 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:12.279980 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1daeea5-4394-44ae-8384-72134f529480 None admin] PATH_INFO: `/v3/projects/86b325231ef14af1b9223cffefd8d475/groups/8e571cf4cc194744ad7e2ffc83cd65b8/roles/0c67797d444d4c929b2ccab47c468848` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:12.282389 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1daeea5-4394-44ae-8384-72134f529480 None admin] RBAC: Authorizing `identity:create_grant(project_id=86b325231ef14af1b9223cffefd8d475, group_id=8e571cf4cc194744ad7e2ffc83cd65b8, role_id=0c67797d444d4c929b2ccab47c468848)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:12.283750 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1daeea5-4394-44ae-8384-72134f529480 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:12.295318 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac08b465-3864-46f0-8631-5898c5706a2f None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:12.333600 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 197/391] 10.222.0.47 () {58 vars in 1442 bytes} [Mon Aug 29 22:32:11 2022] PUT /identity/v3/projects/86b325231ef14af1b9223cffefd8d475/groups/8e571cf4cc194744ad7e2ffc83cd65b8/roles/0c67797d444d4c929b2ccab47c468848 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:32:12.337394 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2475137e-648c-446d-92a5-a5a346bb60ef None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:12.337394 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2475137e-648c-446d-92a5-a5a346bb60ef None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:12.337394 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2475137e-648c-446d-92a5-a5a346bb60ef None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:12.337394 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 198/392] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:32:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:32:12.348027 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513d28f-d760-4032-990d-e51f71580a85 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:12.348402 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513d28f-d760-4032-990d-e51f71580a85 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:12.348584 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513d28f-d760-4032-990d-e51f71580a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:12.355459 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3433dae-be2f-4581-a1c1-d738dc491ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:12.361359 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3433dae-be2f-4581-a1c1-d738dc491ccb None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:12.361359 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3433dae-be2f-4581-a1c1-d738dc491ccb None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:12.361359 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3433dae-be2f-4581-a1c1-d738dc491ccb None admin] PATH_INFO: `/v3/groups/8e571cf4cc194744ad7e2ffc83cd65b8` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:12.365622 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3433dae-be2f-4581-a1c1-d738dc491ccb None admin] RBAC: Authorizing `identity:get_group(group_id=8e571cf4cc194744ad7e2ffc83cd65b8)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:12.367188 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3433dae-be2f-4581-a1c1-d738dc491ccb None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:12.370030 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 195/393] 10.222.0.47 () {56 vars in 1180 bytes} [Mon Aug 29 22:32:12 2022] GET /identity/v3/groups/8e571cf4cc194744ad7e2ffc83cd65b8 => generated 226 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:12.377066 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3433dae-be2f-4581-a1c1-d738dc491ccb None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:12.413539 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-4513d28f-d760-4032-990d-e51f71580a85 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:32:12.414754 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-4513d28f-d760-4032-990d-e51f71580a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:12.445500 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:12.531182 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3433dae-be2f-4581-a1c1-d738dc491ccb None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:12.593366 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1218579b-b9b2-44ab-8c6d-a07e4a8fdba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:12.593366 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1218579b-b9b2-44ab-8c6d-a07e4a8fdba0 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:12.593366 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1218579b-b9b2-44ab-8c6d-a07e4a8fdba0 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:12.593366 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1218579b-b9b2-44ab-8c6d-a07e4a8fdba0 None admin] PATH_INFO: `/v3/projects/86b325231ef14af1b9223cffefd8d475` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:12.597359 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1218579b-b9b2-44ab-8c6d-a07e4a8fdba0 None admin] RBAC: Authorizing `identity:get_project(project_id=86b325231ef14af1b9223cffefd8d475)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:12.599379 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1218579b-b9b2-44ab-8c6d-a07e4a8fdba0 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:12.605382 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 196/394] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Aug 29 22:32:12 2022] GET /identity/v3/projects/86b325231ef14af1b9223cffefd8d475 => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:12.607320 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1218579b-b9b2-44ab-8c6d-a07e4a8fdba0 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:12.621109 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 199/395] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:32:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:32:12.753788 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1218579b-b9b2-44ab-8c6d-a07e4a8fdba0 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:12.793756 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:12.813131 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f665eb-7531-4a4c-a0d8-cbcac271bfde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:12.813846 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f665eb-7531-4a4c-a0d8-cbcac271bfde None admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:12.814129 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f665eb-7531-4a4c-a0d8-cbcac271bfde None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:12.814421 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f665eb-7531-4a4c-a0d8-cbcac271bfde None admin] PATH_INFO: `/v3/projects/86b325231ef14af1b9223cffefd8d475/groups/8e571cf4cc194744ad7e2ffc83cd65b8/roles/066c4a2915d247089e9df06936eb9a97` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:12.821353 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f665eb-7531-4a4c-a0d8-cbcac271bfde None admin] RBAC: Authorizing `identity:create_grant(project_id=86b325231ef14af1b9223cffefd8d475, group_id=8e571cf4cc194744ad7e2ffc83cd65b8, role_id=066c4a2915d247089e9df06936eb9a97)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:12.821353 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f665eb-7531-4a4c-a0d8-cbcac271bfde None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:12.852280 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 197/396] 10.222.0.47 () {58 vars in 1442 bytes} [Mon Aug 29 22:32:12 2022] PUT /identity/v3/projects/86b325231ef14af1b9223cffefd8d475/groups/8e571cf4cc194744ad7e2ffc83cd65b8/roles/066c4a2915d247089e9df06936eb9a97 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:32:12.998688 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4513d28f-d760-4032-990d-e51f71580a85 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:13.075560 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:13.131990 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4513d28f-d760-4032-990d-e51f71580a85 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:13.178109 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a0e213-d8e5-4341-af08-710a58017351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:13.179033 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0e213-d8e5-4341-af08-710a58017351 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:13.179321 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0e213-d8e5-4341-af08-710a58017351 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:13.179593 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0e213-d8e5-4341-af08-710a58017351 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:13.218380 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a0e213-d8e5-4341-af08-710a58017351 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:32:13.223632 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-29a0e213-d8e5-4341-af08-710a58017351 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:32:13.223632 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:13.223632 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:13.223632 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:13.223632 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:13.223632 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:13.223632 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:13.223632 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:13.223632 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:13.223632 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:13.223632 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:13.223632 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:13.223632 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:32:13.223632 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:32:13.223632 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:32:13.223632 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:32:13.224548 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:32:13.224548 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:32:13.224548 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:32:13.224548 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:32:13.224548 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:13.224548 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:13.224548 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:13.224548 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:13.224548 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:13.224548 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:13.224548 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:13.224548 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:13.224548 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:13.224548 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:13.224548 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:13.224548 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:13.225364 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:13.225364 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:13.225364 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:13.225364 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:13.225364 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:32:13.225364 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:32:13.225364 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:32:13.225364 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:32:13.225364 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:32:13.225364 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:32:13.225364 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:32:13.225364 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:32:13.225364 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 200/397] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Aug 29 22:32:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:13.231879 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f665eb-7531-4a4c-a0d8-cbcac271bfde None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:13.247109 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff528ff4-d7d4-4599-8c35-e0d30c14b693 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:13.247426 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff528ff4-d7d4-4599-8c35-e0d30c14b693 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:13.249215 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff528ff4-d7d4-4599-8c35-e0d30c14b693 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:13.252087 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 201/398] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:32:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:32:13.256393 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b221a1bf-86c4-45a6-a0cb-f46bcdecfea7 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:13.257063 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b221a1bf-86c4-45a6-a0cb-f46bcdecfea7 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:13.257355 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b221a1bf-86c4-45a6-a0cb-f46bcdecfea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:13.289373 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-b221a1bf-86c4-45a6-a0cb-f46bcdecfea7 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:32:13.289373 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-b221a1bf-86c4-45a6-a0cb-f46bcdecfea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:13.447980 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 202/399] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:32:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:32:13.459386 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f665eb-7531-4a4c-a0d8-cbcac271bfde None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:13.521140 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb5cf55-c447-49bd-a4ef-4f1e690e846f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:13.521844 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5cf55-c447-49bd-a4ef-4f1e690e846f None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:13.522127 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5cf55-c447-49bd-a4ef-4f1e690e846f None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:13.522452 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5cf55-c447-49bd-a4ef-4f1e690e846f None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:13.523132 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb5cf55-c447-49bd-a4ef-4f1e690e846f None admin] RBAC: Adding query filter params (name=member) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:13.523438 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb5cf55-c447-49bd-a4ef-4f1e690e846f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:13.524881 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb5cf55-c447-49bd-a4ef-4f1e690e846f None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:13.540694 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 198/400] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Aug 29 22:32:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:13.545529 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a95cc-74fa-4ac4-a0e1-8b70241090b4 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:13.545839 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a95cc-74fa-4ac4-a0e1-8b70241090b4 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:13.546084 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a95cc-74fa-4ac4-a0e1-8b70241090b4 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:13.548863 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 203/401] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:32:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:32:13.550324 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb5cf55-c447-49bd-a4ef-4f1e690e846f None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:13.554877 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e361617-987b-45a9-b196-6e2fef0a432f None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:13.555158 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e361617-987b-45a9-b196-6e2fef0a432f None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:13.555482 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e361617-987b-45a9-b196-6e2fef0a432f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:13.589479 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-0e361617-987b-45a9-b196-6e2fef0a432f None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:32:13.593351 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-0e361617-987b-45a9-b196-6e2fef0a432f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:13.641363 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:13.722614 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:13.757579 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb5cf55-c447-49bd-a4ef-4f1e690e846f None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:13.790335 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 204/402] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:32:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:32:13.856498 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703e6078-e04f-4e06-ba45-124bcb50655f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:13.857151 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e6078-e04f-4e06-ba45-124bcb50655f None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:13.857458 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e6078-e04f-4e06-ba45-124bcb50655f None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:13.857735 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e6078-e04f-4e06-ba45-124bcb50655f None admin] PATH_INFO: `/v3/groups/8e571cf4cc194744ad7e2ffc83cd65b8` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:13.860221 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703e6078-e04f-4e06-ba45-124bcb50655f None admin] RBAC: Authorizing `identity:get_group(group_id=8e571cf4cc194744ad7e2ffc83cd65b8)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:13.860618 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e361617-987b-45a9-b196-6e2fef0a432f None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:13.862151 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703e6078-e04f-4e06-ba45-124bcb50655f None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:13.864211 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 199/403] 10.222.0.47 () {56 vars in 1180 bytes} [Mon Aug 29 22:32:13 2022] GET /identity/v3/groups/8e571cf4cc194744ad7e2ffc83cd65b8 => generated 226 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:13.869943 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703e6078-e04f-4e06-ba45-124bcb50655f None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:14.053756 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e361617-987b-45a9-b196-6e2fef0a432f None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:14.084295 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703e6078-e04f-4e06-ba45-124bcb50655f None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:14.091579 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:14.126758 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51df573-c402-4d6c-8890-3227c03669b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:14.127475 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51df573-c402-4d6c-8890-3227c03669b8 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:14.127782 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51df573-c402-4d6c-8890-3227c03669b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:14.128028 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51df573-c402-4d6c-8890-3227c03669b8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:14.153365 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e4fd1e-1432-424b-9567-55a51a382dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:14.153365 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4fd1e-1432-424b-9567-55a51a382dba None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:14.153365 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4fd1e-1432-424b-9567-55a51a382dba None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:14.153365 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4fd1e-1432-424b-9567-55a51a382dba None admin] PATH_INFO: `/v3/projects/2d92e217cd6146f7910ea8e021e81cb4` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:14.153759 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e4fd1e-1432-424b-9567-55a51a382dba None admin] RBAC: Authorizing `identity:get_project(project_id=2d92e217cd6146f7910ea8e021e81cb4)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:14.153759 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e4fd1e-1432-424b-9567-55a51a382dba None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:14.155772 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 200/404] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Aug 29 22:32:13 2022] GET /identity/v3/projects/2d92e217cd6146f7910ea8e021e81cb4 => generated 302 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:14.156499 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e4fd1e-1432-424b-9567-55a51a382dba None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:14.163508 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51df573-c402-4d6c-8890-3227c03669b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:32:14.172486 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-d51df573-c402-4d6c-8890-3227c03669b8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:32:14.172486 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:14.172486 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:14.172486 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:14.172486 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:14.172486 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:14.172486 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:14.172486 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:14.172486 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:14.172486 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:14.172486 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:14.172486 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:14.172486 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:32:14.172486 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:32:14.172486 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:32:14.172486 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:32:14.173440 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:32:14.173440 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:32:14.173440 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:32:14.173440 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:32:14.173440 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:14.173440 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:14.173440 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:14.173440 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:14.173440 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:14.173440 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:14.173440 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:14.173440 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:14.173440 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:14.173440 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:14.173440 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:14.173440 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:14.174363 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:14.174363 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:14.174363 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:14.174363 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:14.174363 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:32:14.174363 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:32:14.174363 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:32:14.174363 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:32:14.174363 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:32:14.174363 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:32:14.174363 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:32:14.174363 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:32:14.174363 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 205/405] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Aug 29 22:32:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:32:14.179791 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51df573-c402-4d6c-8890-3227c03669b8 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:14.251707 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:14.296340 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e4fd1e-1432-424b-9567-55a51a382dba None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:14.340793 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03dad58-203e-4aa3-83c1-48fc9fd5af5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:14.341515 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03dad58-203e-4aa3-83c1-48fc9fd5af5b None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:14.342036 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03dad58-203e-4aa3-83c1-48fc9fd5af5b None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:14.345482 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03dad58-203e-4aa3-83c1-48fc9fd5af5b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:14.357242 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03dad58-203e-4aa3-83c1-48fc9fd5af5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:32:14.360396 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51df573-c402-4d6c-8890-3227c03669b8 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:14.365366 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-e03dad58-203e-4aa3-83c1-48fc9fd5af5b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:32:14.365366 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:14.365366 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:14.365366 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:14.365366 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:14.365366 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:14.365366 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:14.365366 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:14.365366 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:14.365366 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:14.365366 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:14.365366 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:14.365366 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:32:14.365366 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:32:14.365366 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:32:14.365366 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:32:14.366236 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:32:14.366236 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:32:14.366236 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:32:14.366236 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:32:14.366236 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:14.366236 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:14.366236 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:14.366236 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:14.366236 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:14.366236 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:14.366236 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:14.366236 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:14.366236 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:14.366236 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:14.366236 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:14.366236 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:14.367014 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:14.367014 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:14.367014 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:14.367014 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:14.367014 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:32:14.367014 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:32:14.367014 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:32:14.367014 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:32:14.367014 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:32:14.367014 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:32:14.367014 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:32:14.367014 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:32:14.367014 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 201/406] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Aug 29 22:32:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:14.367014 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03dad58-203e-4aa3-83c1-48fc9fd5af5b None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:14.410925 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:14.430474 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c835118d-09e7-48b3-ada5-739ae7a87d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:14.432631 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835118d-09e7-48b3-ada5-739ae7a87d60 None admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:14.432926 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835118d-09e7-48b3-ada5-739ae7a87d60 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:14.435331 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835118d-09e7-48b3-ada5-739ae7a87d60 None admin] PATH_INFO: `/v3/projects/2d92e217cd6146f7910ea8e021e81cb4/groups/8e571cf4cc194744ad7e2ffc83cd65b8/roles/0c67797d444d4c929b2ccab47c468848` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:14.440666 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c835118d-09e7-48b3-ada5-739ae7a87d60 None admin] RBAC: Authorizing `identity:create_grant(project_id=2d92e217cd6146f7910ea8e021e81cb4, group_id=8e571cf4cc194744ad7e2ffc83cd65b8, role_id=0c67797d444d4c929b2ccab47c468848)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:14.443530 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c835118d-09e7-48b3-ada5-739ae7a87d60 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:14.469421 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 206/407] 10.222.0.47 () {58 vars in 1442 bytes} [Mon Aug 29 22:32:14 2022] PUT /identity/v3/projects/2d92e217cd6146f7910ea8e021e81cb4/groups/8e571cf4cc194744ad7e2ffc83cd65b8/roles/0c67797d444d4c929b2ccab47c468848 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:32:14.471230 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c835118d-09e7-48b3-ada5-739ae7a87d60 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:14.552212 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03dad58-203e-4aa3-83c1-48fc9fd5af5b None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:14.622444 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc139cf-93c0-4baa-a4f6-2147da3f81e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:14.623031 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc139cf-93c0-4baa-a4f6-2147da3f81e9 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:14.623314 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc139cf-93c0-4baa-a4f6-2147da3f81e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:14.623590 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc139cf-93c0-4baa-a4f6-2147da3f81e9 None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:14.624270 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc139cf-93c0-4baa-a4f6-2147da3f81e9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:14.624569 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc139cf-93c0-4baa-a4f6-2147da3f81e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:14.626616 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc139cf-93c0-4baa-a4f6-2147da3f81e9 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:14.637805 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 202/408] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Aug 29 22:32:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:14.643514 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc139cf-93c0-4baa-a4f6-2147da3f81e9 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:14.662282 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c835118d-09e7-48b3-ada5-739ae7a87d60 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:14.671062 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:14.713805 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc3a8b-0e57-4e29-a4c4-42752be9d3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:14.714767 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc3a8b-0e57-4e29-a4c4-42752be9d3ab None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:14.715227 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc3a8b-0e57-4e29-a4c4-42752be9d3ab None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:14.715736 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc3a8b-0e57-4e29-a4c4-42752be9d3ab None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:14.716626 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fc3a8b-0e57-4e29-a4c4-42752be9d3ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:14.717144 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fc3a8b-0e57-4e29-a4c4-42752be9d3ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:14.719710 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fc3a8b-0e57-4e29-a4c4-42752be9d3ab None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:14.730345 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 207/409] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Aug 29 22:32:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:14.736497 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc3a8b-0e57-4e29-a4c4-42752be9d3ab None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:14.787063 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:14.797538 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc139cf-93c0-4baa-a4f6-2147da3f81e9 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:14.855996 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e2860b-b446-4c59-8081-e9e2b90684c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:14.856997 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2860b-b446-4c59-8081-e9e2b90684c5 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:14.857709 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2860b-b446-4c59-8081-e9e2b90684c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:14.859696 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2860b-b446-4c59-8081-e9e2b90684c5 None admin] PATH_INFO: `/v3/groups/8e571cf4cc194744ad7e2ffc83cd65b8` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:14.861112 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e2860b-b446-4c59-8081-e9e2b90684c5 None admin] RBAC: Authorizing `identity:get_group(group_id=8e571cf4cc194744ad7e2ffc83cd65b8)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:14.862875 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e2860b-b446-4c59-8081-e9e2b90684c5 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:14.864952 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 203/410] 10.222.0.47 () {56 vars in 1180 bytes} [Mon Aug 29 22:32:14 2022] GET /identity/v3/groups/8e571cf4cc194744ad7e2ffc83cd65b8 => generated 226 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:14.870827 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f128d1d-dffc-42f0-bed1-f03942c897e4 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:14.871699 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f128d1d-dffc-42f0-bed1-f03942c897e4 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:14.872171 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f128d1d-dffc-42f0-bed1-f03942c897e4 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:14.873928 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 204/411] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:32:14 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:32:14.874367 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc3a8b-0e57-4e29-a4c4-42752be9d3ab None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:14.875077 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f128d1d-dffc-42f0-bed1-f03942c897e4 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:14.924493 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7302c2e2-0a05-45e7-b5b1-00a6af75a546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:14.925635 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302c2e2-0a05-45e7-b5b1-00a6af75a546 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:14.925992 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302c2e2-0a05-45e7-b5b1-00a6af75a546 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:14.926345 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302c2e2-0a05-45e7-b5b1-00a6af75a546 None admin] PATH_INFO: `/v3/groups/526ae832c9c04ba48b6abd9363b1fa60` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:14.927830 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7302c2e2-0a05-45e7-b5b1-00a6af75a546 None admin] RBAC: Authorizing `identity:get_group(group_id=526ae832c9c04ba48b6abd9363b1fa60)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:14.929469 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7302c2e2-0a05-45e7-b5b1-00a6af75a546 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:14.932495 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 208/412] 10.222.0.47 () {56 vars in 1180 bytes} [Mon Aug 29 22:32:14 2022] GET /identity/v3/groups/526ae832c9c04ba48b6abd9363b1fa60 => generated 229 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:14.934155 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f1dfa-b59a-4deb-9db2-d8d6938a9a90 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:14.934515 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f1dfa-b59a-4deb-9db2-d8d6938a9a90 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:14.935061 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f1dfa-b59a-4deb-9db2-d8d6938a9a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:14.960932 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-a44f1dfa-b59a-4deb-9db2-d8d6938a9a90 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:32:14.963278 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-a44f1dfa-b59a-4deb-9db2-d8d6938a9a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:14.998836 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:15.043265 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f128d1d-dffc-42f0-bed1-f03942c897e4 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:15.068202 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 209/413] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:32:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:32:15.069266 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f1dfa-b59a-4deb-9db2-d8d6938a9a90 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:15.106699 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfb083e-ec8a-4354-861a-fc4e90ee4d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:15.107787 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb083e-ec8a-4354-861a-fc4e90ee4d29 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:15.108260 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb083e-ec8a-4354-861a-fc4e90ee4d29 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:15.108724 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb083e-ec8a-4354-861a-fc4e90ee4d29 None admin] PATH_INFO: `/v3/projects/2d92e217cd6146f7910ea8e021e81cb4` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:15.111696 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfb083e-ec8a-4354-861a-fc4e90ee4d29 None admin] RBAC: Authorizing `identity:get_project(project_id=2d92e217cd6146f7910ea8e021e81cb4)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:15.113478 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfb083e-ec8a-4354-861a-fc4e90ee4d29 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:15.115965 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 205/414] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Aug 29 22:32:14 2022] GET /identity/v3/projects/2d92e217cd6146f7910ea8e021e81cb4 => generated 302 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:15.122700 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfb083e-ec8a-4354-861a-fc4e90ee4d29 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:15.163610 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:15.189441 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f1dfa-b59a-4deb-9db2-d8d6938a9a90 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:15.237665 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e26176a-dde6-427f-bcc6-2b57f1a5fb42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:15.238310 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e26176a-dde6-427f-bcc6-2b57f1a5fb42 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:15.238583 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e26176a-dde6-427f-bcc6-2b57f1a5fb42 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:15.238852 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e26176a-dde6-427f-bcc6-2b57f1a5fb42 None admin] PATH_INFO: `/v3/projects/8ad4679521624f7c95e5cca6de7bc365` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:15.239975 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e26176a-dde6-427f-bcc6-2b57f1a5fb42 None admin] RBAC: Authorizing `identity:get_project(project_id=8ad4679521624f7c95e5cca6de7bc365)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:15.241439 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e26176a-dde6-427f-bcc6-2b57f1a5fb42 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:15.243401 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 210/415] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Aug 29 22:32:15 2022] GET /identity/v3/projects/8ad4679521624f7c95e5cca6de7bc365 => generated 344 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:15.254488 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e26176a-dde6-427f-bcc6-2b57f1a5fb42 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:15.287205 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfb083e-ec8a-4354-861a-fc4e90ee4d29 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:15.336028 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:15.346237 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10551536-5a89-4904-9124-ad13ac2f4eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:15.347208 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10551536-5a89-4904-9124-ad13ac2f4eb4 None admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:15.347492 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10551536-5a89-4904-9124-ad13ac2f4eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:15.347767 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10551536-5a89-4904-9124-ad13ac2f4eb4 None admin] PATH_INFO: `/v3/projects/2d92e217cd6146f7910ea8e021e81cb4/groups/8e571cf4cc194744ad7e2ffc83cd65b8/roles/066c4a2915d247089e9df06936eb9a97` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:15.354324 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10551536-5a89-4904-9124-ad13ac2f4eb4 None admin] RBAC: Authorizing `identity:create_grant(project_id=2d92e217cd6146f7910ea8e021e81cb4, group_id=8e571cf4cc194744ad7e2ffc83cd65b8, role_id=066c4a2915d247089e9df06936eb9a97)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:15.356001 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10551536-5a89-4904-9124-ad13ac2f4eb4 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:15.381126 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 206/416] 10.222.0.47 () {58 vars in 1442 bytes} [Mon Aug 29 22:32:15 2022] PUT /identity/v3/projects/2d92e217cd6146f7910ea8e021e81cb4/groups/8e571cf4cc194744ad7e2ffc83cd65b8/roles/066c4a2915d247089e9df06936eb9a97 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:32:15.382534 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820212b9-1f41-48e7-8808-85ef272eace2 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:15.382824 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820212b9-1f41-48e7-8808-85ef272eace2 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:15.383101 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820212b9-1f41-48e7-8808-85ef272eace2 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:15.390225 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 207/417] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:32:15 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:32:15.399164 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d142d-7d35-4fee-b133-d0991f516ffe None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:15.399450 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d142d-7d35-4fee-b133-d0991f516ffe None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:15.399752 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d142d-7d35-4fee-b133-d0991f516ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:15.439850 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-f17d142d-7d35-4fee-b133-d0991f516ffe None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:32:15.442695 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-f17d142d-7d35-4fee-b133-d0991f516ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:15.516782 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e26176a-dde6-427f-bcc6-2b57f1a5fb42 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:15.558296 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 208/418] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:32:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:32:15.559894 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17d142d-7d35-4fee-b133-d0991f516ffe None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:15.565257 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29247d16-6514-4a11-be45-7f124b54a473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:15.567629 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29247d16-6514-4a11-be45-7f124b54a473 None admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:15.567946 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29247d16-6514-4a11-be45-7f124b54a473 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:15.568189 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29247d16-6514-4a11-be45-7f124b54a473 None admin] PATH_INFO: `/v3/projects/8ad4679521624f7c95e5cca6de7bc365/groups/526ae832c9c04ba48b6abd9363b1fa60/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:15.578334 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29247d16-6514-4a11-be45-7f124b54a473 None admin] RBAC: Authorizing `identity:create_grant(project_id=8ad4679521624f7c95e5cca6de7bc365, group_id=526ae832c9c04ba48b6abd9363b1fa60, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:15.579928 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29247d16-6514-4a11-be45-7f124b54a473 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:15.591530 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:15.604912 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 211/419] 10.222.0.47 () {58 vars in 1442 bytes} [Mon Aug 29 22:32:15 2022] PUT /identity/v3/projects/8ad4679521624f7c95e5cca6de7bc365/groups/526ae832c9c04ba48b6abd9363b1fa60/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:32:15.699711 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17d142d-7d35-4fee-b133-d0991f516ffe None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:15.741644 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1649c168-1765-4101-b3ea-5887860a0db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:15.742354 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1649c168-1765-4101-b3ea-5887860a0db4 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:15.742640 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1649c168-1765-4101-b3ea-5887860a0db4 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:15.742912 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1649c168-1765-4101-b3ea-5887860a0db4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:15.757408 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1649c168-1765-4101-b3ea-5887860a0db4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:32:15.766412 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-1649c168-1765-4101-b3ea-5887860a0db4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:32:15.766412 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:15.766412 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:15.766412 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:15.766412 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:15.766412 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:15.766412 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:15.766412 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:15.766412 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:15.766412 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:15.766412 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:15.766412 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:15.766412 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:32:15.766412 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:32:15.766412 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:32:15.766412 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:32:15.767366 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:32:15.767366 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:32:15.767366 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:32:15.767366 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:32:15.767366 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:15.767366 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:15.767366 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:15.767366 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:15.767366 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:15.767366 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:15.767366 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:15.767366 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:15.767366 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:15.767366 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:15.767366 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:15.767366 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:15.768126 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:15.768126 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:15.768126 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:15.768126 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:15.768126 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:32:15.768126 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:32:15.768126 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:32:15.768126 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:32:15.768126 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:32:15.768126 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:32:15.768126 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:32:15.768126 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:32:15.768126 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 209/420] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Aug 29 22:32:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:15.770910 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29247d16-6514-4a11-be45-7f124b54a473 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:15.919952 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:15.920455 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1649c168-1765-4101-b3ea-5887860a0db4 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:15.933815 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29247d16-6514-4a11-be45-7f124b54a473 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:15.998176 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e29abcb-0e0d-4d8a-82da-e91fafa39e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:15.998726 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29abcb-0e0d-4d8a-82da-e91fafa39e33 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:15.999006 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29abcb-0e0d-4d8a-82da-e91fafa39e33 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:15.999276 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29abcb-0e0d-4d8a-82da-e91fafa39e33 None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:15.999951 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e29abcb-0e0d-4d8a-82da-e91fafa39e33 None admin] RBAC: Adding query filter params (name=member) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:16.000250 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e29abcb-0e0d-4d8a-82da-e91fafa39e33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:16.001974 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e29abcb-0e0d-4d8a-82da-e91fafa39e33 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:16.014713 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 212/421] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Aug 29 22:32:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:16.022510 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e29abcb-0e0d-4d8a-82da-e91fafa39e33 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:16.145968 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:16.146616 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e29abcb-0e0d-4d8a-82da-e91fafa39e33 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:16.184883 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3637f13a-ffdc-4dd5-9762-1e0c7b9c4e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:16.186337 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3637f13a-ffdc-4dd5-9762-1e0c7b9c4e5c None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:16.186628 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3637f13a-ffdc-4dd5-9762-1e0c7b9c4e5c None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:16.186903 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3637f13a-ffdc-4dd5-9762-1e0c7b9c4e5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:16.215308 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:16.224382 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1649c168-1765-4101-b3ea-5887860a0db4 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:16.270507 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3637f13a-ffdc-4dd5-9762-1e0c7b9c4e5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:16.277848 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3637f13a-ffdc-4dd5-9762-1e0c7b9c4e5c None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:16.331035 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770ced60-a8e1-4325-8397-771a6a2de0e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:16.331694 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ced60-a8e1-4325-8397-771a6a2de0e4 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:16.331977 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ced60-a8e1-4325-8397-771a6a2de0e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:16.332253 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ced60-a8e1-4325-8397-771a6a2de0e4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:16.357367 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770ced60-a8e1-4325-8397-771a6a2de0e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:32:16.357753 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-770ced60-a8e1-4325-8397-771a6a2de0e4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:32:16.357753 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:16.357753 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:16.357753 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:16.357753 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:16.357753 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:16.357753 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:16.357753 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:16.357753 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:16.357753 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:16.357753 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:16.357753 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:16.357753 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:32:16.357753 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:32:16.357753 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:32:16.357753 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:32:16.358570 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:32:16.358570 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:32:16.358570 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:32:16.358570 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:32:16.358570 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:16.358570 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:16.358570 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:16.358570 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:16.358570 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:16.358570 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:16.358570 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:16.358570 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:16.358570 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:16.358570 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:16.358570 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:16.358570 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:16.359337 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:16.359337 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:16.359337 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:16.359337 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:16.359337 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:32:16.359337 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:32:16.359337 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:32:16.359337 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:32:16.359337 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:32:16.359337 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:32:16.359337 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:32:16.359337 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:32:16.365771 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 210/422] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Aug 29 22:32:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 447 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:32:16.377354 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770ced60-a8e1-4325-8397-771a6a2de0e4 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:16.400290 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 213/423] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Aug 29 22:32:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:32:16.407573 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3637f13a-ffdc-4dd5-9762-1e0c7b9c4e5c None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:16.487133 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:16.588108 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770ced60-a8e1-4325-8397-771a6a2de0e4 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:16.592772 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3637f13a-ffdc-4dd5-9762-1e0c7b9c4e5c None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:16.660485 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580949e4-3af2-4146-bf59-1759f8db5cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:16.661145 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580949e4-3af2-4146-bf59-1759f8db5cea None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:16.661433 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580949e4-3af2-4146-bf59-1759f8db5cea None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:16.664123 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580949e4-3af2-4146-bf59-1759f8db5cea None admin] PATH_INFO: `/v3/projects/86b325231ef14af1b9223cffefd8d475` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:16.665376 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bad2ce5-395b-4ecd-a2c2-3218b92c5294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:16.669351 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad2ce5-395b-4ecd-a2c2-3218b92c5294 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:16.669351 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad2ce5-395b-4ecd-a2c2-3218b92c5294 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:16.669351 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad2ce5-395b-4ecd-a2c2-3218b92c5294 None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:16.669351 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bad2ce5-395b-4ecd-a2c2-3218b92c5294 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:16.669351 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bad2ce5-395b-4ecd-a2c2-3218b92c5294 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:16.669735 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bad2ce5-395b-4ecd-a2c2-3218b92c5294 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:16.673349 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580949e4-3af2-4146-bf59-1759f8db5cea None admin] RBAC: Authorizing `identity:get_project(project_id=86b325231ef14af1b9223cffefd8d475)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:16.673487 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580949e4-3af2-4146-bf59-1759f8db5cea None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:16.677348 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 214/424] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Aug 29 22:32:16 2022] GET /identity/v3/projects/86b325231ef14af1b9223cffefd8d475 => generated 298 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:32:16.682987 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580949e4-3af2-4146-bf59-1759f8db5cea None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:16.693652 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 211/425] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Aug 29 22:32:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:16.698672 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bad2ce5-395b-4ecd-a2c2-3218b92c5294 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:16.709662 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:16.902516 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580949e4-3af2-4146-bf59-1759f8db5cea None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:16.946819 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bad2ce5-395b-4ecd-a2c2-3218b92c5294 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:16.953808 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:17.010840 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27df1cd5-242d-40f8-9ad0-488d88a392dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:17.011837 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df1cd5-242d-40f8-9ad0-488d88a392dc None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:17.012342 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df1cd5-242d-40f8-9ad0-488d88a392dc None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:17.012830 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df1cd5-242d-40f8-9ad0-488d88a392dc None admin] PATH_INFO: `/v3/groups/8e571cf4cc194744ad7e2ffc83cd65b8` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:17.017370 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27df1cd5-242d-40f8-9ad0-488d88a392dc None admin] RBAC: Authorizing `identity:get_group(group_id=8e571cf4cc194744ad7e2ffc83cd65b8)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:17.017607 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27df1cd5-242d-40f8-9ad0-488d88a392dc None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:17.020645 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 215/426] 10.222.0.47 () {56 vars in 1180 bytes} [Mon Aug 29 22:32:16 2022] GET /identity/v3/groups/8e571cf4cc194744ad7e2ffc83cd65b8 => generated 226 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:32:17.027092 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27df1cd5-242d-40f8-9ad0-488d88a392dc None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:17.027246 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0530f0fe-9726-422f-9bc0-be7e2914bd27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:17.028228 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530f0fe-9726-422f-9bc0-be7e2914bd27 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:17.028573 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530f0fe-9726-422f-9bc0-be7e2914bd27 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:17.028842 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530f0fe-9726-422f-9bc0-be7e2914bd27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:17.131244 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0530f0fe-9726-422f-9bc0-be7e2914bd27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:17.132722 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0530f0fe-9726-422f-9bc0-be7e2914bd27 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:17.134839 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:17.213435 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27df1cd5-242d-40f8-9ad0-488d88a392dc None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:17.249998 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc83395-a5b8-419a-8d84-2dd42dc31b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:17.250638 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc83395-a5b8-419a-8d84-2dd42dc31b09 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:17.253350 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc83395-a5b8-419a-8d84-2dd42dc31b09 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:17.253350 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc83395-a5b8-419a-8d84-2dd42dc31b09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:17.253350 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc83395-a5b8-419a-8d84-2dd42dc31b09 None admin] RBAC: Adding query filter params (group.id=8e571cf4cc194744ad7e2ffc83cd65b8, role.id=0c67797d444d4c929b2ccab47c468848, scope.project.id=86b325231ef14af1b9223cffefd8d475) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:17.253350 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc83395-a5b8-419a-8d84-2dd42dc31b09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:17.253775 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc83395-a5b8-419a-8d84-2dd42dc31b09 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:17.262160 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 216/427] 10.222.0.47 () {56 vars in 1376 bytes} [Mon Aug 29 22:32:17 2022] GET /identity/v3/role_assignments?group.id=8e571cf4cc194744ad7e2ffc83cd65b8&scope.project.id=86b325231ef14af1b9223cffefd8d475&role.id=0c67797d444d4c929b2ccab47c468848 => generated 611 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:17.262160 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccefd63-1a70-4c56-bbcb-0bd10f40a91c None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:17.262505 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccefd63-1a70-4c56-bbcb-0bd10f40a91c None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:17.262729 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccefd63-1a70-4c56-bbcb-0bd10f40a91c None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:17.265532 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 217/428] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:32:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:32:17.283316 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21515759-67cb-440b-b65e-8875e600f82f None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:17.283612 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21515759-67cb-440b-b65e-8875e600f82f None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:17.283879 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21515759-67cb-440b-b65e-8875e600f82f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:17.304883 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 212/429] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Aug 29 22:32:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 602 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:32:17.307488 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0530f0fe-9726-422f-9bc0-be7e2914bd27 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:17.376271 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-21515759-67cb-440b-b65e-8875e600f82f None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:32:17.377318 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-21515759-67cb-440b-b65e-8875e600f82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:17.432188 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0530f0fe-9726-422f-9bc0-be7e2914bd27 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:17.442084 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:17.505219 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54226132-3db8-46a8-8b32-3631fd30e688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:17.506356 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54226132-3db8-46a8-8b32-3631fd30e688 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:17.506847 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54226132-3db8-46a8-8b32-3631fd30e688 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:17.507322 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54226132-3db8-46a8-8b32-3631fd30e688 None admin] PATH_INFO: `/v3/projects/86b325231ef14af1b9223cffefd8d475` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:17.508692 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54226132-3db8-46a8-8b32-3631fd30e688 None admin] RBAC: Authorizing `identity:get_project(project_id=86b325231ef14af1b9223cffefd8d475)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:17.510936 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54226132-3db8-46a8-8b32-3631fd30e688 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:17.519122 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 213/430] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Aug 29 22:32:17 2022] GET /identity/v3/projects/86b325231ef14af1b9223cffefd8d475 => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:17.521573 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54226132-3db8-46a8-8b32-3631fd30e688 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:17.536847 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:17.582651 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 218/431] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:32:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:32:17.670735 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54226132-3db8-46a8-8b32-3631fd30e688 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:17.714461 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266bcd82-a5e7-4a9a-ac9b-6c41246e1422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:17.715380 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266bcd82-a5e7-4a9a-ac9b-6c41246e1422 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:17.715854 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266bcd82-a5e7-4a9a-ac9b-6c41246e1422 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:17.716272 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266bcd82-a5e7-4a9a-ac9b-6c41246e1422 None admin] PATH_INFO: `/v3/groups/8e571cf4cc194744ad7e2ffc83cd65b8` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:17.717643 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266bcd82-a5e7-4a9a-ac9b-6c41246e1422 None admin] RBAC: Authorizing `identity:get_group(group_id=8e571cf4cc194744ad7e2ffc83cd65b8)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:17.719450 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266bcd82-a5e7-4a9a-ac9b-6c41246e1422 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:17.721511 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 214/432] 10.222.0.47 () {56 vars in 1180 bytes} [Mon Aug 29 22:32:17 2022] GET /identity/v3/groups/8e571cf4cc194744ad7e2ffc83cd65b8 => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:17.728078 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21515759-67cb-440b-b65e-8875e600f82f None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:17.846152 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21515759-67cb-440b-b65e-8875e600f82f None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:17.884738 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfd0ae8-079e-4501-8d8f-6d3f37f0bf0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:17.885627 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd0ae8-079e-4501-8d8f-6d3f37f0bf0e None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:17.886075 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd0ae8-079e-4501-8d8f-6d3f37f0bf0e None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:17.886495 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd0ae8-079e-4501-8d8f-6d3f37f0bf0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:17.887394 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfd0ae8-079e-4501-8d8f-6d3f37f0bf0e None admin] RBAC: Adding query filter params (group.id=8e571cf4cc194744ad7e2ffc83cd65b8, role.id=066c4a2915d247089e9df06936eb9a97, scope.project.id=86b325231ef14af1b9223cffefd8d475) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:17.887921 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfd0ae8-079e-4501-8d8f-6d3f37f0bf0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:17.889594 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfd0ae8-079e-4501-8d8f-6d3f37f0bf0e None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:17.896623 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 219/433] 10.222.0.47 () {56 vars in 1376 bytes} [Mon Aug 29 22:32:17 2022] GET /identity/v3/role_assignments?group.id=8e571cf4cc194744ad7e2ffc83cd65b8&scope.project.id=86b325231ef14af1b9223cffefd8d475&role.id=066c4a2915d247089e9df06936eb9a97 => generated 611 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:17.942621 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266bcd82-a5e7-4a9a-ac9b-6c41246e1422 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:17.997695 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:18.045088 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf9cd1-8f5a-42ea-ae7b-27869b970f5a None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:18.047227 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf9cd1-8f5a-42ea-ae7b-27869b970f5a None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:18.047800 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf9cd1-8f5a-42ea-ae7b-27869b970f5a None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:18.051734 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 220/434] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:32:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:32:18.064050 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350b7ea-96a9-4872-aeb7-04607d1cc73d None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:18.064880 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350b7ea-96a9-4872-aeb7-04607d1cc73d None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:18.064880 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350b7ea-96a9-4872-aeb7-04607d1cc73d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:18.092110 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266bcd82-a5e7-4a9a-ac9b-6c41246e1422 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:18.098634 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-d350b7ea-96a9-4872-aeb7-04607d1cc73d None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:32:18.101412 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-d350b7ea-96a9-4872-aeb7-04607d1cc73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:18.145589 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9471b9-c52d-4779-bc68-ca0aa0c1b9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:18.146739 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9471b9-c52d-4779-bc68-ca0aa0c1b9c8 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:18.148361 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9471b9-c52d-4779-bc68-ca0aa0c1b9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:18.150388 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9471b9-c52d-4779-bc68-ca0aa0c1b9c8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:18.168609 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9471b9-c52d-4779-bc68-ca0aa0c1b9c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:32:18.174040 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-6e9471b9-c52d-4779-bc68-ca0aa0c1b9c8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:32:18.174040 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:18.174040 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:18.174040 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:18.174040 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:18.174040 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:18.174040 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:18.174040 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:18.174040 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:18.174040 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:18.174040 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:18.174040 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:18.174040 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:32:18.174040 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:32:18.174040 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:32:18.174040 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:32:18.175052 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:32:18.175052 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:32:18.175052 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:32:18.175052 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:32:18.175052 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:18.175052 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:18.175052 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:18.175052 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:18.175052 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:18.175052 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:18.175052 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:18.175052 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:18.175052 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:18.175052 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:18.175052 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:18.175052 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:18.175848 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:18.175848 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:18.175848 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:18.175848 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:18.175848 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:32:18.175848 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:32:18.175848 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:32:18.175848 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:32:18.175848 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:32:18.175848 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:32:18.175848 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 22:32:18.175848 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:32:18.175848 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 215/435] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Aug 29 22:32:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:18.176857 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf4018-7da8-401a-878e-ae19f48e893c None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:18.177137 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf4018-7da8-401a-878e-ae19f48e893c None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:18.178950 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf4018-7da8-401a-878e-ae19f48e893c None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:18.179534 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 216/436] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:32:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:32:18.184473 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:18.184980 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddf4018-7da8-401a-878e-ae19f48e893c None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:18.230735 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 221/437] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:32:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:32:18.232528 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e04761-f9a4-4f00-a231-92d47ce6e8eb None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:18.232893 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e04761-f9a4-4f00-a231-92d47ce6e8eb None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:18.233176 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e04761-f9a4-4f00-a231-92d47ce6e8eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:18.271013 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-c2e04761-f9a4-4f00-a231-92d47ce6e8eb None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:32:18.272217 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-c2e04761-f9a4-4f00-a231-92d47ce6e8eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:18.325504 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:18.338820 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddf4018-7da8-401a-878e-ae19f48e893c None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:18.383307 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 222/438] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:32:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:32:18.397557 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f122041-78f1-4678-9367-4b2020dd0569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:18.398318 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f122041-78f1-4678-9367-4b2020dd0569 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:18.398602 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f122041-78f1-4678-9367-4b2020dd0569 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:18.398932 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f122041-78f1-4678-9367-4b2020dd0569 None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:18.400219 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f122041-78f1-4678-9367-4b2020dd0569 None admin] RBAC: Adding query filter params (name=member) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:18.400578 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f122041-78f1-4678-9367-4b2020dd0569 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:18.402130 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f122041-78f1-4678-9367-4b2020dd0569 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:18.414112 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 217/439] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Aug 29 22:32:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:18.420071 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e04761-f9a4-4f00-a231-92d47ce6e8eb None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:18.530777 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f122041-78f1-4678-9367-4b2020dd0569 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:18.554393 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e04761-f9a4-4f00-a231-92d47ce6e8eb None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:18.565261 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:18.606601 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac60e67c-bc14-46ec-94cd-1d4a19dff150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:18.607222 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac60e67c-bc14-46ec-94cd-1d4a19dff150 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:18.607673 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac60e67c-bc14-46ec-94cd-1d4a19dff150 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:18.607957 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac60e67c-bc14-46ec-94cd-1d4a19dff150 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:18.688022 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f122041-78f1-4678-9367-4b2020dd0569 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:18.702488 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac60e67c-bc14-46ec-94cd-1d4a19dff150 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:18.703966 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac60e67c-bc14-46ec-94cd-1d4a19dff150 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:18.731726 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90940ac-ffec-4c3b-aa14-f3da1eaedfc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:18.732665 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90940ac-ffec-4c3b-aa14-f3da1eaedfc1 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:18.733131 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90940ac-ffec-4c3b-aa14-f3da1eaedfc1 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:18.733243 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90940ac-ffec-4c3b-aa14-f3da1eaedfc1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:18.744664 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90940ac-ffec-4c3b-aa14-f3da1eaedfc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:32:18.750268 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-c90940ac-ffec-4c3b-aa14-f3da1eaedfc1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:32:18.750268 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:18.750268 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:18.750268 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:18.750268 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:18.750268 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:18.750268 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:18.750268 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:18.750268 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:18.750268 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:18.750268 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:18.750268 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:18.750268 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:32:18.750268 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:32:18.750268 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:32:18.750268 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:32:18.751180 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:32:18.751180 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:32:18.751180 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:32:18.751180 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:32:18.751180 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:18.751180 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:18.751180 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:18.751180 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:18.751180 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:18.751180 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:18.751180 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:18.751180 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:18.751180 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:18.751180 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:18.751180 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:18.751180 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:18.751957 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:18.751957 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:18.751957 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:18.751957 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:18.751957 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:32:18.751957 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:32:18.751957 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:32:18.751957 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:32:18.751957 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:32:18.751957 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:32:18.751957 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:32:18.751957 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:32:18.751957 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 218/440] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Aug 29 22:32:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:18.752588 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90940ac-ffec-4c3b-aa14-f3da1eaedfc1 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:18.778796 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:18.826260 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 223/441] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Aug 29 22:32:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:32:18.826994 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac60e67c-bc14-46ec-94cd-1d4a19dff150 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:18.836159 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:18.878319 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90940ac-ffec-4c3b-aa14-f3da1eaedfc1 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:18.916028 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a2d831-da1f-4ed2-976d-3c49c73521de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:18.917130 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2d831-da1f-4ed2-976d-3c49c73521de None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:18.918386 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2d831-da1f-4ed2-976d-3c49c73521de None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:18.918386 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2d831-da1f-4ed2-976d-3c49c73521de None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:18.929244 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a2d831-da1f-4ed2-976d-3c49c73521de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:32:18.935852 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-41a2d831-da1f-4ed2-976d-3c49c73521de None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:32:18.935852 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:18.935852 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:18.935852 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:18.935852 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:18.935852 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:18.935852 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:18.935852 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:18.935852 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:18.935852 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:18.935852 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:18.935852 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:18.935852 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:32:18.935852 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:32:18.935852 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:32:18.935852 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:32:18.936748 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:32:18.936748 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:32:18.936748 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:32:18.936748 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:32:18.936748 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:18.936748 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:18.936748 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:18.936748 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:18.936748 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:18.936748 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:18.936748 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:18.936748 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:18.936748 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:18.936748 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:18.936748 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:18.936748 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:18.937599 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:18.937599 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:18.937599 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:18.937599 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:18.937599 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:32:18.937599 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:32:18.937599 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:32:18.937599 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:32:18.937599 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:32:18.937599 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:32:18.937599 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:32:18.937599 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:32:18.937599 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 219/442] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Aug 29 22:32:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:18.938278 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a2d831-da1f-4ed2-976d-3c49c73521de None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:18.945096 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac60e67c-bc14-46ec-94cd-1d4a19dff150 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:18.988235 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e27b376-d418-48db-a329-24f2ffdb9dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:18.988846 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27b376-d418-48db-a329-24f2ffdb9dd6 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:18.989128 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27b376-d418-48db-a329-24f2ffdb9dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:18.989449 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27b376-d418-48db-a329-24f2ffdb9dd6 None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:18.990122 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e27b376-d418-48db-a329-24f2ffdb9dd6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:18.990427 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e27b376-d418-48db-a329-24f2ffdb9dd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:18.991882 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e27b376-d418-48db-a329-24f2ffdb9dd6 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:19.006105 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 224/443] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Aug 29 22:32:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:19.006105 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e27b376-d418-48db-a329-24f2ffdb9dd6 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:19.036548 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:19.060381 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a2d831-da1f-4ed2-976d-3c49c73521de None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:19.087368 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:19.105321 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df808a-a7d3-4157-83e3-39a2eeee1a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:19.106276 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df808a-a7d3-4157-83e3-39a2eeee1a0e None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:19.106642 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df808a-a7d3-4157-83e3-39a2eeee1a0e None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:19.106817 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df808a-a7d3-4157-83e3-39a2eeee1a0e None admin] PATH_INFO: `/v3/projects/2d92e217cd6146f7910ea8e021e81cb4` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:19.107970 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95df808a-a7d3-4157-83e3-39a2eeee1a0e None admin] RBAC: Authorizing `identity:get_project(project_id=2d92e217cd6146f7910ea8e021e81cb4)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:19.109445 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95df808a-a7d3-4157-83e3-39a2eeee1a0e None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:19.115575 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 220/444] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Aug 29 22:32:18 2022] GET /identity/v3/projects/2d92e217cd6146f7910ea8e021e81cb4 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:19.115575 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df808a-a7d3-4157-83e3-39a2eeee1a0e None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:19.128915 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e27b376-d418-48db-a329-24f2ffdb9dd6 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:19.164205 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec3a9a-6d28-44fd-9415-1475e713b2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:19.164812 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec3a9a-6d28-44fd-9415-1475e713b2fe None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:19.165668 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec3a9a-6d28-44fd-9415-1475e713b2fe None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:19.166092 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec3a9a-6d28-44fd-9415-1475e713b2fe None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:19.167029 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ec3a9a-6d28-44fd-9415-1475e713b2fe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:19.167328 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ec3a9a-6d28-44fd-9415-1475e713b2fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:19.168962 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ec3a9a-6d28-44fd-9415-1475e713b2fe None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:19.178071 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 225/445] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Aug 29 22:32:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:19.178887 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec3a9a-6d28-44fd-9415-1475e713b2fe None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:19.230544 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df808a-a7d3-4157-83e3-39a2eeee1a0e None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:19.268935 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274ecadb-7698-4c51-908e-a0784d6b5ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:19.269594 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274ecadb-7698-4c51-908e-a0784d6b5ecc None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:19.269879 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274ecadb-7698-4c51-908e-a0784d6b5ecc None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:19.270158 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274ecadb-7698-4c51-908e-a0784d6b5ecc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:19.291841 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:19.297425 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec3a9a-6d28-44fd-9415-1475e713b2fe None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:19.328110 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:19.334674 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0766ff7-0360-40db-96cd-ad9b8c0a4718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:19.335437 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0766ff7-0360-40db-96cd-ad9b8c0a4718 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:19.335799 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0766ff7-0360-40db-96cd-ad9b8c0a4718 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:19.336292 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0766ff7-0360-40db-96cd-ad9b8c0a4718 None admin] PATH_INFO: `/v3/groups/8e571cf4cc194744ad7e2ffc83cd65b8` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:19.338112 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0766ff7-0360-40db-96cd-ad9b8c0a4718 None admin] RBAC: Authorizing `identity:get_group(group_id=8e571cf4cc194744ad7e2ffc83cd65b8)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:19.339733 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0766ff7-0360-40db-96cd-ad9b8c0a4718 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:19.341765 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 226/446] 10.222.0.47 () {56 vars in 1180 bytes} [Mon Aug 29 22:32:19 2022] GET /identity/v3/groups/8e571cf4cc194744ad7e2ffc83cd65b8 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:19.342549 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0766ff7-0360-40db-96cd-ad9b8c0a4718 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:19.355487 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274ecadb-7698-4c51-908e-a0784d6b5ecc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:19.357202 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274ecadb-7698-4c51-908e-a0784d6b5ecc None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:19.454025 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0766ff7-0360-40db-96cd-ad9b8c0a4718 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:19.473840 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 221/447] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Aug 29 22:32:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:32:19.474125 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274ecadb-7698-4c51-908e-a0784d6b5ecc None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:19.496150 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc377cd-0706-40a1-9bd7-5c8871423d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:19.496783 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc377cd-0706-40a1-9bd7-5c8871423d9c None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:19.497150 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc377cd-0706-40a1-9bd7-5c8871423d9c None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:19.497461 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc377cd-0706-40a1-9bd7-5c8871423d9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:19.530338 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:19.569521 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:19.574342 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc377cd-0706-40a1-9bd7-5c8871423d9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:19.576197 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc377cd-0706-40a1-9bd7-5c8871423d9c None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:19.597595 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274ecadb-7698-4c51-908e-a0784d6b5ecc None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:19.635743 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed1c3e7-bc0b-43fe-ac35-952458f53cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:19.636353 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed1c3e7-bc0b-43fe-ac35-952458f53cae None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:19.636630 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed1c3e7-bc0b-43fe-ac35-952458f53cae None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:19.636905 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed1c3e7-bc0b-43fe-ac35-952458f53cae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:19.637668 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed1c3e7-bc0b-43fe-ac35-952458f53cae None admin] RBAC: Adding query filter params (group.id=8e571cf4cc194744ad7e2ffc83cd65b8, role.id=0c67797d444d4c929b2ccab47c468848, scope.project.id=2d92e217cd6146f7910ea8e021e81cb4) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:19.637974 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed1c3e7-bc0b-43fe-ac35-952458f53cae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:19.639407 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed1c3e7-bc0b-43fe-ac35-952458f53cae None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:19.645294 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 222/448] 10.222.0.47 () {56 vars in 1376 bytes} [Mon Aug 29 22:32:19 2022] GET /identity/v3/role_assignments?group.id=8e571cf4cc194744ad7e2ffc83cd65b8&scope.project.id=2d92e217cd6146f7910ea8e021e81cb4&role.id=0c67797d444d4c929b2ccab47c468848 => generated 611 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:19.646109 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed1c3e7-bc0b-43fe-ac35-952458f53cae None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:19.710008 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 227/449] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Aug 29 22:32:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:32:19.716582 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc377cd-0706-40a1-9bd7-5c8871423d9c None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:19.792361 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed1c3e7-bc0b-43fe-ac35-952458f53cae None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:19.809174 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:19.843288 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99127d9b-b450-4aa9-b6e4-02b933ec1291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:19.844337 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99127d9b-b450-4aa9-b6e4-02b933ec1291 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:19.845270 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99127d9b-b450-4aa9-b6e4-02b933ec1291 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:19.845801 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99127d9b-b450-4aa9-b6e4-02b933ec1291 None admin] PATH_INFO: `/v3/projects/8ad4679521624f7c95e5cca6de7bc365` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:19.849525 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99127d9b-b450-4aa9-b6e4-02b933ec1291 None admin] RBAC: Authorizing `identity:get_project(project_id=8ad4679521624f7c95e5cca6de7bc365)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:19.852168 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99127d9b-b450-4aa9-b6e4-02b933ec1291 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:19.857959 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 223/450] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Aug 29 22:32:19 2022] GET /identity/v3/projects/8ad4679521624f7c95e5cca6de7bc365 => generated 344 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:19.861028 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99127d9b-b450-4aa9-b6e4-02b933ec1291 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:19.863499 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:19.869381 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc377cd-0706-40a1-9bd7-5c8871423d9c None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:19.917770 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b445ce24-4f2c-44fd-9a11-72c7f166f71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:19.918427 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445ce24-4f2c-44fd-9a11-72c7f166f71b None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:19.918698 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445ce24-4f2c-44fd-9a11-72c7f166f71b None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:19.918969 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445ce24-4f2c-44fd-9a11-72c7f166f71b None admin] PATH_INFO: `/v3/projects/2d92e217cd6146f7910ea8e021e81cb4` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:19.920497 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b445ce24-4f2c-44fd-9a11-72c7f166f71b None admin] RBAC: Authorizing `identity:get_project(project_id=2d92e217cd6146f7910ea8e021e81cb4)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:19.922321 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b445ce24-4f2c-44fd-9a11-72c7f166f71b None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:19.924340 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 228/451] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Aug 29 22:32:19 2022] GET /identity/v3/projects/2d92e217cd6146f7910ea8e021e81cb4 => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:19.930015 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b445ce24-4f2c-44fd-9a11-72c7f166f71b None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:20.013852 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99127d9b-b450-4aa9-b6e4-02b933ec1291 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:20.063980 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86959971-a479-49f4-8573-a6bb1a9235b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:20.064717 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86959971-a479-49f4-8573-a6bb1a9235b8 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:20.065069 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86959971-a479-49f4-8573-a6bb1a9235b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:20.065488 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86959971-a479-49f4-8573-a6bb1a9235b8 None admin] PATH_INFO: `/v3/groups/526ae832c9c04ba48b6abd9363b1fa60` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:20.066679 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86959971-a479-49f4-8573-a6bb1a9235b8 None admin] RBAC: Authorizing `identity:get_group(group_id=526ae832c9c04ba48b6abd9363b1fa60)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:20.068157 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86959971-a479-49f4-8573-a6bb1a9235b8 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:20.069865 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 224/452] 10.222.0.47 () {56 vars in 1180 bytes} [Mon Aug 29 22:32:19 2022] GET /identity/v3/groups/526ae832c9c04ba48b6abd9363b1fa60 => generated 229 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:20.077600 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86959971-a479-49f4-8573-a6bb1a9235b8 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:20.090400 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b445ce24-4f2c-44fd-9a11-72c7f166f71b None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:20.130558 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901435f1-ef3c-4ed6-8f13-4261ec43ca1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:20.131226 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901435f1-ef3c-4ed6-8f13-4261ec43ca1f None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:20.131459 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901435f1-ef3c-4ed6-8f13-4261ec43ca1f None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:20.131735 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901435f1-ef3c-4ed6-8f13-4261ec43ca1f None admin] PATH_INFO: `/v3/groups/8e571cf4cc194744ad7e2ffc83cd65b8` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:20.132846 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901435f1-ef3c-4ed6-8f13-4261ec43ca1f None admin] RBAC: Authorizing `identity:get_group(group_id=8e571cf4cc194744ad7e2ffc83cd65b8)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:20.134366 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901435f1-ef3c-4ed6-8f13-4261ec43ca1f None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:20.136235 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 229/453] 10.222.0.47 () {56 vars in 1180 bytes} [Mon Aug 29 22:32:19 2022] GET /identity/v3/groups/8e571cf4cc194744ad7e2ffc83cd65b8 => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:32:20.138902 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:20.142291 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901435f1-ef3c-4ed6-8f13-4261ec43ca1f None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:20.184579 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:20.201981 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86959971-a479-49f4-8573-a6bb1a9235b8 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:20.240432 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f6b53-923e-41a2-83a9-ef220ab4698c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:20.241046 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f6b53-923e-41a2-83a9-ef220ab4698c None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:20.241343 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f6b53-923e-41a2-83a9-ef220ab4698c None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:20.241625 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f6b53-923e-41a2-83a9-ef220ab4698c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:20.242350 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4f6b53-923e-41a2-83a9-ef220ab4698c None admin] RBAC: Adding query filter params (group.id=526ae832c9c04ba48b6abd9363b1fa60, role.id=d00eabaec96a4956aaec2c37a5819c25, scope.project.id=8ad4679521624f7c95e5cca6de7bc365) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:20.242655 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4f6b53-923e-41a2-83a9-ef220ab4698c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:20.244133 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4f6b53-923e-41a2-83a9-ef220ab4698c None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:20.251244 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 225/454] 10.222.0.47 () {56 vars in 1376 bytes} [Mon Aug 29 22:32:20 2022] GET /identity/v3/role_assignments?group.id=526ae832c9c04ba48b6abd9363b1fa60&scope.project.id=8ad4679521624f7c95e5cca6de7bc365&role.id=d00eabaec96a4956aaec2c37a5819c25 => generated 611 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:20.261256 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901435f1-ef3c-4ed6-8f13-4261ec43ca1f None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:20.312447 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d49561-7bb2-415a-ac28-460babe4a948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:20.313052 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d49561-7bb2-415a-ac28-460babe4a948 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:20.313318 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d49561-7bb2-415a-ac28-460babe4a948 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:20.313566 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d49561-7bb2-415a-ac28-460babe4a948 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:20.314382 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d49561-7bb2-415a-ac28-460babe4a948 None admin] RBAC: Adding query filter params (group.id=8e571cf4cc194744ad7e2ffc83cd65b8, role.id=066c4a2915d247089e9df06936eb9a97, scope.project.id=2d92e217cd6146f7910ea8e021e81cb4) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:20.314758 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d49561-7bb2-415a-ac28-460babe4a948 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:20.316146 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d49561-7bb2-415a-ac28-460babe4a948 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:20.323037 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 230/455] 10.222.0.47 () {56 vars in 1376 bytes} [Mon Aug 29 22:32:20 2022] GET /identity/v3/role_assignments?group.id=8e571cf4cc194744ad7e2ffc83cd65b8&scope.project.id=2d92e217cd6146f7910ea8e021e81cb4&role.id=066c4a2915d247089e9df06936eb9a97 => generated 611 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:22.866797 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae8477-a221-48d1-b630-0c0ab5fcbe03 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:22.867697 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae8477-a221-48d1-b630-0c0ab5fcbe03 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:22.868362 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae8477-a221-48d1-b630-0c0ab5fcbe03 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:22.870186 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 226/456] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:32:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:32:22.876867 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9fa97-384d-4e51-a7a6-e54fe1ed2704 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:22.877362 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9fa97-384d-4e51-a7a6-e54fe1ed2704 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:22.877442 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9fa97-384d-4e51-a7a6-e54fe1ed2704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:22.900232 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-0ed9fa97-384d-4e51-a7a6-e54fe1ed2704 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:32:22.901563 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-0ed9fa97-384d-4e51-a7a6-e54fe1ed2704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:22.980649 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 231/457] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:32:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:32:23.151888 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57176479-dabd-4c7f-a9d1-26aa77640757 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:23.152096 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57176479-dabd-4c7f-a9d1-26aa77640757 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:23.152376 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57176479-dabd-4c7f-a9d1-26aa77640757 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:23.154075 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 227/458] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:32:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:32:23.159822 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34874351-377b-4698-a628-415bb407229c None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:23.160148 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34874351-377b-4698-a628-415bb407229c None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:23.160439 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34874351-377b-4698-a628-415bb407229c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:23.180172 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-34874351-377b-4698-a628-415bb407229c None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:32:23.181658 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-34874351-377b-4698-a628-415bb407229c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:23.208712 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:23.265167 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 232/459] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:32:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:32:23.310189 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57176479-dabd-4c7f-a9d1-26aa77640757 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:23.482318 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57176479-dabd-4c7f-a9d1-26aa77640757 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:23.511924 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:23.552812 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3504076-0769-4295-9863-9e6a6ecb188f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:23.553487 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3504076-0769-4295-9863-9e6a6ecb188f None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:23.553776 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3504076-0769-4295-9863-9e6a6ecb188f None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:23.554052 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3504076-0769-4295-9863-9e6a6ecb188f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:23.579255 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3504076-0769-4295-9863-9e6a6ecb188f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:23.580748 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3504076-0769-4295-9863-9e6a6ecb188f None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:23.600596 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-b3504076-0769-4295-9863-9e6a6ecb188f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:23.600596 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:23.600596 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:23.600596 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:23.600596 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:23.600596 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:23.600596 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:23.600596 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:23.600596 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:23.600596 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:23.600596 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:23.600596 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:23.600596 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:32:23.600596 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:32:23.600596 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:32:23.600596 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:32:23.601570 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:23.601570 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:23.601570 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:23.601570 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:23.601570 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:23.601570 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:23.601570 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:23.601570 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:23.601570 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:23.601570 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:23.601570 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:23.601570 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:23.601570 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:23.601570 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:23.601570 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:23.601570 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:23.601570 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:32:23.603208 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:32:23.603208 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:23.603208 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:32:23.603208 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 228/460] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:32:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:23.608249 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34874351-377b-4698-a628-415bb407229c None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:23.642651 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3504076-0769-4295-9863-9e6a6ecb188f None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:23.777564 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34874351-377b-4698-a628-415bb407229c None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:23.780185 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3504076-0769-4295-9863-9e6a6ecb188f None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:23.817762 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1b8ba2-3d23-4270-8152-06c78d913e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:23.817961 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee47b25-bdcc-4122-ba10-208fbaa2bbee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:23.818403 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b8ba2-3d23-4270-8152-06c78d913e8d None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:23.818508 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee47b25-bdcc-4122-ba10-208fbaa2bbee None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:23.818681 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b8ba2-3d23-4270-8152-06c78d913e8d None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:23.818773 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee47b25-bdcc-4122-ba10-208fbaa2bbee None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:23.818948 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b8ba2-3d23-4270-8152-06c78d913e8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:23.819043 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee47b25-bdcc-4122-ba10-208fbaa2bbee None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:23.819844 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee47b25-bdcc-4122-ba10-208fbaa2bbee None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:23.820153 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee47b25-bdcc-4122-ba10-208fbaa2bbee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:23.822931 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee47b25-bdcc-4122-ba10-208fbaa2bbee None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:23.831262 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1b8ba2-3d23-4270-8152-06c78d913e8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:23.832752 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1b8ba2-3d23-4270-8152-06c78d913e8d None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:23.844321 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 233/461] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:32:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:23.845714 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f64baf-2919-4019-bd45-797b9c4e71cc None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:23.845996 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f64baf-2919-4019-bd45-797b9c4e71cc None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:23.846271 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f64baf-2919-4019-bd45-797b9c4e71cc None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:23.848347 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 234/462] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:32:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:32:23.854432 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f64baf-2919-4019-bd45-797b9c4e71cc None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:23.857359 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-8a1b8ba2-3d23-4270-8152-06c78d913e8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:23.857359 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:23.857359 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:23.857359 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:23.857359 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:23.857359 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:23.857359 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:23.857359 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:23.857359 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:23.857359 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:23.857359 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:23.857359 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:23.857359 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:32:23.857359 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:32:23.857359 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:32:23.857359 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:32:23.858370 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:23.858370 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:23.858370 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:23.858370 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:23.858370 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:23.858370 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:23.858370 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:23.858370 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:23.858370 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:23.858370 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:23.858370 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:23.858370 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:23.858370 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:23.858370 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:23.858370 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:23.858370 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:23.858370 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:32:23.859269 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:32:23.859269 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:23.859269 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:32:23.859269 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 229/463] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:32:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:32:23.859269 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb3baa-0b67-4653-9df4-dfac4f0e8dfa None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:23.859269 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb3baa-0b67-4653-9df4-dfac4f0e8dfa None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:23.859668 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb3baa-0b67-4653-9df4-dfac4f0e8dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:23.881357 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-5ecb3baa-0b67-4653-9df4-dfac4f0e8dfa None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:32:23.881965 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-5ecb3baa-0b67-4653-9df4-dfac4f0e8dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:23.889526 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:23.895663 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:23.972681 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 230/464] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:32:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:32:23.973998 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecb3baa-0b67-4653-9df4-dfac4f0e8dfa None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:24.066985 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f64baf-2919-4019-bd45-797b9c4e71cc None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:24.104749 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecb3baa-0b67-4653-9df4-dfac4f0e8dfa None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:24.142562 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58599879-c30e-4d48-af47-b7e4a80d16c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:24.143518 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58599879-c30e-4d48-af47-b7e4a80d16c2 None admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:24.144018 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58599879-c30e-4d48-af47-b7e4a80d16c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:24.144486 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58599879-c30e-4d48-af47-b7e4a80d16c2 None admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:24.145346 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58599879-c30e-4d48-af47-b7e4a80d16c2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:24.146984 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58599879-c30e-4d48-af47-b7e4a80d16c2 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:24.179269 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 235/465] 10.222.0.47 () {60 vars in 1132 bytes} [Mon Aug 29 22:32:23 2022] POST /identity/v3/users => generated 246 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:32:24.192106 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa6bab-5bd7-4811-96f0-51075bee0752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:24.193126 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa6bab-5bd7-4811-96f0-51075bee0752 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:24.193625 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa6bab-5bd7-4811-96f0-51075bee0752 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:24.194102 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa6bab-5bd7-4811-96f0-51075bee0752 None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:24.194957 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa6bab-5bd7-4811-96f0-51075bee0752 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:24.195473 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa6bab-5bd7-4811-96f0-51075bee0752 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:24.197683 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa6bab-5bd7-4811-96f0-51075bee0752 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:24.220417 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 231/466] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:32:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:24.226526 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58599879-c30e-4d48-af47-b7e4a80d16c2 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:24.356504 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:24.392673 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58599879-c30e-4d48-af47-b7e4a80d16c2 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:24.432824 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0b87f2-ae9a-4f42-b7c8-8f9c8390dbd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:24.433521 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b87f2-ae9a-4f42-b7c8-8f9c8390dbd1 None admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:24.433812 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b87f2-ae9a-4f42-b7c8-8f9c8390dbd1 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:24.434087 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b87f2-ae9a-4f42-b7c8-8f9c8390dbd1 None admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:24.434816 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0b87f2-ae9a-4f42-b7c8-8f9c8390dbd1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:24.436265 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0b87f2-ae9a-4f42-b7c8-8f9c8390dbd1 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:24.445735 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa6bab-5bd7-4811-96f0-51075bee0752 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:24.459434 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:24.466614 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 236/467] 10.222.0.47 () {60 vars in 1132 bytes} [Mon Aug 29 22:32:24 2022] POST /identity/v3/users => generated 248 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:32:24.468100 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7a0c8-c06e-479a-84d1-80defc8adf1a None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:24.468395 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7a0c8-c06e-479a-84d1-80defc8adf1a None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:24.468673 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7a0c8-c06e-479a-84d1-80defc8adf1a None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:24.470239 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 237/468] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:32:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:32:24.478157 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ab84a-5739-44f4-8491-e4eebbfbacff None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:24.479765 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ab84a-5739-44f4-8491-e4eebbfbacff None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:24.480281 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ab84a-5739-44f4-8491-e4eebbfbacff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:24.506302 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-ac9ab84a-5739-44f4-8491-e4eebbfbacff None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:32:24.509037 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-ac9ab84a-5739-44f4-8491-e4eebbfbacff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:24.582638 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa6bab-5bd7-4811-96f0-51075bee0752 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:24.604255 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 238/469] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:32:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:32:24.633034 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30674341-67d4-48f8-b528-de289d172ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:24.634799 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30674341-67d4-48f8-b528-de289d172ba6 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:24.635310 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30674341-67d4-48f8-b528-de289d172ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:24.635755 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30674341-67d4-48f8-b528-de289d172ba6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:24.648214 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30674341-67d4-48f8-b528-de289d172ba6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:24.650758 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30674341-67d4-48f8-b528-de289d172ba6 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:24.666617 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-30674341-67d4-48f8-b528-de289d172ba6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:24.666617 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:24.666617 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:24.666617 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:24.666617 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:24.666617 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:24.666617 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:24.666617 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:24.666617 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:24.666617 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:24.666617 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:24.666617 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:24.666617 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:32:24.666617 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:32:24.666617 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:32:24.666617 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:32:24.667564 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:24.667564 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:24.667564 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:24.667564 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:24.667564 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:24.667564 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:24.667564 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:24.667564 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:24.667564 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:24.667564 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:24.667564 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:24.667564 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:24.667564 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:24.667564 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:24.667564 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:24.667564 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:24.667564 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:32:24.668383 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:32:24.668383 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:24.668383 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:32:24.668887 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 232/470] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:32:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:24.674887 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ab84a-5739-44f4-8491-e4eebbfbacff None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:24.747587 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:24.793636 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ab84a-5739-44f4-8491-e4eebbfbacff None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:24.832950 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07067f13-9711-4586-a76b-d77983c0ad6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:24.834026 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07067f13-9711-4586-a76b-d77983c0ad6e None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:24.834504 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07067f13-9711-4586-a76b-d77983c0ad6e None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:24.834970 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07067f13-9711-4586-a76b-d77983c0ad6e None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:24.835812 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07067f13-9711-4586-a76b-d77983c0ad6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:24.836316 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07067f13-9711-4586-a76b-d77983c0ad6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:24.838472 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07067f13-9711-4586-a76b-d77983c0ad6e None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:24.851616 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 239/471] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:32:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:24.857131 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30674341-67d4-48f8-b528-de289d172ba6 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:24.897461 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07067f13-9711-4586-a76b-d77983c0ad6e None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:24.940036 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:25.007505 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30674341-67d4-48f8-b528-de289d172ba6 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:25.021155 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07067f13-9711-4586-a76b-d77983c0ad6e None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:25.049827 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:25.072403 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca80a2a-e33c-44d8-b126-94faf96550b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:25.073029 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca80a2a-e33c-44d8-b126-94faf96550b8 None admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:25.073307 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca80a2a-e33c-44d8-b126-94faf96550b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:25.073606 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca80a2a-e33c-44d8-b126-94faf96550b8 None admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:25.075106 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca80a2a-e33c-44d8-b126-94faf96550b8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:25.076554 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca80a2a-e33c-44d8-b126-94faf96550b8 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:25.085914 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbde77c4-6b3d-4ed9-8ecb-d4cdbc2c9943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:25.087085 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde77c4-6b3d-4ed9-8ecb-d4cdbc2c9943 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:25.087365 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde77c4-6b3d-4ed9-8ecb-d4cdbc2c9943 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:25.087637 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde77c4-6b3d-4ed9-8ecb-d4cdbc2c9943 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:25.106790 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbde77c4-6b3d-4ed9-8ecb-d4cdbc2c9943 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:25.108328 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbde77c4-6b3d-4ed9-8ecb-d4cdbc2c9943 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:25.116155 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 233/472] 10.222.0.47 () {60 vars in 1132 bytes} [Mon Aug 29 22:32:24 2022] POST /identity/v3/users => generated 248 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:32:25.132346 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-dbde77c4-6b3d-4ed9-8ecb-d4cdbc2c9943 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:25.132346 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:25.132346 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:25.132346 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:25.132346 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:25.132346 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:25.132346 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:25.132346 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:25.132346 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:25.132346 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:25.132346 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:25.132346 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:25.132346 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:32:25.132346 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:32:25.132346 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:32:25.132346 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:32:25.133975 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:25.133975 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:25.133975 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:25.133975 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:25.133975 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:25.133975 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:25.133975 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:25.133975 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:25.133975 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:25.133975 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:25.133975 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:25.133975 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:25.133975 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:25.133975 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:25.133975 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:25.133975 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:25.133975 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:32:25.135269 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:32:25.135269 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:25.135269 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:32:25.135269 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 240/473] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:32:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:32:25.142776 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca80a2a-e33c-44d8-b126-94faf96550b8 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:25.286997 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca80a2a-e33c-44d8-b126-94faf96550b8 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:25.309785 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:25.340957 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24065127-ad31-4fdd-b801-d8faead249c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:25.341671 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24065127-ad31-4fdd-b801-d8faead249c5 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:25.342044 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24065127-ad31-4fdd-b801-d8faead249c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:25.342364 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24065127-ad31-4fdd-b801-d8faead249c5 None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:25.343031 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24065127-ad31-4fdd-b801-d8faead249c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:25.343335 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24065127-ad31-4fdd-b801-d8faead249c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:25.344721 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24065127-ad31-4fdd-b801-d8faead249c5 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:25.364410 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 234/474] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:32:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:25.370555 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbde77c4-6b3d-4ed9-8ecb-d4cdbc2c9943 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:25.442156 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810d990-a3dc-4c20-b5c5-29c6daa081b7 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:25.442494 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810d990-a3dc-4c20-b5c5-29c6daa081b7 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:25.442708 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810d990-a3dc-4c20-b5c5-29c6daa081b7 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:25.444320 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 235/475] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:32:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:32:25.450267 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b8913-89c3-4bc7-a4bf-b06948fb7bc1 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:25.450558 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b8913-89c3-4bc7-a4bf-b06948fb7bc1 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:25.450839 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b8913-89c3-4bc7-a4bf-b06948fb7bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:25.473519 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-913b8913-89c3-4bc7-a4bf-b06948fb7bc1 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:32:25.474773 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-913b8913-89c3-4bc7-a4bf-b06948fb7bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:25.514565 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbde77c4-6b3d-4ed9-8ecb-d4cdbc2c9943 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:25.554918 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b84bf31-faec-453c-8139-df2b91adf76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:25.556082 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84bf31-faec-453c-8139-df2b91adf76c None admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:25.556579 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84bf31-faec-453c-8139-df2b91adf76c None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:25.557052 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84bf31-faec-453c-8139-df2b91adf76c None admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:25.557960 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b84bf31-faec-453c-8139-df2b91adf76c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:25.559615 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b84bf31-faec-453c-8139-df2b91adf76c None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:25.566465 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 236/476] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:32:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:32:25.582696 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 241/477] 10.222.0.47 () {60 vars in 1132 bytes} [Mon Aug 29 22:32:25 2022] POST /identity/v3/users => generated 249 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:32:25.857241 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913b8913-89c3-4bc7-a4bf-b06948fb7bc1 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:25.965880 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913b8913-89c3-4bc7-a4bf-b06948fb7bc1 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:25.968304 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:26.020941 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca8f9a2-8697-4b25-8ce2-6ea624b54cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:26.021595 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8f9a2-8697-4b25-8ce2-6ea624b54cd6 None admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:26.021878 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8f9a2-8697-4b25-8ce2-6ea624b54cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:26.022157 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8f9a2-8697-4b25-8ce2-6ea624b54cd6 None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:26.022836 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca8f9a2-8697-4b25-8ce2-6ea624b54cd6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:26.025020 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca8f9a2-8697-4b25-8ce2-6ea624b54cd6 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:26.039253 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.sql.core [None req-bca8f9a2-8697-4b25-8ce2-6ea624b54cd6 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 29 22:32:26.039253 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 29 22:32:26.039253 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [parameters: {'id': '090e6cf0a2274096b1d014c2d1ed0503', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 29 22:32:26.039253 dv-cinder-854270-4-smb devstack@keystone.service[88338]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88338) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 29 22:32:26.061427 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-bca8f9a2-8697-4b25-8ce2-6ea624b54cd6 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 29 22:32:26.061427 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:26.061427 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 22:32:26.061427 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 22:32:26.061427 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 22:32:26.061427 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 22:32:26.061427 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 22:32:26.061427 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 22:32:26.061427 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 22:32:26.061427 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application conn.query(q) Aug 29 22:32:26.061427 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 22:32:26.061427 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 22:32:26.061427 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 22:32:26.061427 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application result.read() Aug 29 22:32:26.061427 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 22:32:26.062356 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 22:32:26.062356 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 22:32:26.062356 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 22:32:26.062356 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 22:32:26.062356 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 22:32:26.062356 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 22:32:26.062356 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 22:32:26.062356 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 29 22:32:26.062356 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:32:26.062356 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 29 22:32:26.062356 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:32:26.062356 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:26.062356 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 29 22:32:26.062356 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 29 22:32:26.062356 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 29 22:32:26.062356 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return ref.to_dict() Aug 29 22:32:26.062356 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 22:32:26.062356 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application next(self.gen) Aug 29 22:32:26.063757 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 29 22:32:26.063757 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application yield resource Aug 29 22:32:26.063757 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 22:32:26.063757 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application next(self.gen) Aug 29 22:32:26.063757 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 29 22:32:26.063757 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application self.session.rollback() Aug 29 22:32:26.063757 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 22:32:26.063757 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application self.force_reraise() Aug 29 22:32:26.063757 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 22:32:26.063757 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise self.value Aug 29 22:32:26.063757 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 29 22:32:26.063757 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 29 22:32:26.063757 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 29 22:32:26.063757 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application session.commit() Aug 29 22:32:26.063757 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 29 22:32:26.063757 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 29 22:32:26.063757 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 29 22:32:26.065864 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application self._prepare_impl() Aug 29 22:32:26.065864 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 29 22:32:26.065864 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application self.session.flush() Aug 29 22:32:26.065864 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 29 22:32:26.065864 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application self._flush(objects) Aug 29 22:32:26.065864 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 29 22:32:26.065864 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 29 22:32:26.065864 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 29 22:32:26.065864 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application compat.raise_( Aug 29 22:32:26.065864 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 22:32:26.065864 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception Aug 29 22:32:26.065864 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 29 22:32:26.065864 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application flush_context.execute() Aug 29 22:32:26.065864 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 29 22:32:26.065864 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rec.execute(self) Aug 29 22:32:26.065864 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 29 22:32:26.065864 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 29 22:32:26.072284 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 29 22:32:26.072284 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 29 22:32:26.072284 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 29 22:32:26.072284 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 29 22:32:26.072284 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 29 22:32:26.072284 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 29 22:32:26.072284 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 29 22:32:26.072284 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 29 22:32:26.072284 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 29 22:32:26.072284 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 29 22:32:26.072284 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 29 22:32:26.072284 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 29 22:32:26.072284 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 29 22:32:26.072284 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 29 22:32:26.072284 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 22:32:26.072284 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception Aug 29 22:32:26.074381 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 22:32:26.074381 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 22:32:26.074381 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 22:32:26.074381 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 22:32:26.074381 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 22:32:26.074381 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 22:32:26.074381 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 22:32:26.074381 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application conn.query(q) Aug 29 22:32:26.074381 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 22:32:26.074381 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 22:32:26.074381 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 22:32:26.074381 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application result.read() Aug 29 22:32:26.074381 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 22:32:26.074381 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 22:32:26.074381 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 22:32:26.074381 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 22:32:26.076279 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 22:32:26.076279 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 22:32:26.076279 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 22:32:26.076279 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 22:32:26.076279 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 29 22:32:26.076279 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 29 22:32:26.076279 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [parameters: {'id': '090e6cf0a2274096b1d014c2d1ed0503', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 29 22:32:26.076279 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 29 22:32:26.076279 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:32:26.076279 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:32:26.076279 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:32:26.076279 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:26.076279 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:26.076279 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:26.076279 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:26.076279 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:26.078302 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:26.078302 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:26.078302 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:26.078302 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:26.078302 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:26.078302 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:26.078302 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 29 22:32:26.078302 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 29 22:32:26.078302 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:26.078302 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:26.078302 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 29 22:32:26.078302 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 29 22:32:26.078302 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 29 22:32:26.078302 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 29 22:32:26.078302 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 29 22:32:26.078302 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:32:26.080314 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 237/478] 10.222.0.47 () {60 vars in 1131 bytes} [Mon Aug 29 22:32:25 2022] POST /identity/v3/roles => generated 144 bytes in 206 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:26.080455 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b84bf31-faec-453c-8139-df2b91adf76c None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:26.135369 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:26.236800 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b84bf31-faec-453c-8139-df2b91adf76c None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:26.283731 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888f7124-85e2-40c4-a260-b117832622ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:26.284387 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f7124-85e2-40c4-a260-b117832622ba None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:26.284665 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f7124-85e2-40c4-a260-b117832622ba None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:26.284938 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f7124-85e2-40c4-a260-b117832622ba None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:26.296369 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888f7124-85e2-40c4-a260-b117832622ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:32:26.306681 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-888f7124-85e2-40c4-a260-b117832622ba None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:32:26.306681 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:26.306681 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:26.306681 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:26.306681 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:26.306681 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:26.306681 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:26.306681 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:26.306681 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:26.306681 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:26.306681 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:26.306681 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:26.306681 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:32:26.306681 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:32:26.306681 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:32:26.306681 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:32:26.308921 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:32:26.308921 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:32:26.308921 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:32:26.308921 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:32:26.308921 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:26.308921 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:26.308921 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:26.308921 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:26.308921 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:26.308921 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:26.308921 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:26.308921 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:26.308921 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:26.308921 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:26.308921 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:26.308921 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:26.310955 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:26.310955 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:26.310955 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:26.310955 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:26.310955 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:32:26.310955 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:32:26.310955 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:32:26.310955 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:32:26.310955 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:32:26.310955 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:32:26.310955 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 22:32:26.310955 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:32:26.310955 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 242/479] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Aug 29 22:32:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:26.314406 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca8f9a2-8697-4b25-8ce2-6ea624b54cd6 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:26.467738 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca8f9a2-8697-4b25-8ce2-6ea624b54cd6 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:26.512509 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edb44aa-3ec3-4e8d-a2a0-d33565552f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:26.513120 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb44aa-3ec3-4e8d-a2a0-d33565552f5f None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:26.513424 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb44aa-3ec3-4e8d-a2a0-d33565552f5f None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:26.513695 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb44aa-3ec3-4e8d-a2a0-d33565552f5f None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:26.514357 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edb44aa-3ec3-4e8d-a2a0-d33565552f5f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:26.514647 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edb44aa-3ec3-4e8d-a2a0-d33565552f5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:26.516000 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edb44aa-3ec3-4e8d-a2a0-d33565552f5f None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:26.530199 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 238/480] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Aug 29 22:32:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:26.885265 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fdb1eb-d219-468d-a4f2-2172c8d97c51 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:26.885691 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fdb1eb-d219-468d-a4f2-2172c8d97c51 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:26.885883 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fdb1eb-d219-468d-a4f2-2172c8d97c51 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:26.887418 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 243/481] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:32:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:32:26.893033 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf0ca4-b86e-44f2-978c-bcdee1d3e3d6 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:26.893621 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf0ca4-b86e-44f2-978c-bcdee1d3e3d6 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:26.894102 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf0ca4-b86e-44f2-978c-bcdee1d3e3d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:26.920498 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-1adf0ca4-b86e-44f2-978c-bcdee1d3e3d6 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:32:26.921738 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-1adf0ca4-b86e-44f2-978c-bcdee1d3e3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:26.950420 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:27.001513 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 239/482] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:32:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:32:27.022847 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5c5ec-8921-4334-bd3a-e5e626e5a4ed None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:27.023457 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5c5ec-8921-4334-bd3a-e5e626e5a4ed None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:27.024393 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5c5ec-8921-4334-bd3a-e5e626e5a4ed None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:27.026026 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 244/483] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:32:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:32:27.032357 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f840b4d-171f-45f8-a95a-a576231a5f5c None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:27.032646 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f840b4d-171f-45f8-a95a-a576231a5f5c None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:27.032918 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f840b4d-171f-45f8-a95a-a576231a5f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:27.053736 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-2f840b4d-171f-45f8-a95a-a576231a5f5c None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:32:27.055140 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-2f840b4d-171f-45f8-a95a-a576231a5f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:27.125719 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 240/484] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:32:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:32:27.402594 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a5c5ec-8921-4334-bd3a-e5e626e5a4ed None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:27.464838 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f840b4d-171f-45f8-a95a-a576231a5f5c None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:27.526578 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:27.536889 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a5c5ec-8921-4334-bd3a-e5e626e5a4ed None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:27.574522 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bdd330-f28c-4ffd-a264-cd07734b491d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:27.575172 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bdd330-f28c-4ffd-a264-cd07734b491d None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:27.575489 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bdd330-f28c-4ffd-a264-cd07734b491d None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:27.575738 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bdd330-f28c-4ffd-a264-cd07734b491d None admin] PATH_INFO: `/v3/roles/service` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:27.587097 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bdd330-f28c-4ffd-a264-cd07734b491d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:32:27.592464 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-a3bdd330-f28c-4ffd-a264-cd07734b491d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:32:27.592464 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:27.592464 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:27.592464 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:27.592464 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:27.592464 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:27.592464 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:27.592464 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:27.592464 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:27.592464 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:27.592464 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:27.592464 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:27.592464 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:32:27.592464 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:32:27.592464 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:32:27.592464 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:32:27.593363 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:32:27.593363 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:32:27.593363 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:32:27.593363 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:32:27.593363 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:27.593363 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:27.593363 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:27.593363 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:27.593363 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:27.593363 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:27.593363 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:27.593363 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:27.593363 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:27.593363 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:27.593363 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:27.593363 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:27.594152 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:27.594152 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:27.594152 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:27.594152 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:27.594152 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:32:27.594152 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:32:27.594152 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:32:27.594152 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:32:27.594152 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:32:27.594152 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:32:27.594152 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:32:27.594152 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:32:27.594152 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 245/485] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Aug 29 22:32:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:27.599280 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bdd330-f28c-4ffd-a264-cd07734b491d None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:27.652366 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:27.667801 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f840b4d-171f-45f8-a95a-a576231a5f5c None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:27.715959 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165f86d4-9409-4b17-ba00-14fe7dd0d199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:27.717986 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f86d4-9409-4b17-ba00-14fe7dd0d199 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:27.718272 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f86d4-9409-4b17-ba00-14fe7dd0d199 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:27.718549 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f86d4-9409-4b17-ba00-14fe7dd0d199 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:27.743588 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165f86d4-9409-4b17-ba00-14fe7dd0d199 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:32:27.757190 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-165f86d4-9409-4b17-ba00-14fe7dd0d199 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:32:27.757190 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:27.757190 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:27.757190 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:27.757190 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:27.757190 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:27.757190 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:27.757190 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:27.757190 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:27.757190 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:27.757190 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:27.757190 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:27.757190 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:32:27.757190 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:32:27.757190 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:32:27.757190 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:32:27.758752 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:32:27.758752 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:32:27.758752 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:32:27.758752 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:32:27.758752 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:27.758752 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:27.758752 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:27.758752 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:27.758752 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:27.758752 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:27.758752 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:27.758752 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:27.758752 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:27.758752 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:27.758752 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:27.758752 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:27.759661 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:27.759661 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:27.759661 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:27.759661 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:27.759661 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:32:27.759661 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:32:27.759661 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:32:27.759661 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:32:27.759661 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:32:27.759661 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:32:27.759661 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:32:27.759661 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:32:27.759661 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 241/486] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Aug 29 22:32:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:27.764889 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165f86d4-9409-4b17-ba00-14fe7dd0d199 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:27.827344 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bdd330-f28c-4ffd-a264-cd07734b491d None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:27.899375 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a2fd9-40c9-438a-94df-41d3b454fe4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:27.899992 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a2fd9-40c9-438a-94df-41d3b454fe4e None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:27.900275 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a2fd9-40c9-438a-94df-41d3b454fe4e None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:27.900550 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a2fd9-40c9-438a-94df-41d3b454fe4e None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:27.901230 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42a2fd9-40c9-438a-94df-41d3b454fe4e None admin] RBAC: Adding query filter params (name=service) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:27.901570 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42a2fd9-40c9-438a-94df-41d3b454fe4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:27.903371 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42a2fd9-40c9-438a-94df-41d3b454fe4e None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:27.919919 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 246/487] 10.222.0.47 () {56 vars in 1103 bytes} [Mon Aug 29 22:32:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:27.929535 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a2fd9-40c9-438a-94df-41d3b454fe4e None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:27.933270 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165f86d4-9409-4b17-ba00-14fe7dd0d199 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:27.949752 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:27.978453 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbce8c1-4966-4684-b9d0-c9e44e8388fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:27.979062 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbce8c1-4966-4684-b9d0-c9e44e8388fb None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:27.979340 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbce8c1-4966-4684-b9d0-c9e44e8388fb None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:27.979607 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbce8c1-4966-4684-b9d0-c9e44e8388fb None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:27.980271 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbce8c1-4966-4684-b9d0-c9e44e8388fb None admin] RBAC: Adding query filter params (name=service) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:27.980571 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbce8c1-4966-4684-b9d0-c9e44e8388fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:27.982004 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbce8c1-4966-4684-b9d0-c9e44e8388fb None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:27.990682 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 242/488] 10.222.0.47 () {56 vars in 1103 bytes} [Mon Aug 29 22:32:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:27.996473 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbce8c1-4966-4684-b9d0-c9e44e8388fb None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:28.028072 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:28.056807 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a2fd9-40c9-438a-94df-41d3b454fe4e None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:28.094090 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389e838-b25c-4491-bf01-02f4134cce38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:28.094637 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389e838-b25c-4491-bf01-02f4134cce38 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:28.094920 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389e838-b25c-4491-bf01-02f4134cce38 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:28.095193 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389e838-b25c-4491-bf01-02f4134cce38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:28.107079 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1389e838-b25c-4491-bf01-02f4134cce38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:28.108623 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1389e838-b25c-4491-bf01-02f4134cce38 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:28.124439 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-1389e838-b25c-4491-bf01-02f4134cce38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:28.124439 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:28.124439 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:28.124439 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:28.124439 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:28.124439 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:28.124439 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:28.124439 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:28.124439 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:28.124439 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:28.124439 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:28.124439 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:28.124439 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:32:28.124439 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:32:28.124439 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:32:28.124439 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:32:28.125405 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:28.125405 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:28.125405 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:28.125405 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:28.125405 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:28.125405 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:28.125405 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:28.125405 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:28.125405 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:28.125405 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:28.125405 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:28.125405 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:28.125405 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:28.125405 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:28.125405 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:28.125405 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:28.125405 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:32:28.126229 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:32:28.126229 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:28.126229 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:32:28.126229 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 247/489] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:32:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:28.127195 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bfbc3c-d86e-4316-a7fc-030e3c9674a0 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:28.127482 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bfbc3c-d86e-4316-a7fc-030e3c9674a0 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:28.127757 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bfbc3c-d86e-4316-a7fc-030e3c9674a0 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:28.133264 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 248/490] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:32:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:32:28.133264 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bfbc3c-d86e-4316-a7fc-030e3c9674a0 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:28.160596 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbce8c1-4966-4684-b9d0-c9e44e8388fb None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:28.202415 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139ffe97-6ad9-465b-b36b-11b536b2da5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:28.203046 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ffe97-6ad9-465b-b36b-11b536b2da5a None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:28.203329 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ffe97-6ad9-465b-b36b-11b536b2da5a None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:28.203603 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ffe97-6ad9-465b-b36b-11b536b2da5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:28.205237 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:28.215569 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139ffe97-6ad9-465b-b36b-11b536b2da5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:28.217031 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139ffe97-6ad9-465b-b36b-11b536b2da5a None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:28.232266 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-139ffe97-6ad9-465b-b36b-11b536b2da5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:28.232266 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:28.232266 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:28.232266 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:28.232266 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:28.232266 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:28.232266 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:28.232266 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:28.232266 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:28.232266 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:28.232266 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:28.232266 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:28.232266 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:32:28.232266 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:32:28.232266 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:32:28.232266 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:32:28.233156 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:28.233156 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:28.233156 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:28.233156 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:28.233156 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:28.233156 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:28.233156 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:28.233156 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:28.233156 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:28.233156 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:28.233156 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:28.233156 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:28.233156 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:28.233156 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:28.233156 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:28.233156 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:28.233156 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:32:28.234016 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:32:28.234016 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:28.234016 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:32:28.234016 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 243/491] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:32:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:28.234964 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e2de01-a083-419d-8294-04b36621ff9d None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:28.235251 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e2de01-a083-419d-8294-04b36621ff9d None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:28.235523 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e2de01-a083-419d-8294-04b36621ff9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:28.253738 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-03e2de01-a083-419d-8294-04b36621ff9d None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:32:28.254931 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-03e2de01-a083-419d-8294-04b36621ff9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:28.257193 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bfbc3c-d86e-4316-a7fc-030e3c9674a0 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:28.302293 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd39647-7af4-4a5c-9ebe-1a209320d2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:28.302898 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd39647-7af4-4a5c-9ebe-1a209320d2a3 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:28.303174 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd39647-7af4-4a5c-9ebe-1a209320d2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:28.303441 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd39647-7af4-4a5c-9ebe-1a209320d2a3 None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:28.304087 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd39647-7af4-4a5c-9ebe-1a209320d2a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:28.304384 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd39647-7af4-4a5c-9ebe-1a209320d2a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:28.306653 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd39647-7af4-4a5c-9ebe-1a209320d2a3 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:28.322826 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 249/492] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:32:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:28.322826 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a588b-1ea1-4ee9-9a5b-0a3e1b23aae7 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:28.322826 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a588b-1ea1-4ee9-9a5b-0a3e1b23aae7 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:28.322826 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a588b-1ea1-4ee9-9a5b-0a3e1b23aae7 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:28.322826 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 250/493] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:32:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:32:28.322826 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8a588b-1ea1-4ee9-9a5b-0a3e1b23aae7 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:28.331289 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:28.342029 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 244/494] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:32:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:32:28.343045 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e2de01-a083-419d-8294-04b36621ff9d None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:28.447592 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8a588b-1ea1-4ee9-9a5b-0a3e1b23aae7 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:28.473363 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:28.487925 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c3902-41c8-4c44-9fa7-5d22fef87e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:28.488780 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c3902-41c8-4c44-9fa7-5d22fef87e8a None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:28.489266 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c3902-41c8-4c44-9fa7-5d22fef87e8a None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:28.489472 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e2de01-a083-419d-8294-04b36621ff9d None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:28.489923 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c3902-41c8-4c44-9fa7-5d22fef87e8a None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:28.490736 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6c3902-41c8-4c44-9fa7-5d22fef87e8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:28.491209 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6c3902-41c8-4c44-9fa7-5d22fef87e8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:28.493058 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6c3902-41c8-4c44-9fa7-5d22fef87e8a None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:28.512356 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 251/495] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:32:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:28.514173 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4558345-149e-45b5-8aa1-3f79dba545ee None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:28.514537 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4558345-149e-45b5-8aa1-3f79dba545ee None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:28.514891 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4558345-149e-45b5-8aa1-3f79dba545ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:28.535101 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393446ac-3588-40a5-ba0a-f01d0c6582e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:28.536075 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393446ac-3588-40a5-ba0a-f01d0c6582e5 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:28.536576 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393446ac-3588-40a5-ba0a-f01d0c6582e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:28.537019 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393446ac-3588-40a5-ba0a-f01d0c6582e5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:28.538817 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-a4558345-149e-45b5-8aa1-3f79dba545ee None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:32:28.540997 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-a4558345-149e-45b5-8aa1-3f79dba545ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:28.546761 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393446ac-3588-40a5-ba0a-f01d0c6582e5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:28.548460 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393446ac-3588-40a5-ba0a-f01d0c6582e5 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:28.562843 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-393446ac-3588-40a5-ba0a-f01d0c6582e5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 22:32:28.562843 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:28.562843 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:28.562843 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:28.562843 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:28.562843 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:28.562843 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:28.562843 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:28.562843 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:28.562843 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:28.562843 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:28.562843 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:28.562843 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:32:28.562843 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:32:28.562843 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:32:28.562843 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:32:28.563777 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:28.563777 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:28.563777 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:32:28.563777 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:32:28.563777 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:32:28.563777 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:32:28.563777 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:28.563777 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:28.563777 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:28.563777 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:28.563777 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:28.563777 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:28.563777 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:28.563777 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:28.563777 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:28.563777 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:28.563777 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:28.563777 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:28.564649 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:28.564649 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:28.564649 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:32:28.564649 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:32:28.564649 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:32:28.564649 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:32:28.564649 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:32:28.564649 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:32:28.564649 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 22:32:28.564649 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:32:28.566827 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 245/496] 10.222.0.47 () {56 vars in 1093 bytes} [Mon Aug 29 22:32:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:28.568019 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393446ac-3588-40a5-ba0a-f01d0c6582e5 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:28.627467 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 252/497] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:32:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:32:28.628199 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4558345-149e-45b5-8aa1-3f79dba545ee None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:28.642530 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:28.705877 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393446ac-3588-40a5-ba0a-f01d0c6582e5 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:28.744647 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4558345-149e-45b5-8aa1-3f79dba545ee None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:28.750061 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c9f58-8998-4d53-994e-a66f03182f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:28.750720 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c9f58-8998-4d53-994e-a66f03182f3d None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:28.751090 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c9f58-8998-4d53-994e-a66f03182f3d None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:28.751399 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c9f58-8998-4d53-994e-a66f03182f3d None admin] PATH_INFO: `/v3/users/glance` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:28.760340 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6c9f58-8998-4d53-994e-a66f03182f3d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:28.762080 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6c9f58-8998-4d53-994e-a66f03182f3d None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:28.763639 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:28.779064 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-2a6c9f58-8998-4d53-994e-a66f03182f3d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 29 22:32:28.779064 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:28.779064 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:28.779064 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:28.779064 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:28.779064 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:28.779064 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:28.779064 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:28.779064 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:28.779064 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:28.779064 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:28.779064 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:28.779064 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:32:28.779064 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:32:28.779064 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:32:28.779064 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:32:28.779991 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:28.779991 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:28.779991 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:32:28.779991 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:32:28.779991 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:32:28.779991 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:32:28.779991 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:28.779991 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:28.779991 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:28.779991 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:28.779991 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:28.779991 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:28.779991 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:28.779991 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:28.779991 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:28.779991 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:28.779991 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:28.779991 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:28.780856 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:28.780856 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:28.780856 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:32:28.780856 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:32:28.780856 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:32:28.780856 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:32:28.780856 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:32:28.780856 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:32:28.780856 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 29 22:32:28.780856 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:32:28.780856 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 246/498] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Aug 29 22:32:28 2022] GET /identity/v3/users/glance => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:28.780856 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c9f58-8998-4d53-994e-a66f03182f3d None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:28.794184 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d540f4a1-9ea2-47db-9136-539f988d5031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:28.794938 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d540f4a1-9ea2-47db-9136-539f988d5031 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:28.795116 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d540f4a1-9ea2-47db-9136-539f988d5031 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:28.795384 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d540f4a1-9ea2-47db-9136-539f988d5031 None admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:28.796182 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d540f4a1-9ea2-47db-9136-539f988d5031 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:28.796490 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d540f4a1-9ea2-47db-9136-539f988d5031 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:28.798078 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d540f4a1-9ea2-47db-9136-539f988d5031 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:28.845123 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 253/499] 10.222.0.47 () {56 vars in 1133 bytes} [Mon Aug 29 22:32:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:28.846745 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d540f4a1-9ea2-47db-9136-539f988d5031 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:28.905596 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c9f58-8998-4d53-994e-a66f03182f3d None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:28.921715 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:28.945135 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5586762-f647-41d5-950d-78957b40a4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:28.946583 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5586762-f647-41d5-950d-78957b40a4ca None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:28.946870 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5586762-f647-41d5-950d-78957b40a4ca None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:28.947144 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5586762-f647-41d5-950d-78957b40a4ca None admin] PATH_INFO: `/v3/roles/service` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:28.958415 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5586762-f647-41d5-950d-78957b40a4ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:32:28.962241 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d540f4a1-9ea2-47db-9136-539f988d5031 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:28.964851 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-c5586762-f647-41d5-950d-78957b40a4ca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:32:28.964851 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:28.964851 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:28.964851 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:28.964851 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:28.964851 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:28.964851 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:28.964851 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:28.964851 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:28.964851 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:28.964851 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:28.964851 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:28.964851 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:32:28.964851 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:32:28.964851 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:32:28.964851 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:32:28.965830 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:32:28.965830 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:32:28.965830 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:32:28.965830 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:32:28.965830 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:28.965830 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:28.965830 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:28.965830 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:28.965830 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:28.965830 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:28.965830 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:28.965830 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:28.965830 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:28.965830 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:28.965830 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:28.965830 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:28.970055 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:28.970055 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:28.970055 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:28.970055 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:28.970055 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:32:28.970055 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:32:28.970055 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:32:28.970055 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:32:28.970055 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:32:28.970055 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:32:28.970055 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:32:28.970055 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:32:28.970055 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 247/500] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Aug 29 22:32:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:28.970055 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5586762-f647-41d5-950d-78957b40a4ca None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:29.005623 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2795283-260b-4e3f-ac3e-2111e52d3047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:29.006232 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2795283-260b-4e3f-ac3e-2111e52d3047 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:29.006511 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2795283-260b-4e3f-ac3e-2111e52d3047 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:29.006779 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2795283-260b-4e3f-ac3e-2111e52d3047 None admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:29.007517 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2795283-260b-4e3f-ac3e-2111e52d3047 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:29.007823 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2795283-260b-4e3f-ac3e-2111e52d3047 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:29.010165 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2795283-260b-4e3f-ac3e-2111e52d3047 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:29.029711 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 254/501] 10.222.0.47 () {56 vars in 1137 bytes} [Mon Aug 29 22:32:28 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:29.030552 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2795283-260b-4e3f-ac3e-2111e52d3047 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:29.059890 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:29.080389 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5586762-f647-41d5-950d-78957b40a4ca None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:29.113577 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c244ab2-603f-4a09-bfbd-a5410005b8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:29.114188 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c244ab2-603f-4a09-bfbd-a5410005b8b4 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:29.114469 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c244ab2-603f-4a09-bfbd-a5410005b8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:29.114743 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c244ab2-603f-4a09-bfbd-a5410005b8b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:29.135274 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2795283-260b-4e3f-ac3e-2111e52d3047 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:29.160487 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:29.170926 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09698ad7-f998-49e8-9e94-d003e75b7031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:29.171574 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09698ad7-f998-49e8-9e94-d003e75b7031 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:29.171857 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09698ad7-f998-49e8-9e94-d003e75b7031 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:29.172134 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09698ad7-f998-49e8-9e94-d003e75b7031 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:29.184405 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09698ad7-f998-49e8-9e94-d003e75b7031 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:32:29.187831 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c244ab2-603f-4a09-bfbd-a5410005b8b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:29.189302 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c244ab2-603f-4a09-bfbd-a5410005b8b4 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:29.189416 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-09698ad7-f998-49e8-9e94-d003e75b7031 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:32:29.189416 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:29.189416 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:29.189416 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:29.189416 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:29.189416 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:29.189416 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:29.189416 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:29.189416 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:29.189416 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:29.189416 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:29.189416 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:29.189416 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:32:29.189416 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:32:29.189416 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:32:29.189416 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:32:29.190378 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:32:29.190378 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:32:29.190378 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:32:29.190378 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:32:29.190378 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:29.190378 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:29.190378 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:29.190378 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:29.190378 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:29.190378 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:29.190378 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:29.190378 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:29.190378 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:29.190378 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:29.190378 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:29.190378 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:29.191164 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:29.191164 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:29.191164 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:29.191164 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:29.191164 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:32:29.191164 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:32:29.191164 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:32:29.191164 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:32:29.191164 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:32:29.191164 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:32:29.191164 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:32:29.191164 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:32:29.191164 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 255/502] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Aug 29 22:32:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:29.191816 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09698ad7-f998-49e8-9e94-d003e75b7031 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:29.288401 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:29.300755 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09698ad7-f998-49e8-9e94-d003e75b7031 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:29.303040 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 248/503] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Aug 29 22:32:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:32:29.303887 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c244ab2-603f-4a09-bfbd-a5410005b8b4 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:29.338791 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62d0646-f68e-40c9-80c1-3505462c910b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:29.339395 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d0646-f68e-40c9-80c1-3505462c910b None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:29.339673 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d0646-f68e-40c9-80c1-3505462c910b None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:29.339946 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d0646-f68e-40c9-80c1-3505462c910b None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:29.340605 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62d0646-f68e-40c9-80c1-3505462c910b None admin] RBAC: Adding query filter params (name=service) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:29.340903 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62d0646-f68e-40c9-80c1-3505462c910b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:29.342301 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62d0646-f68e-40c9-80c1-3505462c910b None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:29.350376 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 256/504] 10.222.0.47 () {56 vars in 1103 bytes} [Mon Aug 29 22:32:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:29.351527 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35deffb7-2ef0-4293-a38a-102913f28144 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:29.351880 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35deffb7-2ef0-4293-a38a-102913f28144 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:29.352158 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35deffb7-2ef0-4293-a38a-102913f28144 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:29.353393 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 257/505] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:32:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:32:29.354102 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35deffb7-2ef0-4293-a38a-102913f28144 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:29.381125 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:29.407469 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c244ab2-603f-4a09-bfbd-a5410005b8b4 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:29.441506 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125fd34b-8fea-4f60-8163-360b07aaa0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:29.442102 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125fd34b-8fea-4f60-8163-360b07aaa0d1 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:29.442377 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125fd34b-8fea-4f60-8163-360b07aaa0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:29.442670 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125fd34b-8fea-4f60-8163-360b07aaa0d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:29.460047 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35deffb7-2ef0-4293-a38a-102913f28144 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:29.494366 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cbef85-96d5-4719-9acf-ff7d1aa53cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:29.494967 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cbef85-96d5-4719-9acf-ff7d1aa53cb9 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:29.495243 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cbef85-96d5-4719-9acf-ff7d1aa53cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:29.495510 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cbef85-96d5-4719-9acf-ff7d1aa53cb9 None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:29.496164 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cbef85-96d5-4719-9acf-ff7d1aa53cb9 None admin] RBAC: Adding query filter params (name=service) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:29.496464 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cbef85-96d5-4719-9acf-ff7d1aa53cb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:29.497907 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cbef85-96d5-4719-9acf-ff7d1aa53cb9 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:29.505815 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 258/506] 10.222.0.47 () {56 vars in 1103 bytes} [Mon Aug 29 22:32:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:29.506593 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cbef85-96d5-4719-9acf-ff7d1aa53cb9 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:29.512073 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125fd34b-8fea-4f60-8163-360b07aaa0d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:29.513569 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125fd34b-8fea-4f60-8163-360b07aaa0d1 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:29.526456 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:29.590723 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:29.619431 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 249/507] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Aug 29 22:32:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:32:29.619612 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125fd34b-8fea-4f60-8163-360b07aaa0d1 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:29.622553 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cbef85-96d5-4719-9acf-ff7d1aa53cb9 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:29.657005 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8361654c-06ca-4a9e-9edb-4f5b85163d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:29.657656 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361654c-06ca-4a9e-9edb-4f5b85163d59 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:29.657937 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361654c-06ca-4a9e-9edb-4f5b85163d59 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:29.658210 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361654c-06ca-4a9e-9edb-4f5b85163d59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:29.669087 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8361654c-06ca-4a9e-9edb-4f5b85163d59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:29.670568 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8361654c-06ca-4a9e-9edb-4f5b85163d59 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:29.685704 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-8361654c-06ca-4a9e-9edb-4f5b85163d59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:29.685704 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:29.685704 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:29.685704 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:29.685704 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:29.685704 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:29.685704 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:29.685704 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:29.685704 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:29.685704 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:29.685704 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:29.685704 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:29.685704 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:32:29.685704 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:32:29.685704 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:32:29.685704 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:32:29.686675 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:29.686675 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:29.686675 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:29.686675 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:29.686675 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:29.686675 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:29.686675 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:29.686675 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:29.686675 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:29.686675 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:29.686675 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:29.686675 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:29.686675 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:29.686675 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:29.686675 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:29.686675 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:29.686675 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:32:29.687805 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:32:29.687805 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:29.687805 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:32:29.687805 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 259/508] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:32:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:29.688137 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a34f20-fbbe-4bd3-8884-ca9ff90e837a None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:29.688214 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a34f20-fbbe-4bd3-8884-ca9ff90e837a None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:29.688442 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a34f20-fbbe-4bd3-8884-ca9ff90e837a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:29.706209 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-32a34f20-fbbe-4bd3-8884-ca9ff90e837a None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:32:29.707415 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-32a34f20-fbbe-4bd3-8884-ca9ff90e837a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:29.721025 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125fd34b-8fea-4f60-8163-360b07aaa0d1 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:29.755661 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce44e5db-1ee4-4fa0-bfb0-c6f5ff5feebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:29.756288 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44e5db-1ee4-4fa0-bfb0-c6f5ff5feebc None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:29.756557 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44e5db-1ee4-4fa0-bfb0-c6f5ff5feebc None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:29.756826 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44e5db-1ee4-4fa0-bfb0-c6f5ff5feebc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:29.766870 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce44e5db-1ee4-4fa0-bfb0-c6f5ff5feebc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:29.767333 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:29.768303 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce44e5db-1ee4-4fa0-bfb0-c6f5ff5feebc None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:29.776926 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 260/509] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:32:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:32:29.777614 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a34f20-fbbe-4bd3-8884-ca9ff90e837a None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:29.783755 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-ce44e5db-1ee4-4fa0-bfb0-c6f5ff5feebc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:29.783755 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:29.783755 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:29.783755 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:29.783755 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:29.783755 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:29.783755 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:29.783755 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:29.783755 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:29.783755 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:29.783755 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:29.783755 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:29.783755 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:32:29.783755 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:32:29.783755 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:32:29.783755 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:32:29.784640 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:29.784640 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:29.784640 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:29.784640 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:29.784640 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:29.784640 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:29.784640 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:29.784640 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:29.784640 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:29.784640 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:29.784640 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:29.784640 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:29.784640 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:29.784640 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:29.784640 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:29.784640 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:29.784640 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:32:29.785497 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:32:29.785497 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:29.785497 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:32:29.790093 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 250/510] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:32:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:29.791065 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce44e5db-1ee4-4fa0-bfb0-c6f5ff5feebc None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:29.826492 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:29.890703 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a34f20-fbbe-4bd3-8884-ca9ff90e837a None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:29.905219 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce44e5db-1ee4-4fa0-bfb0-c6f5ff5feebc None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:29.928816 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c21516-bd3f-4629-9e3e-302a15ad51df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:29.929502 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c21516-bd3f-4629-9e3e-302a15ad51df None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:29.930768 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c21516-bd3f-4629-9e3e-302a15ad51df None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:29.930768 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c21516-bd3f-4629-9e3e-302a15ad51df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:29.941898 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13a4f39-c132-43c2-b9cd-d6aa8955ec8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:29.942053 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c21516-bd3f-4629-9e3e-302a15ad51df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:29.942588 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a4f39-c132-43c2-b9cd-d6aa8955ec8f None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:29.942870 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a4f39-c132-43c2-b9cd-d6aa8955ec8f None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:29.943142 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a4f39-c132-43c2-b9cd-d6aa8955ec8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:29.943474 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c21516-bd3f-4629-9e3e-302a15ad51df None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:29.955093 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13a4f39-c132-43c2-b9cd-d6aa8955ec8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:29.956544 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13a4f39-c132-43c2-b9cd-d6aa8955ec8f None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:29.959537 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-66c21516-bd3f-4629-9e3e-302a15ad51df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:29.959537 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:29.959537 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:29.959537 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:29.959537 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:29.959537 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:29.959537 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:29.959537 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:29.959537 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:29.959537 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:29.959537 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:29.959537 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:29.959537 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:32:29.959537 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:32:29.959537 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:32:29.959537 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:32:29.960385 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:29.960385 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:29.960385 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:29.960385 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:29.960385 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:29.960385 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:29.960385 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:29.960385 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:29.960385 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:29.960385 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:29.960385 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:29.960385 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:29.960385 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:29.960385 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:29.960385 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:29.960385 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:29.960385 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:32:29.962465 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:32:29.962465 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:29.962465 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:32:29.962465 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 261/511] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:32:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:29.962465 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c21516-bd3f-4629-9e3e-302a15ad51df None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:29.977651 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-a13a4f39-c132-43c2-b9cd-d6aa8955ec8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:29.977651 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:29.977651 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:29.977651 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:29.977651 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:29.977651 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:29.977651 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:29.977651 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:29.977651 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:29.977651 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:29.977651 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:29.977651 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:29.977651 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:32:29.977651 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:32:29.977651 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:32:29.977651 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:32:29.978765 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:29.978765 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:29.978765 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:29.978765 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:29.978765 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:29.978765 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:29.978765 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:29.978765 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:29.978765 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:29.978765 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:29.978765 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:29.978765 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:29.978765 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:29.978765 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:29.978765 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:29.978765 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:29.978765 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:32:29.979748 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:32:29.979748 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:29.979748 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:32:29.979748 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 251/512] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:32:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:29.979748 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13a4f39-c132-43c2-b9cd-d6aa8955ec8f None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:30.017745 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:30.062046 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:30.079429 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c21516-bd3f-4629-9e3e-302a15ad51df None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:30.084951 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13a4f39-c132-43c2-b9cd-d6aa8955ec8f None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:30.114777 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f19e13-73ef-4566-a79f-be0c44cfb912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:30.115374 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f19e13-73ef-4566-a79f-be0c44cfb912 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:30.115649 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f19e13-73ef-4566-a79f-be0c44cfb912 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:30.115919 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f19e13-73ef-4566-a79f-be0c44cfb912 None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:30.116563 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f19e13-73ef-4566-a79f-be0c44cfb912 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:30.116863 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f19e13-73ef-4566-a79f-be0c44cfb912 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:30.118480 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f19e13-73ef-4566-a79f-be0c44cfb912 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:30.119225 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8587af-910c-46bf-9648-9155fe4ebf01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:30.119822 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8587af-910c-46bf-9648-9155fe4ebf01 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:30.120096 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8587af-910c-46bf-9648-9155fe4ebf01 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:30.120364 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8587af-910c-46bf-9648-9155fe4ebf01 None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:30.120995 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8587af-910c-46bf-9648-9155fe4ebf01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:30.121288 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8587af-910c-46bf-9648-9155fe4ebf01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:30.122658 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8587af-910c-46bf-9648-9155fe4ebf01 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:30.129471 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 262/513] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:32:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:30.130263 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f19e13-73ef-4566-a79f-be0c44cfb912 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:30.135536 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 252/514] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:32:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:30.136334 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8587af-910c-46bf-9648-9155fe4ebf01 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:30.233401 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f19e13-73ef-4566-a79f-be0c44cfb912 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:30.238032 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8587af-910c-46bf-9648-9155fe4ebf01 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:30.240445 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:30.268524 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a280a5b8-8acd-4dd2-b13c-d5ae76f840f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:30.269122 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280a5b8-8acd-4dd2-b13c-d5ae76f840f3 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:30.269427 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280a5b8-8acd-4dd2-b13c-d5ae76f840f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:30.269700 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280a5b8-8acd-4dd2-b13c-d5ae76f840f3 None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:30.270367 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a280a5b8-8acd-4dd2-b13c-d5ae76f840f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:30.270663 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a280a5b8-8acd-4dd2-b13c-d5ae76f840f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:30.272016 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f5467-71d0-4c52-b77c-5a812b541845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:30.272128 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a280a5b8-8acd-4dd2-b13c-d5ae76f840f3 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:30.272630 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f5467-71d0-4c52-b77c-5a812b541845 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:30.272911 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f5467-71d0-4c52-b77c-5a812b541845 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:30.273184 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f5467-71d0-4c52-b77c-5a812b541845 None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:30.274388 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784f5467-71d0-4c52-b77c-5a812b541845 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:30.274776 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784f5467-71d0-4c52-b77c-5a812b541845 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:30.276332 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784f5467-71d0-4c52-b77c-5a812b541845 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:30.283860 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:30.286661 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 263/515] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:32:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:30.292072 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a280a5b8-8acd-4dd2-b13c-d5ae76f840f3 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:30.294450 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 253/516] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:32:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:30.295357 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f5467-71d0-4c52-b77c-5a812b541845 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:30.396286 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a280a5b8-8acd-4dd2-b13c-d5ae76f840f3 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:30.402420 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f5467-71d0-4c52-b77c-5a812b541845 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:30.430380 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf908a0-a612-4f98-b8bd-57f0b7fb4963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:30.430998 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf908a0-a612-4f98-b8bd-57f0b7fb4963 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:30.431271 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf908a0-a612-4f98-b8bd-57f0b7fb4963 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:30.431540 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf908a0-a612-4f98-b8bd-57f0b7fb4963 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:30.435623 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8465741-b1c5-4c91-bda4-91aa757f74a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:30.436248 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8465741-b1c5-4c91-bda4-91aa757f74a4 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:30.436530 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8465741-b1c5-4c91-bda4-91aa757f74a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:30.436807 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8465741-b1c5-4c91-bda4-91aa757f74a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:30.441967 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf908a0-a612-4f98-b8bd-57f0b7fb4963 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:30.443411 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf908a0-a612-4f98-b8bd-57f0b7fb4963 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:30.443518 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8465741-b1c5-4c91-bda4-91aa757f74a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:30.444881 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8465741-b1c5-4c91-bda4-91aa757f74a4 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:30.458074 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-c8465741-b1c5-4c91-bda4-91aa757f74a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:32:30.458074 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:30.458074 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:30.458074 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:30.458074 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:30.458074 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:30.458074 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:30.458074 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:30.458074 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:30.458074 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:30.458074 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:30.458074 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:30.458074 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:32:30.458074 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:32:30.458074 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:32:30.459066 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:32:30.459066 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:30.459066 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:30.459066 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:30.459066 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:30.459066 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:30.459066 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:30.459066 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:30.459066 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:30.459066 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:30.459066 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:30.459066 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:30.459066 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:30.459066 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:30.459066 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:30.459066 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:30.459066 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:30.462462 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:32:30.462462 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:32:30.462462 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:32:30.462462 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:32:30.462462 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:32:30.462462 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:32:30.462462 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:32:30.462462 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:32:30.462888 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-dcf908a0-a612-4f98-b8bd-57f0b7fb4963 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:30.462888 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:30.462888 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:30.462888 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:30.462888 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:30.462888 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:30.462888 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:30.462888 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:30.462888 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:30.462888 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:30.462888 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:30.462888 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:30.462888 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:32:30.462888 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:32:30.462888 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:32:30.462888 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:32:30.463992 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:30.463992 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:30.463992 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:30.463992 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:30.463992 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:30.463992 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:30.463992 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:30.463992 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:30.463992 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:30.463992 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:30.463992 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:30.463992 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:30.463992 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:30.463992 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:30.463992 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:30.463992 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:30.463992 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:32:30.464809 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:32:30.464809 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:30.464809 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:32:30.464962 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 254/517] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Aug 29 22:32:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:30.465040 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 264/518] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:32:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:30.465105 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8465741-b1c5-4c91-bda4-91aa757f74a4 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:30.465169 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf908a0-a612-4f98-b8bd-57f0b7fb4963 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:30.483981 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:30.520839 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:30.563427 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8465741-b1c5-4c91-bda4-91aa757f74a4 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:30.566147 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf908a0-a612-4f98-b8bd-57f0b7fb4963 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:30.597069 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4404d7-2764-49bf-9947-584ac193104f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:30.597735 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4404d7-2764-49bf-9947-584ac193104f None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:30.598013 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4404d7-2764-49bf-9947-584ac193104f None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:30.598282 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4404d7-2764-49bf-9947-584ac193104f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:30.600273 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7625ad0d-ad95-4ce4-9613-5d2b910ba689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:30.600898 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625ad0d-ad95-4ce4-9613-5d2b910ba689 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:30.601177 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625ad0d-ad95-4ce4-9613-5d2b910ba689 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:30.601498 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625ad0d-ad95-4ce4-9613-5d2b910ba689 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:30.605756 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4404d7-2764-49bf-9947-584ac193104f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:30.607190 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4404d7-2764-49bf-9947-584ac193104f None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:30.609119 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7625ad0d-ad95-4ce4-9613-5d2b910ba689 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:30.610595 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7625ad0d-ad95-4ce4-9613-5d2b910ba689 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:30.618420 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-8f4404d7-2764-49bf-9947-584ac193104f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 22:32:30.618420 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:30.618420 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:30.618420 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:30.618420 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:30.618420 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:30.618420 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:30.618420 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:30.618420 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:30.618420 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:30.618420 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:30.618420 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:30.618420 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:32:30.618420 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:32:30.618420 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:32:30.618420 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:32:30.619396 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:30.619396 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:30.619396 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:32:30.619396 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:32:30.619396 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:32:30.619396 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:32:30.619396 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:30.619396 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:30.619396 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:30.619396 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:30.619396 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:30.619396 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:30.619396 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:30.619396 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:30.619396 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:30.619396 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:30.619396 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:30.619396 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:30.620269 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:30.620269 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:30.620269 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:32:30.620269 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:32:30.620269 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:32:30.620269 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:32:30.620269 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:32:30.620269 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:32:30.620269 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 22:32:30.620269 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:32:30.621190 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 255/519] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Aug 29 22:32:30 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:30.622163 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4404d7-2764-49bf-9947-584ac193104f None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:30.623085 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-7625ad0d-ad95-4ce4-9613-5d2b910ba689 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 22:32:30.623085 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:30.623085 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:30.623085 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:30.623085 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:30.623085 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:30.623085 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:30.623085 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:30.623085 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:30.623085 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:30.623085 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:30.623085 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:30.623085 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:32:30.623085 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:32:30.623085 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:32:30.623085 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:32:30.623946 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:30.623946 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:30.623946 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:32:30.623946 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:32:30.623946 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:32:30.623946 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:32:30.623946 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:30.623946 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:30.623946 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:30.623946 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:30.623946 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:30.623946 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:30.623946 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:30.623946 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:30.623946 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:30.623946 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:30.623946 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:30.623946 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:30.624788 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:30.624788 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:30.624788 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:32:30.624788 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:32:30.624788 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:32:30.624788 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:32:30.624788 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:32:30.624788 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:32:30.624788 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 22:32:30.624788 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:32:30.624788 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 265/520] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Aug 29 22:32:30 2022] GET /identity/v3/users/neutron => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:30.625320 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7625ad0d-ad95-4ce4-9613-5d2b910ba689 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:30.707357 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:30.723974 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4404d7-2764-49bf-9947-584ac193104f None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:30.730001 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7625ad0d-ad95-4ce4-9613-5d2b910ba689 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:30.741746 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:30.760320 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f1f16a-d4de-40f0-a141-03e783f4579d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:30.760953 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f1f16a-d4de-40f0-a141-03e783f4579d None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:30.761235 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f1f16a-d4de-40f0-a141-03e783f4579d None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:30.761568 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f1f16a-d4de-40f0-a141-03e783f4579d None admin] PATH_INFO: `/v3/projects/service` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:30.764247 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75016c16-78fc-47ff-91b7-02dbf0a9bd26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:30.764842 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75016c16-78fc-47ff-91b7-02dbf0a9bd26 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:30.765122 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75016c16-78fc-47ff-91b7-02dbf0a9bd26 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:30.765420 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75016c16-78fc-47ff-91b7-02dbf0a9bd26 None admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:30.766110 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75016c16-78fc-47ff-91b7-02dbf0a9bd26 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:30.766419 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75016c16-78fc-47ff-91b7-02dbf0a9bd26 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:30.767865 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75016c16-78fc-47ff-91b7-02dbf0a9bd26 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:30.768645 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f1f16a-d4de-40f0-a141-03e783f4579d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:30.770096 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f1f16a-d4de-40f0-a141-03e783f4579d None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:30.781954 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-c5f1f16a-d4de-40f0-a141-03e783f4579d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:32:30.781954 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:30.781954 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:30.781954 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:30.781954 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:30.781954 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:30.781954 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:30.781954 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:30.781954 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:30.781954 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:30.781954 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:30.781954 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:30.781954 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:32:30.781954 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:32:30.781954 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:32:30.782805 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:32:30.782805 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:30.782805 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:30.782805 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:30.782805 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:30.782805 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:30.782805 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:30.782805 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:30.782805 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:30.782805 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:30.782805 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:30.782805 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:30.782805 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:30.782805 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:30.782805 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:30.782805 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:30.782805 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:30.783818 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:32:30.783818 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:32:30.783818 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:32:30.783818 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:32:30.783818 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:32:30.783818 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:32:30.783818 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:32:30.783818 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:32:30.783818 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 256/521] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Aug 29 22:32:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:30.784430 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f1f16a-d4de-40f0-a141-03e783f4579d None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:30.788383 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 266/522] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Aug 29 22:32:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:30.789402 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75016c16-78fc-47ff-91b7-02dbf0a9bd26 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:30.892820 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75016c16-78fc-47ff-91b7-02dbf0a9bd26 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:30.893802 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f1f16a-d4de-40f0-a141-03e783f4579d None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:30.926601 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeffafd-aac5-4d41-afa3-cf284548ad39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:30.926792 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b74090-3795-4d28-b8c6-74a61766950c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:30.927204 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeffafd-aac5-4d41-afa3-cf284548ad39 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:30.927320 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b74090-3795-4d28-b8c6-74a61766950c None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:30.927486 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeffafd-aac5-4d41-afa3-cf284548ad39 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:30.927598 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b74090-3795-4d28-b8c6-74a61766950c None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:30.927756 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeffafd-aac5-4d41-afa3-cf284548ad39 None admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:30.927845 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b74090-3795-4d28-b8c6-74a61766950c None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:30.928477 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b74090-3795-4d28-b8c6-74a61766950c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:30.928577 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeffafd-aac5-4d41-afa3-cf284548ad39 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:30.928777 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b74090-3795-4d28-b8c6-74a61766950c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:30.928865 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeffafd-aac5-4d41-afa3-cf284548ad39 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:30.930787 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b74090-3795-4d28-b8c6-74a61766950c None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:30.930924 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeffafd-aac5-4d41-afa3-cf284548ad39 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:30.939159 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:30.943033 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 257/523] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:32:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:30.943835 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b74090-3795-4d28-b8c6-74a61766950c None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:30.956295 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 267/524] 10.222.0.47 () {56 vars in 1137 bytes} [Mon Aug 29 22:32:30 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:30.956295 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeffafd-aac5-4d41-afa3-cf284548ad39 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:30.984382 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:31.050497 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b74090-3795-4d28-b8c6-74a61766950c None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:31.059311 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeffafd-aac5-4d41-afa3-cf284548ad39 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:31.085915 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a17b526-9b1d-4b36-87ba-9a2ad4be46d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:31.087107 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17b526-9b1d-4b36-87ba-9a2ad4be46d8 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:31.087388 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17b526-9b1d-4b36-87ba-9a2ad4be46d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:31.087664 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17b526-9b1d-4b36-87ba-9a2ad4be46d8 None admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:31.088387 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a17b526-9b1d-4b36-87ba-9a2ad4be46d8 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:31.088685 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a17b526-9b1d-4b36-87ba-9a2ad4be46d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:31.090151 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a17b526-9b1d-4b36-87ba-9a2ad4be46d8 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:31.094989 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d26c3-c81c-4fdd-8935-bf87bb9b0079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:31.095586 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d26c3-c81c-4fdd-8935-bf87bb9b0079 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:31.095862 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d26c3-c81c-4fdd-8935-bf87bb9b0079 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:31.096132 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d26c3-c81c-4fdd-8935-bf87bb9b0079 None admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:31.096813 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150d26c3-c81c-4fdd-8935-bf87bb9b0079 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:31.097111 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150d26c3-c81c-4fdd-8935-bf87bb9b0079 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:31.098557 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150d26c3-c81c-4fdd-8935-bf87bb9b0079 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:31.110618 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 268/525] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Aug 29 22:32:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:31.111422 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d26c3-c81c-4fdd-8935-bf87bb9b0079 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:31.128518 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 258/526] 10.222.0.47 () {56 vars in 1139 bytes} [Mon Aug 29 22:32:30 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:31.129734 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a17b526-9b1d-4b36-87ba-9a2ad4be46d8 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:31.171127 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:31.216014 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d26c3-c81c-4fdd-8935-bf87bb9b0079 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:31.224003 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:31.230904 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a17b526-9b1d-4b36-87ba-9a2ad4be46d8 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:31.251451 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11845e50-fc4a-4083-bd6a-220af5c520d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:31.252048 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11845e50-fc4a-4083-bd6a-220af5c520d7 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:31.252489 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11845e50-fc4a-4083-bd6a-220af5c520d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:31.252641 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11845e50-fc4a-4083-bd6a-220af5c520d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:31.253310 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11845e50-fc4a-4083-bd6a-220af5c520d7 None admin] RBAC: Adding query filter params (role.id=938d531e06764249874d708978e7a0e9, scope.project.id=ce09f0beb1a342febbb4a8b3c7cf60c2, user.id=35441c061e514b1b9341e7694ec2c0bc) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:31.253638 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11845e50-fc4a-4083-bd6a-220af5c520d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:31.255071 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11845e50-fc4a-4083-bd6a-220af5c520d7 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:31.265411 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 269/527] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Aug 29 22:32:31 2022] GET /identity/v3/role_assignments?user.id=35441c061e514b1b9341e7694ec2c0bc&scope.project.id=ce09f0beb1a342febbb4a8b3c7cf60c2&role.id=938d531e06764249874d708978e7a0e9 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:31.265411 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11845e50-fc4a-4083-bd6a-220af5c520d7 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:31.271248 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ef587-9573-4284-980d-3ee379babc45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:31.271961 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ef587-9573-4284-980d-3ee379babc45 None admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:31.274844 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ef587-9573-4284-980d-3ee379babc45 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:31.274844 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ef587-9573-4284-980d-3ee379babc45 None admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:31.274844 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45ef587-9573-4284-980d-3ee379babc45 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:31.274844 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45ef587-9573-4284-980d-3ee379babc45 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:31.300780 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 259/528] 10.222.0.47 () {60 vars in 1132 bytes} [Mon Aug 29 22:32:31 2022] POST /identity/v3/users => generated 247 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:32:31.301774 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ef587-9573-4284-980d-3ee379babc45 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:31.445634 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11845e50-fc4a-4083-bd6a-220af5c520d7 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:31.474595 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:31.482883 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ef587-9573-4284-980d-3ee379babc45 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:31.499161 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97419536-df09-4c10-b6e7-30cebc390245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:31.499813 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97419536-df09-4c10-b6e7-30cebc390245 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:31.500154 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97419536-df09-4c10-b6e7-30cebc390245 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:31.500518 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97419536-df09-4c10-b6e7-30cebc390245 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:31.524669 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366c9961-cde2-4e49-adc2-682df36f4c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:31.525288 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c9961-cde2-4e49-adc2-682df36f4c53 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:31.526843 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c9961-cde2-4e49-adc2-682df36f4c53 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:31.526843 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c9961-cde2-4e49-adc2-682df36f4c53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:31.526843 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366c9961-cde2-4e49-adc2-682df36f4c53 None admin] RBAC: Adding query filter params (role.id=938d531e06764249874d708978e7a0e9, scope.project.id=ce09f0beb1a342febbb4a8b3c7cf60c2, user.id=a5c4e692fd714354b96bd3ef4fcecdd0) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:31.526843 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366c9961-cde2-4e49-adc2-682df36f4c53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:31.528532 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366c9961-cde2-4e49-adc2-682df36f4c53 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:31.537459 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 260/529] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Aug 29 22:32:31 2022] GET /identity/v3/role_assignments?user.id=a5c4e692fd714354b96bd3ef4fcecdd0&scope.project.id=ce09f0beb1a342febbb4a8b3c7cf60c2&role.id=938d531e06764249874d708978e7a0e9 => generated 259 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:31.538353 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366c9961-cde2-4e49-adc2-682df36f4c53 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:31.567645 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:31.604976 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97419536-df09-4c10-b6e7-30cebc390245 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:31.607267 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97419536-df09-4c10-b6e7-30cebc390245 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:31.666974 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366c9961-cde2-4e49-adc2-682df36f4c53 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:31.703998 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcbf529-d24a-4d48-9e0a-6641f0300a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:31.704615 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcbf529-d24a-4d48-9e0a-6641f0300a72 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:31.705592 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcbf529-d24a-4d48-9e0a-6641f0300a72 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:31.705592 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcbf529-d24a-4d48-9e0a-6641f0300a72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:31.748359 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 270/530] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Aug 29 22:32:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:32:31.754240 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97419536-df09-4c10-b6e7-30cebc390245 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:31.782276 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:31.854917 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcbf529-d24a-4d48-9e0a-6641f0300a72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:31.856607 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcbf529-d24a-4d48-9e0a-6641f0300a72 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:31.878281 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97419536-df09-4c10-b6e7-30cebc390245 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:31.898811 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:31.918693 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c005ccc-67bc-40f5-901e-b41e8980c6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:31.919437 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c005ccc-67bc-40f5-901e-b41e8980c6ba None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:31.920018 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c005ccc-67bc-40f5-901e-b41e8980c6ba None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:31.920367 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c005ccc-67bc-40f5-901e-b41e8980c6ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:31.933431 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c005ccc-67bc-40f5-901e-b41e8980c6ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:31.935347 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c005ccc-67bc-40f5-901e-b41e8980c6ba None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:31.952419 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-4c005ccc-67bc-40f5-901e-b41e8980c6ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:31.952419 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:31.952419 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:31.952419 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:31.952419 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:31.952419 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:31.952419 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:31.952419 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:31.952419 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:31.952419 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:31.952419 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:31.952419 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:31.952419 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:32:31.952419 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:32:31.952419 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:32:31.952419 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:32:31.953593 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:31.953593 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:31.953593 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:31.953593 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:31.953593 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:31.953593 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:31.953593 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:31.953593 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:31.953593 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:31.953593 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:31.953593 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:31.953593 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:31.953593 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:31.953593 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:31.953593 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:31.953593 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:31.953593 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:32:31.954626 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:32:31.954626 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:31.954626 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:32:31.955408 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 271/531] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:32:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:31.961591 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c005ccc-67bc-40f5-901e-b41e8980c6ba None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:32.046107 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:32.068924 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c005ccc-67bc-40f5-901e-b41e8980c6ba None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:32.084981 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 261/532] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Aug 29 22:32:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:32:32.100825 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcbf529-d24a-4d48-9e0a-6641f0300a72 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:32.111131 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da28c1-cba1-438f-bb9b-0f40332154fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:32.111759 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da28c1-cba1-438f-bb9b-0f40332154fb None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:32.112107 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da28c1-cba1-438f-bb9b-0f40332154fb None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:32.112446 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da28c1-cba1-438f-bb9b-0f40332154fb None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:32.113223 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7da28c1-cba1-438f-bb9b-0f40332154fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:32.113616 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7da28c1-cba1-438f-bb9b-0f40332154fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:32.115112 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7da28c1-cba1-438f-bb9b-0f40332154fb None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:32.132122 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 272/533] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:32:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:32:32.133454 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da28c1-cba1-438f-bb9b-0f40332154fb None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:32.238049 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da28c1-cba1-438f-bb9b-0f40332154fb None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:32.268920 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:32.274130 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e352784-fe95-4afd-94b2-12db4bc539c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:32.274794 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e352784-fe95-4afd-94b2-12db4bc539c9 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:32.275143 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e352784-fe95-4afd-94b2-12db4bc539c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:32.275483 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e352784-fe95-4afd-94b2-12db4bc539c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:32.283218 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e352784-fe95-4afd-94b2-12db4bc539c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:32.284935 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e352784-fe95-4afd-94b2-12db4bc539c9 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:32.298339 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-3e352784-fe95-4afd-94b2-12db4bc539c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:32:32.298339 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:32.298339 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:32.298339 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:32.298339 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:32.298339 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:32.298339 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:32.298339 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:32.298339 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:32.298339 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:32.298339 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:32.298339 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:32.298339 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:32:32.298339 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:32:32.298339 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:32:32.299225 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:32:32.299225 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:32.299225 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:32.299225 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:32.299225 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:32.299225 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:32.299225 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:32.299225 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:32.299225 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:32.299225 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:32.299225 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:32.299225 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:32.299225 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:32.299225 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:32.299225 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:32.299225 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:32.299225 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:32.300020 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:32:32.300020 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:32:32.300020 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:32:32.300020 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:32:32.300020 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:32:32.300020 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:32:32.300020 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:32:32.300020 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:32:32.304315 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 273/534] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Aug 29 22:32:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:32.306375 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e352784-fe95-4afd-94b2-12db4bc539c9 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:32.319843 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcbf529-d24a-4d48-9e0a-6641f0300a72 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:32.365798 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:32.402891 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f546302e-286b-4380-8637-478e60dc56b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:32.403543 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f546302e-286b-4380-8637-478e60dc56b6 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:32.403825 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f546302e-286b-4380-8637-478e60dc56b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:32.404095 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f546302e-286b-4380-8637-478e60dc56b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:32.419396 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e352784-fe95-4afd-94b2-12db4bc539c9 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:32.427559 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f546302e-286b-4380-8637-478e60dc56b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:32.429127 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f546302e-286b-4380-8637-478e60dc56b6 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:32.456847 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74811e4b-a457-48e0-bbae-a186f93aea2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:32.457488 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74811e4b-a457-48e0-bbae-a186f93aea2d None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:32.457770 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74811e4b-a457-48e0-bbae-a186f93aea2d None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:32.458045 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74811e4b-a457-48e0-bbae-a186f93aea2d None admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:32.458743 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74811e4b-a457-48e0-bbae-a186f93aea2d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:32.459044 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74811e4b-a457-48e0-bbae-a186f93aea2d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:32.460482 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74811e4b-a457-48e0-bbae-a186f93aea2d None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:32.464435 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-f546302e-286b-4380-8637-478e60dc56b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:32.464435 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:32.464435 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:32.464435 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:32.464435 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:32.464435 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:32.464435 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:32.464435 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:32.464435 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:32.464435 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:32.464435 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:32.464435 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:32.464435 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:32:32.464435 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:32:32.464435 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:32:32.464435 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:32:32.465313 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:32.465313 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:32.465313 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:32.465313 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:32.465313 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:32.465313 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:32.465313 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:32.465313 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:32.465313 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:32.465313 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:32.465313 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:32.465313 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:32.465313 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:32.465313 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:32.465313 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:32.465313 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:32.465313 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:32:32.466165 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:32:32.466165 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:32.466165 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:32:32.478109 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 274/536] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Aug 29 22:32:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:32.478679 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 262/536] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:32:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:32.484902 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74811e4b-a457-48e0-bbae-a186f93aea2d None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:32.490348 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f546302e-286b-4380-8637-478e60dc56b6 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:32.540781 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:32.589313 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74811e4b-a457-48e0-bbae-a186f93aea2d None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:32.625306 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b22b44-7ea8-4ca6-ab62-13c8a3c6a604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:32.625968 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b22b44-7ea8-4ca6-ab62-13c8a3c6a604 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:32.626313 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b22b44-7ea8-4ca6-ab62-13c8a3c6a604 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:32.626651 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b22b44-7ea8-4ca6-ab62-13c8a3c6a604 None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:32.627361 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b22b44-7ea8-4ca6-ab62-13c8a3c6a604 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:32.627727 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b22b44-7ea8-4ca6-ab62-13c8a3c6a604 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:32.629163 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b22b44-7ea8-4ca6-ab62-13c8a3c6a604 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:32.645468 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 275/537] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:32:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:32.647927 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b22b44-7ea8-4ca6-ab62-13c8a3c6a604 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:32.697815 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f546302e-286b-4380-8637-478e60dc56b6 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:32.753073 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b22b44-7ea8-4ca6-ab62-13c8a3c6a604 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:32.767996 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:32.778818 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c67c6ef-0e66-4779-a4a8-a01fad42d3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:32.779488 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67c6ef-0e66-4779-a4a8-a01fad42d3c8 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:32.779828 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67c6ef-0e66-4779-a4a8-a01fad42d3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:32.780189 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67c6ef-0e66-4779-a4a8-a01fad42d3c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:32.781283 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c67c6ef-0e66-4779-a4a8-a01fad42d3c8 None admin] RBAC: Adding query filter params (role.id=938d531e06764249874d708978e7a0e9, scope.project.id=ce09f0beb1a342febbb4a8b3c7cf60c2, user.id=d6a05d7ad37e4547bada8aabc0fcb64b) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:32.781621 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c67c6ef-0e66-4779-a4a8-a01fad42d3c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:32.783041 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c67c6ef-0e66-4779-a4a8-a01fad42d3c8 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:32.792809 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be1a2b2-8dec-4b7f-80d0-319511c07a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:32.793478 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1a2b2-8dec-4b7f-80d0-319511c07a8c None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:32.793760 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1a2b2-8dec-4b7f-80d0-319511c07a8c None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:32.794032 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1a2b2-8dec-4b7f-80d0-319511c07a8c None admin] PATH_INFO: `/v3/projects/service` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:32.796411 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 263/538] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Aug 29 22:32:32 2022] GET /identity/v3/role_assignments?user.id=d6a05d7ad37e4547bada8aabc0fcb64b&scope.project.id=ce09f0beb1a342febbb4a8b3c7cf60c2&role.id=938d531e06764249874d708978e7a0e9 => generated 259 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:32.807233 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be1a2b2-8dec-4b7f-80d0-319511c07a8c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:32.808710 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be1a2b2-8dec-4b7f-80d0-319511c07a8c None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:32.831300 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-0be1a2b2-8dec-4b7f-80d0-319511c07a8c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:32:32.831300 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:32.831300 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:32.831300 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:32.831300 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:32.831300 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:32.831300 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:32.831300 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:32.831300 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:32.831300 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:32.831300 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:32.831300 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:32.831300 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:32:32.831300 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:32:32.831300 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:32:32.832206 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:32:32.832206 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:32.832206 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:32.832206 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:32.832206 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:32.832206 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:32.832206 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:32.832206 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:32.832206 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:32.832206 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:32.832206 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:32.832206 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:32.832206 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:32.832206 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:32.832206 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:32.832206 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:32.832206 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:32.833037 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:32:32.833037 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:32:32.833037 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:32:32.833037 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:32:32.833037 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:32:32.833037 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:32:32.833037 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:32:32.833037 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:32:32.837477 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 276/539] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Aug 29 22:32:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:32.839443 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c67c6ef-0e66-4779-a4a8-a01fad42d3c8 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:32.901852 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:33.019462 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c67c6ef-0e66-4779-a4a8-a01fad42d3c8 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:33.067513 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de01c028-a860-4ddd-870b-f00b90f4d7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:33.068203 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de01c028-a860-4ddd-870b-f00b90f4d7a2 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:33.068483 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de01c028-a860-4ddd-870b-f00b90f4d7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:33.068753 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de01c028-a860-4ddd-870b-f00b90f4d7a2 None admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:33.069525 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de01c028-a860-4ddd-870b-f00b90f4d7a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:33.069829 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de01c028-a860-4ddd-870b-f00b90f4d7a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:33.071932 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de01c028-a860-4ddd-870b-f00b90f4d7a2 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:33.096807 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 264/540] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Aug 29 22:32:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:33.103974 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be1a2b2-8dec-4b7f-80d0-319511c07a8c None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:33.237461 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be1a2b2-8dec-4b7f-80d0-319511c07a8c None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:33.274465 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaec3af-7625-494b-b3b8-3eae8ecb59a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:33.275067 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaec3af-7625-494b-b3b8-3eae8ecb59a3 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:33.275342 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaec3af-7625-494b-b3b8-3eae8ecb59a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:33.275609 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaec3af-7625-494b-b3b8-3eae8ecb59a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:33.276415 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaec3af-7625-494b-b3b8-3eae8ecb59a3 None admin] RBAC: Adding query filter params (role.id=938d531e06764249874d708978e7a0e9, scope.project.id=ce09f0beb1a342febbb4a8b3c7cf60c2, user.id=27abbf7b40e54fc091ebfe10aa6da90d) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:33.276717 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaec3af-7625-494b-b3b8-3eae8ecb59a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:33.278230 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaec3af-7625-494b-b3b8-3eae8ecb59a3 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:33.284777 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 277/541] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Aug 29 22:32:33 2022] GET /identity/v3/role_assignments?user.id=27abbf7b40e54fc091ebfe10aa6da90d&scope.project.id=ce09f0beb1a342febbb4a8b3c7cf60c2&role.id=938d531e06764249874d708978e7a0e9 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:32:33.573192 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1bd6a6-61da-46e9-af4b-5397d710e687 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:33.574272 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1bd6a6-61da-46e9-af4b-5397d710e687 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:33.574757 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1bd6a6-61da-46e9-af4b-5397d710e687 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:33.576540 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 265/542] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:32:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:32:33.582068 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33714a62-7221-4449-96ac-54b1c721e5fb None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:33.582897 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33714a62-7221-4449-96ac-54b1c721e5fb None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:33.583396 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33714a62-7221-4449-96ac-54b1c721e5fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:33.604194 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-33714a62-7221-4449-96ac-54b1c721e5fb None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:32:33.605796 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-33714a62-7221-4449-96ac-54b1c721e5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:33.640839 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:33.696385 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 278/543] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:32:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:32:33.702455 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db711169-0a89-46d7-8e53-38c8bdd0221d None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:33.703004 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db711169-0a89-46d7-8e53-38c8bdd0221d None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:33.703473 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db711169-0a89-46d7-8e53-38c8bdd0221d None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:33.705222 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 266/544] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:32:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:32:33.710507 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c192c68-1898-4a70-8fa2-98c4aee48c78 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:33.710915 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c192c68-1898-4a70-8fa2-98c4aee48c78 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:33.711196 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c192c68-1898-4a70-8fa2-98c4aee48c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:33.738716 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-1c192c68-1898-4a70-8fa2-98c4aee48c78 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:32:33.739910 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-1c192c68-1898-4a70-8fa2-98c4aee48c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:33.831928 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 279/545] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:32:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:32:34.079773 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db711169-0a89-46d7-8e53-38c8bdd0221d None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:34.211045 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:34.212571 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df78981-8c62-4bd9-9750-584f3fb5d342 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:34.212882 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df78981-8c62-4bd9-9750-584f3fb5d342 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:34.213160 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df78981-8c62-4bd9-9750-584f3fb5d342 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:34.214823 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 280/546] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:32:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:32:34.221352 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f5c6ae-0331-4427-b6e1-89656b2a4fe6 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:34.221649 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f5c6ae-0331-4427-b6e1-89656b2a4fe6 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:34.221920 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f5c6ae-0331-4427-b6e1-89656b2a4fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:34.227497 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db711169-0a89-46d7-8e53-38c8bdd0221d None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:34.262388 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-28f5c6ae-0331-4427-b6e1-89656b2a4fe6 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:32:34.263606 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-28f5c6ae-0331-4427-b6e1-89656b2a4fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:34.265388 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb1c2cd-af47-4d3d-b13b-789af4080e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:34.266038 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb1c2cd-af47-4d3d-b13b-789af4080e74 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:34.266321 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb1c2cd-af47-4d3d-b13b-789af4080e74 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:34.266600 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb1c2cd-af47-4d3d-b13b-789af4080e74 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:34.278579 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb1c2cd-af47-4d3d-b13b-789af4080e74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:32:34.283938 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-beb1c2cd-af47-4d3d-b13b-789af4080e74 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:32:34.283938 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:34.283938 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:34.283938 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:34.283938 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:34.283938 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:34.283938 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:34.283938 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:34.283938 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:34.283938 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:34.283938 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:34.283938 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:34.283938 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:32:34.283938 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:32:34.283938 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:32:34.283938 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:32:34.284803 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:32:34.284803 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:32:34.284803 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:32:34.284803 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:32:34.284803 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:34.284803 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:34.284803 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:34.284803 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:34.284803 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:34.284803 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:34.284803 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:34.284803 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:34.284803 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:34.284803 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:34.284803 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:34.284803 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:34.285614 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:34.285614 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:34.285614 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:34.285614 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:34.285614 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:32:34.285614 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:32:34.285614 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:32:34.285614 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:32:34.285614 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:32:34.285614 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:32:34.285614 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:32:34.285614 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:32:34.285614 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 267/547] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Aug 29 22:32:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:34.294539 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb1c2cd-af47-4d3d-b13b-789af4080e74 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:34.361749 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 281/548] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:32:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:32:34.362631 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f5c6ae-0331-4427-b6e1-89656b2a4fe6 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:34.412271 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:34.425801 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb1c2cd-af47-4d3d-b13b-789af4080e74 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:34.473442 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b983d1-6dc2-4583-98c7-7c5d0c3a5438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:34.474124 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b983d1-6dc2-4583-98c7-7c5d0c3a5438 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:34.474410 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b983d1-6dc2-4583-98c7-7c5d0c3a5438 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:34.474687 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b983d1-6dc2-4583-98c7-7c5d0c3a5438 None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:34.475364 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b983d1-6dc2-4583-98c7-7c5d0c3a5438 None admin] RBAC: Adding query filter params (name=service) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:34.475733 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b983d1-6dc2-4583-98c7-7c5d0c3a5438 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:34.477766 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b983d1-6dc2-4583-98c7-7c5d0c3a5438 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:34.498009 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 268/549] 10.222.0.47 () {56 vars in 1103 bytes} [Mon Aug 29 22:32:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:32:34.503355 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b983d1-6dc2-4583-98c7-7c5d0c3a5438 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:34.521722 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:34.583585 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f5c6ae-0331-4427-b6e1-89656b2a4fe6 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:34.646477 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050f77b4-4bdb-4f4a-ba3b-1f303a213ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:34.647096 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f77b4-4bdb-4f4a-ba3b-1f303a213ae2 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:34.647376 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f77b4-4bdb-4f4a-ba3b-1f303a213ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:34.647646 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f77b4-4bdb-4f4a-ba3b-1f303a213ae2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:34.653517 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b983d1-6dc2-4583-98c7-7c5d0c3a5438 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:34.672155 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050f77b4-4bdb-4f4a-ba3b-1f303a213ae2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:32:34.677059 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-050f77b4-4bdb-4f4a-ba3b-1f303a213ae2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:32:34.677059 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:34.677059 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:34.677059 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:34.677059 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:34.677059 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:34.677059 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:34.677059 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:34.677059 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:34.677059 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:34.677059 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:34.677059 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:34.677059 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:32:34.677059 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:32:34.677059 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:32:34.677059 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:32:34.677959 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:32:34.677959 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:32:34.677959 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:32:34.677959 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:32:34.677959 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:34.677959 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:34.677959 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:34.677959 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:34.677959 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:34.677959 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:34.677959 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:34.677959 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:34.677959 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:34.677959 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:34.677959 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:34.677959 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:34.678828 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:34.678828 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:34.678828 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:34.678828 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:34.678828 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:32:34.678828 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:32:34.678828 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:32:34.678828 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:32:34.678828 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:32:34.678828 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:32:34.678828 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:32:34.678828 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:32:34.678828 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 282/550] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Aug 29 22:32:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:34.686594 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050f77b4-4bdb-4f4a-ba3b-1f303a213ae2 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:34.724058 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eb4f0e-963d-4725-a598-635a5aaf4cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:34.724845 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb4f0e-963d-4725-a598-635a5aaf4cee None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:34.725082 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb4f0e-963d-4725-a598-635a5aaf4cee None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:34.725231 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb4f0e-963d-4725-a598-635a5aaf4cee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:34.746828 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eb4f0e-963d-4725-a598-635a5aaf4cee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:34.748289 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eb4f0e-963d-4725-a598-635a5aaf4cee None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:34.775240 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-26eb4f0e-963d-4725-a598-635a5aaf4cee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:34.775240 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:34.775240 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:34.775240 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:34.775240 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:34.775240 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:34.775240 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:34.775240 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:34.775240 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:34.775240 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:34.775240 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:34.775240 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:34.775240 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:32:34.775240 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:32:34.775240 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:32:34.775240 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:32:34.776374 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:34.776374 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:34.776374 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:34.776374 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:34.776374 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:34.776374 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:34.776374 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:34.776374 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:34.776374 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:34.776374 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:34.776374 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:34.776374 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:34.776374 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:34.776374 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:34.776374 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:34.776374 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:34.776374 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:32:34.777207 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:32:34.777207 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:34.777207 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:32:34.777207 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 269/551] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:32:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:32:34.778187 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eb4f0e-963d-4725-a598-635a5aaf4cee None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:34.828467 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:34.848722 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050f77b4-4bdb-4f4a-ba3b-1f303a213ae2 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:34.864811 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:34.899743 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f0974e-2319-4fd0-87b5-3d638bf610f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:34.900630 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f0974e-2319-4fd0-87b5-3d638bf610f7 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:34.900914 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f0974e-2319-4fd0-87b5-3d638bf610f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:34.901189 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f0974e-2319-4fd0-87b5-3d638bf610f7 None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:34.902152 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f0974e-2319-4fd0-87b5-3d638bf610f7 None admin] RBAC: Adding query filter params (name=service) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:34.902485 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f0974e-2319-4fd0-87b5-3d638bf610f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:34.904765 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f0974e-2319-4fd0-87b5-3d638bf610f7 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:34.909464 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eb4f0e-963d-4725-a598-635a5aaf4cee None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:34.921421 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 283/552] 10.222.0.47 () {56 vars in 1103 bytes} [Mon Aug 29 22:32:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:34.922299 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f0974e-2319-4fd0-87b5-3d638bf610f7 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:34.955032 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd57b84-610f-4a18-918e-4aca693daa67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:34.956003 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd57b84-610f-4a18-918e-4aca693daa67 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:34.956715 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd57b84-610f-4a18-918e-4aca693daa67 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:34.957243 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd57b84-610f-4a18-918e-4aca693daa67 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:34.971167 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd57b84-610f-4a18-918e-4aca693daa67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:32:34.979445 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-0fd57b84-610f-4a18-918e-4aca693daa67 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:32:34.979445 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:34.979445 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:34.979445 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:34.979445 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:34.979445 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:34.979445 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:34.979445 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:34.979445 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:34.979445 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:34.979445 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:34.979445 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:34.979445 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:32:34.979445 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:32:34.979445 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:32:34.979445 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:32:34.981465 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:32:34.981465 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:32:34.981465 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:32:34.981465 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:32:34.981465 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:34.981465 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:34.981465 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:34.981465 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:34.981465 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:34.981465 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:34.981465 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:34.981465 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:34.981465 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:34.981465 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:34.981465 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:34.981465 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:34.983238 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:34.983238 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:34.983238 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:34.983238 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:34.983238 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:32:34.983238 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:32:34.983238 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:32:34.983238 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:32:34.983238 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:32:34.983238 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:32:34.983238 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:32:34.983238 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:32:34.983238 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 270/553] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Aug 29 22:32:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:34.983238 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd57b84-610f-4a18-918e-4aca693daa67 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:35.058903 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f0974e-2319-4fd0-87b5-3d638bf610f7 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:35.106469 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3190f70d-5cc7-4f1d-be0b-57dd7179a71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:35.107515 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190f70d-5cc7-4f1d-be0b-57dd7179a71e None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:35.107798 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190f70d-5cc7-4f1d-be0b-57dd7179a71e None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:35.108388 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190f70d-5cc7-4f1d-be0b-57dd7179a71e None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:35.109045 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3190f70d-5cc7-4f1d-be0b-57dd7179a71e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:35.109621 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3190f70d-5cc7-4f1d-be0b-57dd7179a71e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:35.111827 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3190f70d-5cc7-4f1d-be0b-57dd7179a71e None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:35.120767 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd57b84-610f-4a18-918e-4aca693daa67 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:35.131324 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 284/554] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:32:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:35.134221 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3190f70d-5cc7-4f1d-be0b-57dd7179a71e None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:35.150926 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:35.158389 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:35.171120 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc066b2c-e419-4f63-99b1-26ba3ecdecc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:35.171960 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc066b2c-e419-4f63-99b1-26ba3ecdecc1 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:35.172242 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc066b2c-e419-4f63-99b1-26ba3ecdecc1 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:35.172517 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc066b2c-e419-4f63-99b1-26ba3ecdecc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:35.185379 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc066b2c-e419-4f63-99b1-26ba3ecdecc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:35.186870 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc066b2c-e419-4f63-99b1-26ba3ecdecc1 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:35.201929 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-dc066b2c-e419-4f63-99b1-26ba3ecdecc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:35.201929 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:35.201929 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:35.201929 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:35.201929 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:35.201929 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:35.201929 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:35.201929 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:35.201929 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:35.201929 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:35.201929 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:35.201929 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:35.201929 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:32:35.201929 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:32:35.201929 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:32:35.201929 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:32:35.202946 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:35.202946 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:35.202946 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:35.202946 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:35.202946 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:35.202946 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:35.202946 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:35.202946 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:35.202946 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:35.202946 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:35.202946 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:35.202946 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:35.202946 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:35.202946 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:35.202946 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:35.202946 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:35.202946 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:32:35.204072 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:32:35.204072 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:35.204072 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:32:35.204072 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 271/555] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:32:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:35.204072 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc066b2c-e419-4f63-99b1-26ba3ecdecc1 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:35.266336 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3190f70d-5cc7-4f1d-be0b-57dd7179a71e None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:35.305102 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3138890-ef55-41bf-80cf-6e3b506306df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:35.305764 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3138890-ef55-41bf-80cf-6e3b506306df None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:35.306043 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3138890-ef55-41bf-80cf-6e3b506306df None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:35.306317 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3138890-ef55-41bf-80cf-6e3b506306df None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:35.306988 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3138890-ef55-41bf-80cf-6e3b506306df None admin] RBAC: Adding query filter params (name=service) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:35.307288 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3138890-ef55-41bf-80cf-6e3b506306df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:35.308757 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3138890-ef55-41bf-80cf-6e3b506306df None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:35.322519 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 285/556] 10.222.0.47 () {56 vars in 1103 bytes} [Mon Aug 29 22:32:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:35.322519 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492d165-8ebe-4db0-b9f6-edb592089271 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:35.322519 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492d165-8ebe-4db0-b9f6-edb592089271 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:35.322519 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492d165-8ebe-4db0-b9f6-edb592089271 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:35.322519 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 286/557] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:32:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:32:35.322519 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8492d165-8ebe-4db0-b9f6-edb592089271 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:35.328102 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc066b2c-e419-4f63-99b1-26ba3ecdecc1 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:35.364772 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c640b6-cc1f-4b47-8b02-f3375100c038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:35.365431 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c640b6-cc1f-4b47-8b02-f3375100c038 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:35.365715 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c640b6-cc1f-4b47-8b02-f3375100c038 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:35.365991 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c640b6-cc1f-4b47-8b02-f3375100c038 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:35.374821 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c640b6-cc1f-4b47-8b02-f3375100c038 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:35.376278 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c640b6-cc1f-4b47-8b02-f3375100c038 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:35.387913 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-89c640b6-cc1f-4b47-8b02-f3375100c038 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 22:32:35.387913 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:35.387913 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:35.387913 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:35.387913 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:35.387913 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:35.387913 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:35.387913 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:35.387913 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:35.387913 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:35.387913 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:35.387913 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:35.387913 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:32:35.387913 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:32:35.387913 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:32:35.387913 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:32:35.389394 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:35.389394 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:35.389394 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:32:35.389394 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:32:35.389394 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:32:35.389394 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:32:35.389394 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:35.389394 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:35.389394 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:35.389394 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:35.389394 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:35.389394 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:35.389394 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:35.389394 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:35.389394 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:35.389394 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:35.389394 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:35.389394 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:35.390711 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:35.390711 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:35.390711 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:32:35.390711 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:32:35.390711 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:32:35.390711 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:32:35.390711 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:32:35.390711 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:32:35.390711 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 22:32:35.390711 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:32:35.390711 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 272/558] 10.222.0.47 () {56 vars in 1093 bytes} [Mon Aug 29 22:32:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:35.390711 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c640b6-cc1f-4b47-8b02-f3375100c038 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:35.422070 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:35.439212 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:35.468750 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8492d165-8ebe-4db0-b9f6-edb592089271 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:35.504630 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c640b6-cc1f-4b47-8b02-f3375100c038 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:35.507831 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb9297-4c7f-45e3-ad76-5e9981f73ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:35.508110 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb9297-4c7f-45e3-ad76-5e9981f73ae3 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:35.508428 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb9297-4c7f-45e3-ad76-5e9981f73ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:35.508698 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb9297-4c7f-45e3-ad76-5e9981f73ae3 None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:35.509425 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fb9297-4c7f-45e3-ad76-5e9981f73ae3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:35.509732 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fb9297-4c7f-45e3-ad76-5e9981f73ae3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:35.511101 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fb9297-4c7f-45e3-ad76-5e9981f73ae3 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:35.524092 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 287/559] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:32:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:35.525309 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0627affa-a3b1-4258-a3f7-4a59c8df186a None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:35.525629 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0627affa-a3b1-4258-a3f7-4a59c8df186a None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:35.525905 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0627affa-a3b1-4258-a3f7-4a59c8df186a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:35.545129 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-0627affa-a3b1-4258-a3f7-4a59c8df186a None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:32:35.546351 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-0627affa-a3b1-4258-a3f7-4a59c8df186a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:35.548450 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f566b643-4c7c-48ba-b2bd-f3c6c59be02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:35.549089 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566b643-4c7c-48ba-b2bd-f3c6c59be02b None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:35.549387 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566b643-4c7c-48ba-b2bd-f3c6c59be02b None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:35.549663 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566b643-4c7c-48ba-b2bd-f3c6c59be02b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:35.561610 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f566b643-4c7c-48ba-b2bd-f3c6c59be02b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:35.563084 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f566b643-4c7c-48ba-b2bd-f3c6c59be02b None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:35.577590 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-f566b643-4c7c-48ba-b2bd-f3c6c59be02b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:35.577590 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:35.577590 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:35.577590 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:35.577590 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:35.577590 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:35.577590 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:35.577590 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:35.577590 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:35.577590 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:35.577590 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:35.577590 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:35.577590 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:32:35.577590 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:32:35.577590 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:32:35.577590 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:32:35.578553 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:35.578553 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:35.578553 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:35.578553 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:35.578553 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:35.578553 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:35.578553 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:35.578553 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:35.578553 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:35.578553 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:35.578553 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:35.578553 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:35.578553 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:35.578553 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:35.578553 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:35.578553 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:35.578553 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:32:35.580024 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:32:35.580024 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:35.580024 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:32:35.580024 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 273/560] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:32:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:35.580024 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f566b643-4c7c-48ba-b2bd-f3c6c59be02b None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:35.618634 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 288/561] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:32:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:32:35.619612 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0627affa-a3b1-4258-a3f7-4a59c8df186a None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:35.680096 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:35.681719 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:35.691583 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f566b643-4c7c-48ba-b2bd-f3c6c59be02b None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:35.725071 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0627affa-a3b1-4258-a3f7-4a59c8df186a None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:35.726871 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42cae5a-9ddf-408d-8ba2-5cc8b807914a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:35.727481 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42cae5a-9ddf-408d-8ba2-5cc8b807914a None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:35.727755 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42cae5a-9ddf-408d-8ba2-5cc8b807914a None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:35.728028 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42cae5a-9ddf-408d-8ba2-5cc8b807914a None admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:35.728756 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42cae5a-9ddf-408d-8ba2-5cc8b807914a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:35.729056 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42cae5a-9ddf-408d-8ba2-5cc8b807914a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:35.730515 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42cae5a-9ddf-408d-8ba2-5cc8b807914a None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:35.750533 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 274/562] 10.222.0.47 () {56 vars in 1133 bytes} [Mon Aug 29 22:32:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:35.751751 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c2018-e9f2-40a1-9bdc-3d52f9b97686 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:35.752036 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c2018-e9f2-40a1-9bdc-3d52f9b97686 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:35.752305 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c2018-e9f2-40a1-9bdc-3d52f9b97686 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:35.758079 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 275/563] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:32:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:32:35.759168 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453c2018-e9f2-40a1-9bdc-3d52f9b97686 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:35.768393 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec557f7-7991-4acf-9942-92f3f253f3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:35.769260 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec557f7-7991-4acf-9942-92f3f253f3ba None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:35.769904 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec557f7-7991-4acf-9942-92f3f253f3ba None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:35.770174 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec557f7-7991-4acf-9942-92f3f253f3ba None admin] PATH_INFO: `/v3/users/swift` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:35.778752 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec557f7-7991-4acf-9942-92f3f253f3ba None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:35.780282 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec557f7-7991-4acf-9942-92f3f253f3ba None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:35.793195 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-aec557f7-7991-4acf-9942-92f3f253f3ba None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 22:32:35.793195 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:35.793195 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:35.793195 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:35.793195 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:35.793195 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:35.793195 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:35.793195 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:35.793195 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:35.793195 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:35.793195 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:35.793195 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:35.793195 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:32:35.793195 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:32:35.793195 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:32:35.793195 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:32:35.794379 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:35.794379 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:35.794379 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:32:35.794379 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:32:35.794379 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:32:35.794379 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:32:35.794379 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:35.794379 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:35.794379 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:35.794379 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:35.794379 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:35.794379 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:35.794379 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:35.794379 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:35.794379 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:35.794379 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:35.794379 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:35.794379 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:35.795894 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:35.795894 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:35.795894 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:32:35.795894 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:32:35.795894 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:32:35.795894 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:32:35.795894 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:32:35.795894 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:32:35.795894 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 22:32:35.795894 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:32:35.795894 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 289/564] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Aug 29 22:32:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:35.795894 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec557f7-7991-4acf-9942-92f3f253f3ba None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:35.874968 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453c2018-e9f2-40a1-9bdc-3d52f9b97686 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:35.901959 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec557f7-7991-4acf-9942-92f3f253f3ba None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:35.910734 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827702d2-bf54-4b83-bbc3-006ae76ebe18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:35.911347 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827702d2-bf54-4b83-bbc3-006ae76ebe18 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:35.911625 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827702d2-bf54-4b83-bbc3-006ae76ebe18 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:35.911900 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827702d2-bf54-4b83-bbc3-006ae76ebe18 None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:35.912531 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827702d2-bf54-4b83-bbc3-006ae76ebe18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:35.912832 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827702d2-bf54-4b83-bbc3-006ae76ebe18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:35.914345 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827702d2-bf54-4b83-bbc3-006ae76ebe18 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:35.922456 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:35.926390 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 276/565] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:32:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:35.927669 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe11d17b-42cf-4687-82c7-52444c98f7bf None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:35.927965 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe11d17b-42cf-4687-82c7-52444c98f7bf None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:35.928238 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe11d17b-42cf-4687-82c7-52444c98f7bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:35.941308 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f1fb4e-f91c-463c-9249-0cfbb9c73637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:35.941962 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f1fb4e-f91c-463c-9249-0cfbb9c73637 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:35.942242 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f1fb4e-f91c-463c-9249-0cfbb9c73637 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:35.942515 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f1fb4e-f91c-463c-9249-0cfbb9c73637 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:35.946637 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-fe11d17b-42cf-4687-82c7-52444c98f7bf None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:32:35.947854 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-fe11d17b-42cf-4687-82c7-52444c98f7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:35.949972 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:35.954658 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f1fb4e-f91c-463c-9249-0cfbb9c73637 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:35.956127 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f1fb4e-f91c-463c-9249-0cfbb9c73637 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:35.971206 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-34f1fb4e-f91c-463c-9249-0cfbb9c73637 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:35.971206 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:35.971206 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:35.971206 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:35.971206 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:35.971206 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:35.971206 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:35.971206 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:35.971206 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:35.971206 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:35.971206 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:35.971206 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:35.971206 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:32:35.971206 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:32:35.971206 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:32:35.971206 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:32:35.972139 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:35.972139 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:35.972139 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:35.972139 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:35.972139 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:35.972139 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:35.972139 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:35.972139 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:35.972139 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:35.972139 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:35.972139 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:35.972139 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:35.972139 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:35.972139 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:35.972139 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:35.972139 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:35.972139 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:32:35.973029 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:32:35.973029 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:35.973029 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:32:35.973029 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 290/566] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:32:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:35.973848 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f1fb4e-f91c-463c-9249-0cfbb9c73637 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:36.026754 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 277/567] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:32:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:32:36.027602 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe11d17b-42cf-4687-82c7-52444c98f7bf None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:36.083843 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f1fb4e-f91c-463c-9249-0cfbb9c73637 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:36.118655 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9c2b34-ec42-4baf-8cb6-7f0a23847ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:36.119262 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c2b34-ec42-4baf-8cb6-7f0a23847ac5 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:36.119543 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c2b34-ec42-4baf-8cb6-7f0a23847ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:36.119817 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c2b34-ec42-4baf-8cb6-7f0a23847ac5 None admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:36.120548 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9c2b34-ec42-4baf-8cb6-7f0a23847ac5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:36.120852 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9c2b34-ec42-4baf-8cb6-7f0a23847ac5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:36.122323 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9c2b34-ec42-4baf-8cb6-7f0a23847ac5 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:36.139661 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe11d17b-42cf-4687-82c7-52444c98f7bf None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:36.145117 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 291/568] 10.222.0.47 () {56 vars in 1135 bytes} [Mon Aug 29 22:32:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:36.145117 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9c2b34-ec42-4baf-8cb6-7f0a23847ac5 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:36.175948 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:36.183680 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe2240-a85a-4ade-af3e-cc43e343e35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:36.184322 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe2240-a85a-4ade-af3e-cc43e343e35f None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:36.184604 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe2240-a85a-4ade-af3e-cc43e343e35f None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:36.184880 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe2240-a85a-4ade-af3e-cc43e343e35f None admin] PATH_INFO: `/v3/roles/service` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:36.192587 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:36.197073 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fe2240-a85a-4ade-af3e-cc43e343e35f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:32:36.203115 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-75fe2240-a85a-4ade-af3e-cc43e343e35f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:32:36.203115 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:36.203115 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:36.203115 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:36.203115 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:36.203115 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:36.203115 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:36.203115 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:36.203115 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:36.203115 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:36.203115 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:36.203115 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:36.203115 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:32:36.203115 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:32:36.203115 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:32:36.203115 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:32:36.204065 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:32:36.204065 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:32:36.204065 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:32:36.204065 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:32:36.204065 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:36.204065 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:36.204065 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:36.204065 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:36.204065 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:36.204065 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:36.204065 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:36.204065 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:36.204065 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:36.204065 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:36.204065 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:36.204065 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:36.204890 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:36.204890 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:36.204890 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:36.204890 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:36.204890 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:32:36.204890 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:32:36.204890 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:32:36.204890 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:32:36.204890 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:32:36.204890 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:32:36.204890 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:32:36.204890 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:32:36.204890 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 278/569] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Aug 29 22:32:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:36.205613 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe2240-a85a-4ade-af3e-cc43e343e35f None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:36.260273 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9c2b34-ec42-4baf-8cb6-7f0a23847ac5 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:36.299949 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e09117d-af6e-43c3-97b8-17cb9d745a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:36.300806 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e09117d-af6e-43c3-97b8-17cb9d745a19 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:36.301252 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e09117d-af6e-43c3-97b8-17cb9d745a19 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:36.301647 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e09117d-af6e-43c3-97b8-17cb9d745a19 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:36.310757 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e09117d-af6e-43c3-97b8-17cb9d745a19 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:36.312198 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e09117d-af6e-43c3-97b8-17cb9d745a19 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:36.324712 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-8e09117d-af6e-43c3-97b8-17cb9d745a19 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 29 22:32:36.324712 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:36.324712 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:36.324712 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:36.324712 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:36.324712 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:36.324712 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:36.324712 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:36.324712 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:36.324712 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:36.324712 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:36.324712 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:36.324712 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:32:36.324712 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:32:36.324712 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:32:36.324712 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:32:36.325867 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:36.325867 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:36.325867 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:32:36.325867 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:32:36.325867 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:32:36.325867 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:32:36.325867 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:36.325867 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:36.325867 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:36.325867 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:36.325867 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:36.325867 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:36.325867 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:36.325867 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:36.325867 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:36.325867 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:36.325867 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:36.325867 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:36.326891 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:36.326891 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:36.326891 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:32:36.326891 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:32:36.326891 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:32:36.326891 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:32:36.326891 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:32:36.326891 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:32:36.326891 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 29 22:32:36.326891 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:32:36.327408 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe2240-a85a-4ade-af3e-cc43e343e35f None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:36.327489 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 292/570] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Aug 29 22:32:36 2022] GET /identity/v3/users/glance => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:36.327731 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e09117d-af6e-43c3-97b8-17cb9d745a19 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:36.362103 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62357677-07db-4ded-b25e-287ee23efa05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:36.362632 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62357677-07db-4ded-b25e-287ee23efa05 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:36.362922 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62357677-07db-4ded-b25e-287ee23efa05 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:36.363191 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62357677-07db-4ded-b25e-287ee23efa05 None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:36.363834 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62357677-07db-4ded-b25e-287ee23efa05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:36.364137 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62357677-07db-4ded-b25e-287ee23efa05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:36.365543 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62357677-07db-4ded-b25e-287ee23efa05 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:36.378233 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 279/571] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:32:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:36.378837 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62357677-07db-4ded-b25e-287ee23efa05 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:36.426014 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:36.436290 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e09117d-af6e-43c3-97b8-17cb9d745a19 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:36.439289 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:36.470561 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c8cc67-2289-46e4-85f8-49c5777f0a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:36.471158 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8cc67-2289-46e4-85f8-49c5777f0a05 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:36.471432 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8cc67-2289-46e4-85f8-49c5777f0a05 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:36.471710 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8cc67-2289-46e4-85f8-49c5777f0a05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:36.481680 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62357677-07db-4ded-b25e-287ee23efa05 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:36.515777 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb6371f-f5da-4f69-a9d1-5b0c94ff60ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:36.516391 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6371f-f5da-4f69-a9d1-5b0c94ff60ab None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:36.516675 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6371f-f5da-4f69-a9d1-5b0c94ff60ab None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:36.516959 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6371f-f5da-4f69-a9d1-5b0c94ff60ab None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:36.517643 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb6371f-f5da-4f69-a9d1-5b0c94ff60ab None admin] RBAC: Adding query filter params (name=service) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:36.517948 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb6371f-f5da-4f69-a9d1-5b0c94ff60ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:36.519319 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb6371f-f5da-4f69-a9d1-5b0c94ff60ab None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:36.528003 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 280/572] 10.222.0.47 () {56 vars in 1103 bytes} [Mon Aug 29 22:32:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:36.528800 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb6371f-f5da-4f69-a9d1-5b0c94ff60ab None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:36.541025 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c8cc67-2289-46e4-85f8-49c5777f0a05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:36.542507 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c8cc67-2289-46e4-85f8-49c5777f0a05 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:36.631643 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb6371f-f5da-4f69-a9d1-5b0c94ff60ab None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:36.633406 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:36.644496 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 293/573] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Aug 29 22:32:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:32:36.645310 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c8cc67-2289-46e4-85f8-49c5777f0a05 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:36.652524 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:36.667700 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b004d47f-643d-421a-b6f9-9f2314c8f480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:36.668422 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b004d47f-643d-421a-b6f9-9f2314c8f480 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:36.668702 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b004d47f-643d-421a-b6f9-9f2314c8f480 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:36.668979 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b004d47f-643d-421a-b6f9-9f2314c8f480 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:36.678967 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b004d47f-643d-421a-b6f9-9f2314c8f480 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:32:36.685030 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-b004d47f-643d-421a-b6f9-9f2314c8f480 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:32:36.685030 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:36.685030 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:36.685030 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:36.685030 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:36.685030 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:36.685030 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:36.685030 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:36.685030 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:36.685030 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:36.685030 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:36.685030 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:36.685030 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:32:36.685030 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:32:36.685030 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:32:36.685030 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:32:36.686514 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:32:36.686514 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:32:36.686514 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:32:36.686514 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:32:36.686514 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:36.686514 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:36.686514 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:36.686514 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:36.686514 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:36.686514 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:36.686514 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:36.686514 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:36.686514 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:36.686514 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:36.686514 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:36.686514 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:36.687326 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:36.687326 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:36.687326 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:36.687326 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:36.687326 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:32:36.687326 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:32:36.687326 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:32:36.687326 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:32:36.687326 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:32:36.687326 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:32:36.687326 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:32:36.687326 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:32:36.687326 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 281/574] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Aug 29 22:32:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:36.687326 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b004d47f-643d-421a-b6f9-9f2314c8f480 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:36.748834 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c8cc67-2289-46e4-85f8-49c5777f0a05 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:36.782975 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28437fe7-eaf5-4493-bb91-35cd70903c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:36.783569 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28437fe7-eaf5-4493-bb91-35cd70903c08 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:36.783847 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28437fe7-eaf5-4493-bb91-35cd70903c08 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:36.784117 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28437fe7-eaf5-4493-bb91-35cd70903c08 None admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:36.784838 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28437fe7-eaf5-4493-bb91-35cd70903c08 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:36.785139 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28437fe7-eaf5-4493-bb91-35cd70903c08 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:36.786601 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28437fe7-eaf5-4493-bb91-35cd70903c08 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:36.790609 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b004d47f-643d-421a-b6f9-9f2314c8f480 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:36.803915 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 294/575] 10.222.0.47 () {56 vars in 1137 bytes} [Mon Aug 29 22:32:36 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:36.804948 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28437fe7-eaf5-4493-bb91-35cd70903c08 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:36.825108 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c458e-d2fb-474a-975b-65ab4db7f040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:36.825780 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c458e-d2fb-474a-975b-65ab4db7f040 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:36.826069 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c458e-d2fb-474a-975b-65ab4db7f040 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:36.826348 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c458e-d2fb-474a-975b-65ab4db7f040 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:36.833044 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3c458e-d2fb-474a-975b-65ab4db7f040 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:36.834605 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3c458e-d2fb-474a-975b-65ab4db7f040 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:36.847417 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-4e3c458e-d2fb-474a-975b-65ab4db7f040 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:32:36.847417 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:36.847417 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:36.847417 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:36.847417 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:36.847417 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:36.847417 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:36.847417 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:36.847417 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:36.847417 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:36.847417 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:36.847417 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:36.847417 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:32:36.847417 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:32:36.847417 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:32:36.848474 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:32:36.848474 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:36.848474 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:36.848474 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:36.848474 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:36.848474 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:36.848474 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:36.848474 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:36.848474 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:36.848474 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:36.848474 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:36.848474 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:36.848474 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:36.848474 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:36.848474 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:36.848474 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:36.848474 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:36.849492 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:32:36.849492 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:32:36.849492 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:32:36.849492 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:32:36.849492 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:32:36.849492 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:32:36.849492 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:32:36.849492 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:32:36.849492 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 282/576] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Aug 29 22:32:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:36.850054 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c458e-d2fb-474a-975b-65ab4db7f040 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:36.860544 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:36.893848 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:36.913052 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28437fe7-eaf5-4493-bb91-35cd70903c08 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:36.947873 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e79181c-da8a-4f49-aef6-d77da4b3aba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:36.948498 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e79181c-da8a-4f49-aef6-d77da4b3aba6 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:36.948779 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e79181c-da8a-4f49-aef6-d77da4b3aba6 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:36.949048 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e79181c-da8a-4f49-aef6-d77da4b3aba6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:36.952277 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c458e-d2fb-474a-975b-65ab4db7f040 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:36.958958 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e79181c-da8a-4f49-aef6-d77da4b3aba6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:36.960922 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e79181c-da8a-4f49-aef6-d77da4b3aba6 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:36.975770 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-9e79181c-da8a-4f49-aef6-d77da4b3aba6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:36.975770 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:36.975770 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:36.975770 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:36.975770 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:36.975770 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:36.975770 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:36.975770 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:36.975770 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:36.975770 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:36.975770 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:36.975770 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:36.975770 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:32:36.975770 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:32:36.975770 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:32:36.975770 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:32:36.977628 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:36.977628 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:36.977628 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:36.977628 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:36.977628 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:36.977628 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:36.977628 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:36.977628 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:36.977628 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:36.977628 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:36.977628 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:36.977628 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:36.977628 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:36.977628 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:36.977628 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:36.977628 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:36.977628 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:32:36.978877 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:32:36.978877 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:36.978877 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:32:36.978877 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 295/577] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:32:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:36.978877 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e79181c-da8a-4f49-aef6-d77da4b3aba6 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:36.992738 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74455ad7-38b0-4771-97fb-02f155f1cc15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:36.993531 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74455ad7-38b0-4771-97fb-02f155f1cc15 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:36.993705 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74455ad7-38b0-4771-97fb-02f155f1cc15 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:36.993980 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74455ad7-38b0-4771-97fb-02f155f1cc15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:37.004565 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74455ad7-38b0-4771-97fb-02f155f1cc15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:37.006046 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74455ad7-38b0-4771-97fb-02f155f1cc15 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:37.022439 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-74455ad7-38b0-4771-97fb-02f155f1cc15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:37.022439 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:37.022439 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:37.022439 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:37.022439 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:37.022439 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:37.022439 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:37.022439 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:37.022439 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:37.022439 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:37.022439 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:37.022439 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:37.022439 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:32:37.022439 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:32:37.022439 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:32:37.022439 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:32:37.024343 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:37.024343 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:37.024343 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:37.024343 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:37.024343 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:37.024343 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:37.024343 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:37.024343 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:37.024343 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:37.024343 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:37.024343 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:37.024343 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:37.024343 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:37.024343 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:37.024343 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:37.024343 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:37.024343 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:32:37.025401 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:32:37.025401 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:37.025401 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:32:37.025401 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 283/578] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:32:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:37.025807 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74455ad7-38b0-4771-97fb-02f155f1cc15 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:37.086187 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:37.089300 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e79181c-da8a-4f49-aef6-d77da4b3aba6 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:37.123923 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e8a085-a315-4d00-9124-b940b24fdf7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:37.124519 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8a085-a315-4d00-9124-b940b24fdf7c None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:37.124796 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8a085-a315-4d00-9124-b940b24fdf7c None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:37.125066 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8a085-a315-4d00-9124-b940b24fdf7c None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:37.125759 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e8a085-a315-4d00-9124-b940b24fdf7c None admin] RBAC: Adding query filter params (name=service) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:37.126061 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e8a085-a315-4d00-9124-b940b24fdf7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:37.127425 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e8a085-a315-4d00-9124-b940b24fdf7c None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:37.127964 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:37.136095 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 296/579] 10.222.0.47 () {56 vars in 1103 bytes} [Mon Aug 29 22:32:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:37.136887 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e8a085-a315-4d00-9124-b940b24fdf7c None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:37.138246 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74455ad7-38b0-4771-97fb-02f155f1cc15 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:37.174451 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba751b6b-2ba4-4a4d-8671-bef03ceb501a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:37.175003 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba751b6b-2ba4-4a4d-8671-bef03ceb501a None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:37.175282 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba751b6b-2ba4-4a4d-8671-bef03ceb501a None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:37.175555 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba751b6b-2ba4-4a4d-8671-bef03ceb501a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:37.186217 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba751b6b-2ba4-4a4d-8671-bef03ceb501a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:37.187670 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba751b6b-2ba4-4a4d-8671-bef03ceb501a None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:37.202201 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-ba751b6b-2ba4-4a4d-8671-bef03ceb501a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:37.202201 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:37.202201 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:37.202201 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:37.202201 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:37.202201 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:37.202201 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:37.202201 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:37.202201 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:37.202201 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:37.202201 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:37.202201 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:37.202201 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:32:37.202201 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:32:37.202201 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:32:37.202201 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:32:37.203271 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:37.203271 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:37.203271 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:37.203271 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:37.203271 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:37.203271 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:37.203271 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:37.203271 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:37.203271 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:37.203271 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:37.203271 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:37.203271 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:37.203271 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:37.203271 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:37.203271 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:37.203271 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:37.203271 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:32:37.204359 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:32:37.204359 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:37.204359 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:32:37.208118 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 284/580] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:32:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:37.208930 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba751b6b-2ba4-4a4d-8671-bef03ceb501a None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:37.239560 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e8a085-a315-4d00-9124-b940b24fdf7c None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:37.274462 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa34d5aa-b222-4e35-9692-06df4062c8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:37.274945 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34d5aa-b222-4e35-9692-06df4062c8e5 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:37.275221 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34d5aa-b222-4e35-9692-06df4062c8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:37.275488 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34d5aa-b222-4e35-9692-06df4062c8e5 None admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:37.276191 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa34d5aa-b222-4e35-9692-06df4062c8e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:37.276495 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa34d5aa-b222-4e35-9692-06df4062c8e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:37.277970 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa34d5aa-b222-4e35-9692-06df4062c8e5 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:37.291309 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 297/581] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Aug 29 22:32:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:37.292108 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa34d5aa-b222-4e35-9692-06df4062c8e5 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:37.312700 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba751b6b-2ba4-4a4d-8671-bef03ceb501a None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:37.316475 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:37.349035 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a287e-868c-4256-b729-304534c72517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:37.349676 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a287e-868c-4256-b729-304534c72517 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:37.349959 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a287e-868c-4256-b729-304534c72517 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:37.350230 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a287e-868c-4256-b729-304534c72517 None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:37.350865 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7a287e-868c-4256-b729-304534c72517 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:37.351324 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7a287e-868c-4256-b729-304534c72517 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:37.352702 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7a287e-868c-4256-b729-304534c72517 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:37.364473 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 285/582] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:32:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:37.365075 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a287e-868c-4256-b729-304534c72517 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:37.372005 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:37.394374 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa34d5aa-b222-4e35-9692-06df4062c8e5 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:37.430053 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3eaaf5-65e1-42e8-bba2-f5e64a03df6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:37.430053 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3eaaf5-65e1-42e8-bba2-f5e64a03df6c None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:37.430338 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3eaaf5-65e1-42e8-bba2-f5e64a03df6c None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:37.430575 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3eaaf5-65e1-42e8-bba2-f5e64a03df6c None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:37.431213 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3eaaf5-65e1-42e8-bba2-f5e64a03df6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:37.431513 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3eaaf5-65e1-42e8-bba2-f5e64a03df6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:37.432885 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3eaaf5-65e1-42e8-bba2-f5e64a03df6c None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:37.443841 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 298/583] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:32:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:37.444628 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3eaaf5-65e1-42e8-bba2-f5e64a03df6c None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:37.472992 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a287e-868c-4256-b729-304534c72517 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:37.508082 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9da000-b4d3-4955-ba3d-dbcf25351e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:37.508991 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9da000-b4d3-4955-ba3d-dbcf25351e37 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:37.509274 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9da000-b4d3-4955-ba3d-dbcf25351e37 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:37.509580 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9da000-b4d3-4955-ba3d-dbcf25351e37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:37.520063 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9da000-b4d3-4955-ba3d-dbcf25351e37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:37.521537 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9da000-b4d3-4955-ba3d-dbcf25351e37 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:37.530351 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:37.537584 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-2b9da000-b4d3-4955-ba3d-dbcf25351e37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:37.537584 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:37.537584 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:37.537584 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:37.537584 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:37.537584 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:37.537584 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:37.537584 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:37.537584 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:37.537584 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:37.537584 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:37.537584 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:37.537584 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:32:37.537584 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:32:37.537584 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:32:37.537584 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:32:37.539513 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:37.539513 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:37.539513 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:37.539513 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:37.539513 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:37.539513 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:37.539513 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:37.539513 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:37.539513 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:37.539513 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:37.539513 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:37.539513 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:37.539513 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:37.539513 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:37.539513 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:37.539513 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:37.539513 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:32:37.540469 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:32:37.540469 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:37.540469 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:32:37.540469 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 286/584] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:32:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:37.540469 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9da000-b4d3-4955-ba3d-dbcf25351e37 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:37.555005 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3eaaf5-65e1-42e8-bba2-f5e64a03df6c None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:37.588900 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cedf25-3429-4c5b-9b0c-9910896dbe87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:37.589533 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cedf25-3429-4c5b-9b0c-9910896dbe87 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:37.589814 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cedf25-3429-4c5b-9b0c-9910896dbe87 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:37.590090 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cedf25-3429-4c5b-9b0c-9910896dbe87 None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:37.590723 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cedf25-3429-4c5b-9b0c-9910896dbe87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:37.591020 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cedf25-3429-4c5b-9b0c-9910896dbe87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:37.592385 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cedf25-3429-4c5b-9b0c-9910896dbe87 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:37.597274 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:37.604861 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 299/585] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:32:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:37.605722 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cedf25-3429-4c5b-9b0c-9910896dbe87 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:37.643106 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9da000-b4d3-4955-ba3d-dbcf25351e37 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:37.677586 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92647ad1-2f81-4e47-a4fe-a823cfebbabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:37.678241 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92647ad1-2f81-4e47-a4fe-a823cfebbabe None admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:37.678520 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92647ad1-2f81-4e47-a4fe-a823cfebbabe None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:37.678792 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92647ad1-2f81-4e47-a4fe-a823cfebbabe None admin] PATH_INFO: `/v3/projects/ce09f0beb1a342febbb4a8b3c7cf60c2/users/35441c061e514b1b9341e7694ec2c0bc/roles/938d531e06764249874d708978e7a0e9` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:37.693087 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92647ad1-2f81-4e47-a4fe-a823cfebbabe None admin] RBAC: Authorizing `identity:create_grant(project_id=ce09f0beb1a342febbb4a8b3c7cf60c2, user_id=35441c061e514b1b9341e7694ec2c0bc, role_id=938d531e06764249874d708978e7a0e9)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:37.694599 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92647ad1-2f81-4e47-a4fe-a823cfebbabe None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:37.705136 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cedf25-3429-4c5b-9b0c-9910896dbe87 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:37.711946 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 287/586] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Aug 29 22:32:37 2022] PUT /identity/v3/projects/ce09f0beb1a342febbb4a8b3c7cf60c2/users/35441c061e514b1b9341e7694ec2c0bc/roles/938d531e06764249874d708978e7a0e9 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:32:37.712614 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92647ad1-2f81-4e47-a4fe-a823cfebbabe None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:37.743974 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a83a69-535d-4150-89f0-9eaaac02583f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:37.744888 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a83a69-535d-4150-89f0-9eaaac02583f None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:37.744888 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a83a69-535d-4150-89f0-9eaaac02583f None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:37.745156 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a83a69-535d-4150-89f0-9eaaac02583f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:37.753810 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a83a69-535d-4150-89f0-9eaaac02583f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:37.755366 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a83a69-535d-4150-89f0-9eaaac02583f None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:37.769090 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-b9a83a69-535d-4150-89f0-9eaaac02583f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 22:32:37.769090 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:37.769090 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:37.769090 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:37.769090 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:37.769090 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:37.769090 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:37.769090 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:37.769090 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:37.769090 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:37.769090 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:37.769090 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:37.769090 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:32:37.769090 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:32:37.769090 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:32:37.769090 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:32:37.770329 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:37.770329 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:37.770329 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:32:37.770329 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:32:37.770329 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:32:37.770329 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:32:37.770329 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:37.770329 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:37.770329 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:37.770329 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:37.770329 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:37.770329 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:37.770329 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:37.770329 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:37.770329 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:37.770329 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:37.770329 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:37.770329 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:37.771443 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:37.771443 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:37.771443 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:32:37.771443 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:32:37.771443 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:32:37.771443 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:32:37.771443 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:32:37.771443 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:32:37.771443 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 22:32:37.771443 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:32:37.771443 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 300/587] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Aug 29 22:32:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:37.771443 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a83a69-535d-4150-89f0-9eaaac02583f None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:37.775120 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:37.841016 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92647ad1-2f81-4e47-a4fe-a823cfebbabe None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:37.849012 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:37.886040 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb22f4-9f83-4da2-a6f8-7659f115838d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:37.886679 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb22f4-9f83-4da2-a6f8-7659f115838d None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:37.886946 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb22f4-9f83-4da2-a6f8-7659f115838d None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:37.887213 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb22f4-9f83-4da2-a6f8-7659f115838d None admin] PATH_INFO: `/v3/projects/service` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:37.894551 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eb22f4-9f83-4da2-a6f8-7659f115838d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:37.895985 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eb22f4-9f83-4da2-a6f8-7659f115838d None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:37.897753 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a83a69-535d-4150-89f0-9eaaac02583f None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:37.908243 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-94eb22f4-9f83-4da2-a6f8-7659f115838d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:32:37.908243 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:37.908243 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:37.908243 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:37.908243 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:37.908243 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:37.908243 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:37.908243 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:37.908243 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:37.908243 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:37.908243 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:37.908243 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:37.908243 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:32:37.908243 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:32:37.908243 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:32:37.909290 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:32:37.909290 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:37.909290 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:37.909290 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:37.909290 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:37.909290 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:37.909290 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:37.909290 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:37.909290 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:37.909290 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:37.909290 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:37.909290 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:37.909290 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:37.909290 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:37.909290 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:37.909290 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:37.909290 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:37.910330 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:32:37.910330 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:32:37.910330 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:32:37.910330 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:32:37.910330 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:32:37.910330 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:32:37.910330 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:32:37.910330 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:32:37.910330 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 288/588] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Aug 29 22:32:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:37.910330 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb22f4-9f83-4da2-a6f8-7659f115838d None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:37.938881 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e89104-eec0-4de7-b8f5-e52b04a86df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:37.939734 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e89104-eec0-4de7-b8f5-e52b04a86df0 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:37.940294 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e89104-eec0-4de7-b8f5-e52b04a86df0 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:37.940705 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e89104-eec0-4de7-b8f5-e52b04a86df0 None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:37.941605 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e89104-eec0-4de7-b8f5-e52b04a86df0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:37.942057 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e89104-eec0-4de7-b8f5-e52b04a86df0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:37.943764 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e89104-eec0-4de7-b8f5-e52b04a86df0 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:37.957393 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 301/589] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:32:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:37.958515 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e89104-eec0-4de7-b8f5-e52b04a86df0 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:38.026481 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:38.033476 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb22f4-9f83-4da2-a6f8-7659f115838d None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:38.068193 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e89104-eec0-4de7-b8f5-e52b04a86df0 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:38.072760 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3445e344-a0e3-4d3b-a656-2f0cd6435c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:38.073496 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3445e344-a0e3-4d3b-a656-2f0cd6435c2b None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:38.073856 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3445e344-a0e3-4d3b-a656-2f0cd6435c2b None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:38.074192 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3445e344-a0e3-4d3b-a656-2f0cd6435c2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:38.081524 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3445e344-a0e3-4d3b-a656-2f0cd6435c2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:38.083225 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3445e344-a0e3-4d3b-a656-2f0cd6435c2b None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:38.095916 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-3445e344-a0e3-4d3b-a656-2f0cd6435c2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:32:38.095916 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:38.095916 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:38.095916 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:38.095916 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:38.095916 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:38.095916 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:38.095916 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:38.095916 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:38.095916 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:38.095916 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:38.095916 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:38.095916 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:32:38.095916 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:32:38.095916 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:32:38.096959 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:32:38.096959 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:38.096959 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:38.096959 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:38.096959 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:38.096959 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:38.096959 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:38.096959 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:38.096959 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:38.096959 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:38.096959 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:38.096959 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:38.096959 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:38.096959 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:38.096959 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:38.096959 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:38.096959 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:38.098073 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:32:38.098073 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:32:38.098073 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:32:38.098073 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:32:38.098073 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:32:38.098073 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:32:38.098073 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:32:38.098073 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:32:38.103447 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 289/590] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Aug 29 22:32:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:38.103447 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3445e344-a0e3-4d3b-a656-2f0cd6435c2b None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:38.115289 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad361f4-c0c1-4af7-83bb-eaa99adb7ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:38.115907 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad361f4-c0c1-4af7-83bb-eaa99adb7ca0 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:38.116188 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad361f4-c0c1-4af7-83bb-eaa99adb7ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:38.116468 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad361f4-c0c1-4af7-83bb-eaa99adb7ca0 None admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:38.117710 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad361f4-c0c1-4af7-83bb-eaa99adb7ca0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:38.118016 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad361f4-c0c1-4af7-83bb-eaa99adb7ca0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:38.119487 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad361f4-c0c1-4af7-83bb-eaa99adb7ca0 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:38.136664 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:38.138620 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 302/591] 10.222.0.47 () {56 vars in 1137 bytes} [Mon Aug 29 22:32:37 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:38.139275 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad361f4-c0c1-4af7-83bb-eaa99adb7ca0 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:38.227979 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3445e344-a0e3-4d3b-a656-2f0cd6435c2b None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:38.249757 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad361f4-c0c1-4af7-83bb-eaa99adb7ca0 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:38.264602 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c36d71-c93b-41f6-a384-66dc8519e187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:38.265219 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c36d71-c93b-41f6-a384-66dc8519e187 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:38.265565 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c36d71-c93b-41f6-a384-66dc8519e187 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:38.265853 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c36d71-c93b-41f6-a384-66dc8519e187 None admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:38.266551 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c36d71-c93b-41f6-a384-66dc8519e187 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:38.266881 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c36d71-c93b-41f6-a384-66dc8519e187 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:38.268322 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c36d71-c93b-41f6-a384-66dc8519e187 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:38.282692 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:38.287916 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 290/592] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Aug 29 22:32:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:38.287916 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c36d71-c93b-41f6-a384-66dc8519e187 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:38.297292 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a86b8-cda6-4514-b637-728c83f676e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:38.297944 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a86b8-cda6-4514-b637-728c83f676e2 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:38.298221 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a86b8-cda6-4514-b637-728c83f676e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:38.298493 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a86b8-cda6-4514-b637-728c83f676e2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:38.313221 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8a86b8-cda6-4514-b637-728c83f676e2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:38.314855 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8a86b8-cda6-4514-b637-728c83f676e2 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:38.328397 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-7d8a86b8-cda6-4514-b637-728c83f676e2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 22:32:38.328397 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:38.328397 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:38.328397 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:38.328397 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:38.328397 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:38.328397 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:38.328397 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:38.328397 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:38.328397 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:38.328397 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:38.328397 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:38.328397 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:32:38.328397 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:32:38.328397 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:32:38.328397 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:32:38.329382 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:38.329382 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:38.329382 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:32:38.329382 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:32:38.329382 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:32:38.329382 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:32:38.329382 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:38.329382 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:38.329382 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:38.329382 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:38.329382 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:38.329382 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:38.329382 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:38.329382 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:38.329382 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:38.329382 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:38.329382 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:38.329382 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:38.330308 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:38.330308 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:38.330308 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:32:38.330308 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:32:38.330308 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:32:38.330308 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:32:38.330308 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:32:38.330308 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:32:38.330308 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 22:32:38.330308 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:32:38.334690 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 303/593] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Aug 29 22:32:38 2022] GET /identity/v3/users/neutron => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:38.335078 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a86b8-cda6-4514-b637-728c83f676e2 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:38.386218 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:38.404591 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c36d71-c93b-41f6-a384-66dc8519e187 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:38.447253 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970200c-a290-43cb-af9a-5b7c6af2a237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:38.448177 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970200c-a290-43cb-af9a-5b7c6af2a237 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:38.448295 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a86b8-cda6-4514-b637-728c83f676e2 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:38.448641 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970200c-a290-43cb-af9a-5b7c6af2a237 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:38.448989 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970200c-a290-43cb-af9a-5b7c6af2a237 None admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:38.449819 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970200c-a290-43cb-af9a-5b7c6af2a237 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:38.450161 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970200c-a290-43cb-af9a-5b7c6af2a237 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:38.451622 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970200c-a290-43cb-af9a-5b7c6af2a237 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:38.464499 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 291/594] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Aug 29 22:32:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:38.465626 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970200c-a290-43cb-af9a-5b7c6af2a237 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:38.492562 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddee01b1-ee71-4f64-bb50-18461ca25c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:38.493254 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee01b1-ee71-4f64-bb50-18461ca25c3f None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:38.493717 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee01b1-ee71-4f64-bb50-18461ca25c3f None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:38.494031 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee01b1-ee71-4f64-bb50-18461ca25c3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:38.504825 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddee01b1-ee71-4f64-bb50-18461ca25c3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:38.506481 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddee01b1-ee71-4f64-bb50-18461ca25c3f None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:38.522690 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-ddee01b1-ee71-4f64-bb50-18461ca25c3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:38.522690 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:38.522690 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:38.522690 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:38.522690 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:38.522690 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:38.522690 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:38.522690 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:38.522690 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:38.522690 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:38.522690 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:38.522690 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:38.522690 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:32:38.522690 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:32:38.522690 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:32:38.522690 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:32:38.524360 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:38.524360 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:38.524360 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:38.524360 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:38.524360 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:38.524360 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:38.524360 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:38.524360 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:38.524360 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:38.524360 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:38.524360 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:38.524360 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:38.524360 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:38.524360 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:38.524360 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:38.524360 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:38.524360 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:32:38.525501 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:32:38.525501 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:38.525501 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:32:38.526125 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 304/595] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:32:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:38.531791 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddee01b1-ee71-4f64-bb50-18461ca25c3f None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:38.569833 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:38.580124 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970200c-a290-43cb-af9a-5b7c6af2a237 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:38.618292 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d0a234-2c02-48f3-aff3-342654cb917c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:38.618906 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0a234-2c02-48f3-aff3-342654cb917c None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:38.619192 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0a234-2c02-48f3-aff3-342654cb917c None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:38.619466 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0a234-2c02-48f3-aff3-342654cb917c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:38.620192 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d0a234-2c02-48f3-aff3-342654cb917c None admin] RBAC: Adding query filter params (role.id=938d531e06764249874d708978e7a0e9, scope.project.id=ce09f0beb1a342febbb4a8b3c7cf60c2, user.id=388d8dea2edf4fb888d42ca878c1434d) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:38.620504 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d0a234-2c02-48f3-aff3-342654cb917c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:38.621969 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d0a234-2c02-48f3-aff3-342654cb917c None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:38.627381 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 292/596] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Aug 29 22:32:38 2022] GET /identity/v3/role_assignments?user.id=388d8dea2edf4fb888d42ca878c1434d&scope.project.id=ce09f0beb1a342febbb4a8b3c7cf60c2&role.id=938d531e06764249874d708978e7a0e9 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:38.628195 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d0a234-2c02-48f3-aff3-342654cb917c None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:38.661860 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddee01b1-ee71-4f64-bb50-18461ca25c3f None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:38.693732 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:38.718068 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ddcca1-b854-407a-a205-4cb844fc11e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:38.719955 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ddcca1-b854-407a-a205-4cb844fc11e7 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:38.720462 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ddcca1-b854-407a-a205-4cb844fc11e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:38.720918 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ddcca1-b854-407a-a205-4cb844fc11e7 None admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:38.722420 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ddcca1-b854-407a-a205-4cb844fc11e7 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:38.723150 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ddcca1-b854-407a-a205-4cb844fc11e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:38.724951 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ddcca1-b854-407a-a205-4cb844fc11e7 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:38.758560 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 305/597] 10.222.0.47 () {56 vars in 1139 bytes} [Mon Aug 29 22:32:38 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:38.758560 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ddcca1-b854-407a-a205-4cb844fc11e7 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:38.804209 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d0a234-2c02-48f3-aff3-342654cb917c None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:38.849857 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f0aa6a-3563-4b04-922d-0a836b253467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:38.850706 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0aa6a-3563-4b04-922d-0a836b253467 None admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:38.851017 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0aa6a-3563-4b04-922d-0a836b253467 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:38.851297 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0aa6a-3563-4b04-922d-0a836b253467 None admin] PATH_INFO: `/v3/projects/ce09f0beb1a342febbb4a8b3c7cf60c2/users/a5c4e692fd714354b96bd3ef4fcecdd0/roles/938d531e06764249874d708978e7a0e9` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:38.870597 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f0aa6a-3563-4b04-922d-0a836b253467 None admin] RBAC: Authorizing `identity:create_grant(project_id=ce09f0beb1a342febbb4a8b3c7cf60c2, user_id=a5c4e692fd714354b96bd3ef4fcecdd0, role_id=938d531e06764249874d708978e7a0e9)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:38.872210 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f0aa6a-3563-4b04-922d-0a836b253467 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:38.885999 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:38.901366 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 293/598] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Aug 29 22:32:38 2022] PUT /identity/v3/projects/ce09f0beb1a342febbb4a8b3c7cf60c2/users/a5c4e692fd714354b96bd3ef4fcecdd0/roles/938d531e06764249874d708978e7a0e9 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:32:38.901366 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f0aa6a-3563-4b04-922d-0a836b253467 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:38.907390 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ddcca1-b854-407a-a205-4cb844fc11e7 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:38.979679 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52edd45-136f-4a9e-a067-9a92862c1e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:38.980545 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52edd45-136f-4a9e-a067-9a92862c1e88 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:38.980932 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52edd45-136f-4a9e-a067-9a92862c1e88 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:38.981306 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52edd45-136f-4a9e-a067-9a92862c1e88 None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:38.982111 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52edd45-136f-4a9e-a067-9a92862c1e88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:38.983764 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52edd45-136f-4a9e-a067-9a92862c1e88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:38.988274 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52edd45-136f-4a9e-a067-9a92862c1e88 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:39.012135 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 306/599] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:32:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:39.017301 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52edd45-136f-4a9e-a067-9a92862c1e88 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:39.038198 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:39.106926 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f0aa6a-3563-4b04-922d-0a836b253467 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:39.154006 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188a75c9-36e4-49b2-9f59-27e351ef9596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:39.155788 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a75c9-36e4-49b2-9f59-27e351ef9596 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:39.156078 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a75c9-36e4-49b2-9f59-27e351ef9596 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:39.156355 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a75c9-36e4-49b2-9f59-27e351ef9596 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:39.171880 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188a75c9-36e4-49b2-9f59-27e351ef9596 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:39.173785 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188a75c9-36e4-49b2-9f59-27e351ef9596 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:39.193941 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-188a75c9-36e4-49b2-9f59-27e351ef9596 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:39.193941 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:39.193941 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:39.193941 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:39.193941 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:39.193941 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:39.193941 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:39.193941 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:39.193941 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:39.193941 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:39.193941 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:39.193941 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:39.193941 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:32:39.193941 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:32:39.193941 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:32:39.193941 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:32:39.195920 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:39.195920 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:39.195920 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:39.195920 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:39.195920 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:39.195920 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:39.195920 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:39.195920 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:39.195920 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:39.195920 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:39.195920 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:39.195920 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:39.195920 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:39.195920 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:39.195920 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:39.195920 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:39.195920 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:32:39.197075 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:32:39.197075 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:39.197075 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:32:39.197075 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 294/600] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:32:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:39.203413 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188a75c9-36e4-49b2-9f59-27e351ef9596 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:39.218008 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52edd45-136f-4a9e-a067-9a92862c1e88 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:39.327746 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f96e1-8fe6-42db-a665-2fca0df54078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:39.328145 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f96e1-8fe6-42db-a665-2fca0df54078 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:39.328429 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f96e1-8fe6-42db-a665-2fca0df54078 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:39.328706 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f96e1-8fe6-42db-a665-2fca0df54078 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:39.334488 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188a75c9-36e4-49b2-9f59-27e351ef9596 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:39.350322 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:39.353801 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511f96e1-8fe6-42db-a665-2fca0df54078 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:39.355292 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511f96e1-8fe6-42db-a665-2fca0df54078 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:39.381864 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-511f96e1-8fe6-42db-a665-2fca0df54078 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:32:39.381864 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:39.381864 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:39.381864 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:39.381864 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:39.381864 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:39.381864 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:39.381864 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:39.381864 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:39.381864 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:39.381864 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:39.381864 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:39.381864 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:32:39.381864 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:32:39.381864 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:32:39.383589 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:32:39.383589 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:39.383589 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:39.383589 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:39.383589 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:39.383589 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:39.383589 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:39.383589 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:39.383589 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:39.383589 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:39.383589 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:39.383589 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:39.383589 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:39.383589 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:39.383589 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:39.383589 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:39.383589 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:39.384452 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:32:39.384452 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:32:39.384452 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:32:39.384452 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:32:39.384452 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:32:39.384452 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:32:39.384452 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:32:39.384452 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:32:39.385276 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 307/601] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Aug 29 22:32:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:39.395095 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449bbf09-9be7-46e2-b23b-5cf5663a2c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:39.395724 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449bbf09-9be7-46e2-b23b-5cf5663a2c9e None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:39.396006 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449bbf09-9be7-46e2-b23b-5cf5663a2c9e None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:39.396283 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449bbf09-9be7-46e2-b23b-5cf5663a2c9e None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:39.396993 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449bbf09-9be7-46e2-b23b-5cf5663a2c9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:39.397302 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449bbf09-9be7-46e2-b23b-5cf5663a2c9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:39.398607 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f96e1-8fe6-42db-a665-2fca0df54078 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:39.400016 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449bbf09-9be7-46e2-b23b-5cf5663a2c9e None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:39.424234 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:39.430166 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 295/602] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:32:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:39.435741 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449bbf09-9be7-46e2-b23b-5cf5663a2c9e None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:39.537578 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f96e1-8fe6-42db-a665-2fca0df54078 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:39.574621 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da2175-8860-4d88-a684-e0ff1707f651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:39.575238 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da2175-8860-4d88-a684-e0ff1707f651 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:39.575580 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da2175-8860-4d88-a684-e0ff1707f651 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:39.575860 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da2175-8860-4d88-a684-e0ff1707f651 None admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:39.576565 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9da2175-8860-4d88-a684-e0ff1707f651 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:39.576872 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9da2175-8860-4d88-a684-e0ff1707f651 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:39.578351 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9da2175-8860-4d88-a684-e0ff1707f651 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:39.591363 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 308/603] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Aug 29 22:32:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:32:39.597112 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da2175-8860-4d88-a684-e0ff1707f651 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:39.621760 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449bbf09-9be7-46e2-b23b-5cf5663a2c9e None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:39.672370 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:39.685663 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b3009-3600-49fc-a904-18d2eaa4f8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:39.686471 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b3009-3600-49fc-a904-18d2eaa4f8a1 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:39.686758 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b3009-3600-49fc-a904-18d2eaa4f8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:39.687084 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b3009-3600-49fc-a904-18d2eaa4f8a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:39.702604 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5b3009-3600-49fc-a904-18d2eaa4f8a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:39.704270 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5b3009-3600-49fc-a904-18d2eaa4f8a1 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:39.706657 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da2175-8860-4d88-a684-e0ff1707f651 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:39.728551 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-ea5b3009-3600-49fc-a904-18d2eaa4f8a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:32:39.728551 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:39.728551 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:39.728551 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:39.728551 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:39.728551 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:39.728551 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:39.728551 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:39.728551 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:39.728551 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:39.728551 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:39.728551 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:39.728551 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:32:39.728551 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:32:39.728551 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:32:39.729537 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:32:39.729537 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:39.729537 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:39.729537 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:39.729537 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:39.729537 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:39.729537 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:39.729537 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:39.729537 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:39.729537 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:39.729537 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:39.729537 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:39.729537 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:39.729537 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:39.729537 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:39.729537 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:39.729537 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:39.730427 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:32:39.730427 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:32:39.730427 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:32:39.730427 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:32:39.730427 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:32:39.730427 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:32:39.730427 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:32:39.730427 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:32:39.734726 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 296/604] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Aug 29 22:32:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:39.740637 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b3009-3600-49fc-a904-18d2eaa4f8a1 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:39.746127 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a2688-2e54-43be-8ac9-e55d54e68d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:39.746796 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a2688-2e54-43be-8ac9-e55d54e68d95 None admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:39.747143 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a2688-2e54-43be-8ac9-e55d54e68d95 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:39.747424 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a2688-2e54-43be-8ac9-e55d54e68d95 None admin] PATH_INFO: `/v3/projects/ce09f0beb1a342febbb4a8b3c7cf60c2/users/d6a05d7ad37e4547bada8aabc0fcb64b/roles/938d531e06764249874d708978e7a0e9` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:39.764244 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09a2688-2e54-43be-8ac9-e55d54e68d95 None admin] RBAC: Authorizing `identity:create_grant(project_id=ce09f0beb1a342febbb4a8b3c7cf60c2, user_id=d6a05d7ad37e4547bada8aabc0fcb64b, role_id=938d531e06764249874d708978e7a0e9)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:39.765727 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09a2688-2e54-43be-8ac9-e55d54e68d95 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:39.781565 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 309/605] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Aug 29 22:32:39 2022] PUT /identity/v3/projects/ce09f0beb1a342febbb4a8b3c7cf60c2/users/d6a05d7ad37e4547bada8aabc0fcb64b/roles/938d531e06764249874d708978e7a0e9 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:32:39.782886 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1c156-6921-4bb4-a10e-340908245751 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:39.783216 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1c156-6921-4bb4-a10e-340908245751 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:39.783497 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1c156-6921-4bb4-a10e-340908245751 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:39.789570 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 310/606] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:32:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:32:39.791037 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9220506-7a46-4384-9975-564b7a65f6a2 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:39.791331 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9220506-7a46-4384-9975-564b7a65f6a2 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:39.791642 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9220506-7a46-4384-9975-564b7a65f6a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:39.808729 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:39.811946 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-a9220506-7a46-4384-9975-564b7a65f6a2 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:32:39.813195 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-a9220506-7a46-4384-9975-564b7a65f6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:39.955380 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b3009-3600-49fc-a904-18d2eaa4f8a1 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:39.969504 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 311/607] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:32:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 29 22:32:40.008374 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40be166c-c90e-4216-902c-bd6cec2ef05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:40.008991 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be166c-c90e-4216-902c-bd6cec2ef05e None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:40.009276 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be166c-c90e-4216-902c-bd6cec2ef05e None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:40.009658 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be166c-c90e-4216-902c-bd6cec2ef05e None admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:40.010575 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40be166c-c90e-4216-902c-bd6cec2ef05e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:40.010939 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40be166c-c90e-4216-902c-bd6cec2ef05e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:40.012375 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40be166c-c90e-4216-902c-bd6cec2ef05e None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:40.027257 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 297/608] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Aug 29 22:32:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:40.033055 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9220506-7a46-4384-9975-564b7a65f6a2 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:40.093776 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:40.161882 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9220506-7a46-4384-9975-564b7a65f6a2 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:40.212496 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2903945c-27e7-4d74-9d9c-3e9682bfbea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:40.213184 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903945c-27e7-4d74-9d9c-3e9682bfbea7 None admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:40.213558 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903945c-27e7-4d74-9d9c-3e9682bfbea7 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:40.213901 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903945c-27e7-4d74-9d9c-3e9682bfbea7 None admin] PATH_INFO: `/v3/projects/ce09f0beb1a342febbb4a8b3c7cf60c2/users/27abbf7b40e54fc091ebfe10aa6da90d/roles/938d531e06764249874d708978e7a0e9` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:40.235573 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2903945c-27e7-4d74-9d9c-3e9682bfbea7 None admin] RBAC: Authorizing `identity:create_grant(project_id=ce09f0beb1a342febbb4a8b3c7cf60c2, user_id=27abbf7b40e54fc091ebfe10aa6da90d, role_id=938d531e06764249874d708978e7a0e9)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:40.237205 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2903945c-27e7-4d74-9d9c-3e9682bfbea7 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:40.253054 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 312/609] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Aug 29 22:32:40 2022] PUT /identity/v3/projects/ce09f0beb1a342febbb4a8b3c7cf60c2/users/27abbf7b40e54fc091ebfe10aa6da90d/roles/938d531e06764249874d708978e7a0e9 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:32:40.331792 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40be166c-c90e-4216-902c-bd6cec2ef05e None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:40.462283 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:40.472674 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40be166c-c90e-4216-902c-bd6cec2ef05e None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:40.515357 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b838c2-f773-4d19-8a48-0abbd7a60ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:40.516000 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b838c2-f773-4d19-8a48-0abbd7a60ce5 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:40.516282 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b838c2-f773-4d19-8a48-0abbd7a60ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:40.516559 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b838c2-f773-4d19-8a48-0abbd7a60ce5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:40.529953 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b838c2-f773-4d19-8a48-0abbd7a60ce5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:32:40.535194 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-20b838c2-f773-4d19-8a48-0abbd7a60ce5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:32:40.535194 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:40.535194 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:40.535194 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:40.535194 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:40.535194 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:40.535194 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:40.535194 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:40.535194 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:40.535194 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:40.535194 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:40.535194 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:40.535194 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:32:40.535194 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:32:40.535194 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:32:40.535194 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:32:40.536163 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:32:40.536163 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:32:40.536163 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:32:40.536163 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:32:40.536163 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:40.536163 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:40.536163 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:40.536163 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:40.536163 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:40.536163 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:40.536163 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:40.536163 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:40.536163 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:40.536163 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:40.536163 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:40.536163 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:40.537013 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:40.537013 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:40.537013 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:40.537013 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:40.537013 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:32:40.537013 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:32:40.537013 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:32:40.537013 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:32:40.537013 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:32:40.537013 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:32:40.537013 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:32:40.537013 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:32:40.537013 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 298/610] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Aug 29 22:32:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:40.542783 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2903945c-27e7-4d74-9d9c-3e9682bfbea7 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:40.655708 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:40.658773 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2903945c-27e7-4d74-9d9c-3e9682bfbea7 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:40.697765 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7886ec2a-b736-46ee-ba03-bc713028b279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:40.698402 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7886ec2a-b736-46ee-ba03-bc713028b279 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:40.698687 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7886ec2a-b736-46ee-ba03-bc713028b279 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:40.698964 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7886ec2a-b736-46ee-ba03-bc713028b279 None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:40.699639 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7886ec2a-b736-46ee-ba03-bc713028b279 None admin] RBAC: Adding query filter params (name=service) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:40.699946 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7886ec2a-b736-46ee-ba03-bc713028b279 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:40.702694 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7886ec2a-b736-46ee-ba03-bc713028b279 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:40.712143 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 313/611] 10.222.0.47 () {56 vars in 1103 bytes} [Mon Aug 29 22:32:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:40.718493 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b838c2-f773-4d19-8a48-0abbd7a60ce5 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:40.847009 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a9a15d-2c3d-4141-9118-4258932b88eb None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:40.847526 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a9a15d-2c3d-4141-9118-4258932b88eb None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:40.847526 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a9a15d-2c3d-4141-9118-4258932b88eb None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:40.852888 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 314/612] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:32:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:32:40.858715 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef6c12-f792-4f60-9c49-82a30f3408b1 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:40.858715 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef6c12-f792-4f60-9c49-82a30f3408b1 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:40.858715 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef6c12-f792-4f60-9c49-82a30f3408b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:40.896031 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b838c2-f773-4d19-8a48-0abbd7a60ce5 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:40.902482 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-74ef6c12-f792-4f60-9c49-82a30f3408b1 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:32:40.903722 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-74ef6c12-f792-4f60-9c49-82a30f3408b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:41.001582 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700dce59-76b4-4e73-aad9-c61b759b714e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:41.004714 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700dce59-76b4-4e73-aad9-c61b759b714e None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:41.007540 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700dce59-76b4-4e73-aad9-c61b759b714e None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:41.008236 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700dce59-76b4-4e73-aad9-c61b759b714e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:41.038251 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700dce59-76b4-4e73-aad9-c61b759b714e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:41.044780 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700dce59-76b4-4e73-aad9-c61b759b714e None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:41.089356 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-700dce59-76b4-4e73-aad9-c61b759b714e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:41.089356 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:41.089356 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:41.089356 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:41.089356 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:41.089356 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:41.089356 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:41.089356 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:41.089356 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:41.089356 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:41.089356 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:41.089356 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:41.089356 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:32:41.089356 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:32:41.089356 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:32:41.089356 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:32:41.090359 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:41.090359 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:41.090359 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:41.090359 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:41.090359 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:41.090359 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:41.090359 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:41.090359 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:41.090359 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:41.090359 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:41.090359 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:41.090359 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:41.090359 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:41.090359 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:41.090359 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:41.090359 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:41.090359 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:32:41.091273 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:32:41.091273 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:41.091273 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:32:41.097409 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 299/613] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:32:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:41.102289 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700dce59-76b4-4e73-aad9-c61b759b714e None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:41.109779 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:41.140375 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 315/614] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:32:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:32:41.333243 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700dce59-76b4-4e73-aad9-c61b759b714e None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:41.375274 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f6fe45-57da-4754-add7-4786fe62331f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:41.375809 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f6fe45-57da-4754-add7-4786fe62331f None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:41.376158 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f6fe45-57da-4754-add7-4786fe62331f None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:41.376442 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f6fe45-57da-4754-add7-4786fe62331f None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:41.377093 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f6fe45-57da-4754-add7-4786fe62331f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:41.377427 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f6fe45-57da-4754-add7-4786fe62331f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:41.378818 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f6fe45-57da-4754-add7-4786fe62331f None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:41.391383 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 300/615] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:32:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:41.396488 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ef6c12-f792-4f60-9c49-82a30f3408b1 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:41.479315 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20490ede-502c-436a-98a2-ebb926daae2b None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:41.479638 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20490ede-502c-436a-98a2-ebb926daae2b None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:41.479887 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20490ede-502c-436a-98a2-ebb926daae2b None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:41.481520 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 301/616] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:32:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:32:41.489352 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61ab25-f436-4a03-9c20-ed89ee15e1ce None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:41.489352 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61ab25-f436-4a03-9c20-ed89ee15e1ce None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:41.489352 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61ab25-f436-4a03-9c20-ed89ee15e1ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:41.506301 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-db61ab25-f436-4a03-9c20-ed89ee15e1ce None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:32:41.511200 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-db61ab25-f436-4a03-9c20-ed89ee15e1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:41.541952 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:41.552864 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ef6c12-f792-4f60-9c49-82a30f3408b1 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:41.585745 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:41.597764 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 302/617] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:32:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 22:32:41.598454 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b18c07-cdfb-4cb6-b5f2-e72dab92dc1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:41.598580 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db61ab25-f436-4a03-9c20-ed89ee15e1ce None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:41.599448 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b18c07-cdfb-4cb6-b5f2-e72dab92dc1c None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:41.600058 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b18c07-cdfb-4cb6-b5f2-e72dab92dc1c None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:41.600544 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b18c07-cdfb-4cb6-b5f2-e72dab92dc1c None admin] PATH_INFO: `/v3/users/nova` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:41.620626 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b18c07-cdfb-4cb6-b5f2-e72dab92dc1c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:41.622445 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b18c07-cdfb-4cb6-b5f2-e72dab92dc1c None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:41.645949 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-18b18c07-cdfb-4cb6-b5f2-e72dab92dc1c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 22:32:41.645949 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:41.645949 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:41.645949 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:41.645949 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:41.645949 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:41.645949 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:41.645949 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:41.645949 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:41.645949 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:41.645949 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:41.645949 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:41.645949 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:32:41.645949 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:32:41.645949 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:32:41.645949 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:32:41.646892 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:41.646892 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:41.646892 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:32:41.646892 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:32:41.646892 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:32:41.646892 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:32:41.646892 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:41.646892 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:41.646892 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:41.646892 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:41.646892 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:41.646892 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:41.646892 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:41.646892 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:41.646892 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:41.646892 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:41.646892 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:41.646892 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:41.647865 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:41.647865 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:41.647865 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:32:41.647865 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:32:41.647865 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:32:41.647865 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:32:41.647865 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:32:41.647865 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:32:41.647865 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 22:32:41.647865 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:32:41.653848 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 316/618] 10.222.0.47 () {56 vars in 1093 bytes} [Mon Aug 29 22:32:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:41.659208 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b18c07-cdfb-4cb6-b5f2-e72dab92dc1c None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:41.751652 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db61ab25-f436-4a03-9c20-ed89ee15e1ce None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:41.789956 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce5888a-6767-48f3-8d99-5a4a34524b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:41.791032 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5888a-6767-48f3-8d99-5a4a34524b55 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:41.791516 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5888a-6767-48f3-8d99-5a4a34524b55 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:41.792009 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5888a-6767-48f3-8d99-5a4a34524b55 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:41.803256 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce5888a-6767-48f3-8d99-5a4a34524b55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:32:41.809280 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-1ce5888a-6767-48f3-8d99-5a4a34524b55 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:32:41.809280 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:41.809280 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:41.809280 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:41.809280 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:41.809280 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:41.809280 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:41.809280 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:41.809280 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:41.809280 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:41.809280 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:41.809280 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:41.809280 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:32:41.809280 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:32:41.809280 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:32:41.809280 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:32:41.810232 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:32:41.810232 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:32:41.810232 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:32:41.810232 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:32:41.810232 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:41.810232 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:41.810232 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:41.810232 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:41.810232 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:41.810232 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:41.810232 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:41.810232 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:41.810232 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:41.810232 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:41.810232 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:41.810232 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:41.811092 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:41.811092 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:41.811092 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:41.811092 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:41.811092 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:32:41.811092 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:32:41.811092 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:32:41.811092 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:32:41.811092 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:32:41.811092 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:32:41.811092 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:32:41.811092 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:32:41.813926 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 303/619] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Aug 29 22:32:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:41.822161 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce5888a-6767-48f3-8d99-5a4a34524b55 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:41.876535 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b18c07-cdfb-4cb6-b5f2-e72dab92dc1c None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:41.914867 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a83429-464c-4931-8b5e-fa3b59d53a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:41.915402 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a83429-464c-4931-8b5e-fa3b59d53a70 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:41.915684 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a83429-464c-4931-8b5e-fa3b59d53a70 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:41.915955 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a83429-464c-4931-8b5e-fa3b59d53a70 None admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:41.916695 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a83429-464c-4931-8b5e-fa3b59d53a70 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:41.917000 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a83429-464c-4931-8b5e-fa3b59d53a70 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:41.918626 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a83429-464c-4931-8b5e-fa3b59d53a70 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:41.940364 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 317/620] 10.222.0.47 () {56 vars in 1133 bytes} [Mon Aug 29 22:32:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:32:41.941627 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:41.942607 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a83429-464c-4931-8b5e-fa3b59d53a70 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:41.982043 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:41.996222 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce5888a-6767-48f3-8d99-5a4a34524b55 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:42.046649 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ccbd06-40c8-409f-89e1-22a9e62dc93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:42.047415 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ccbd06-40c8-409f-89e1-22a9e62dc93b None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:42.047767 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ccbd06-40c8-409f-89e1-22a9e62dc93b None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:42.048116 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ccbd06-40c8-409f-89e1-22a9e62dc93b None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:42.048861 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ccbd06-40c8-409f-89e1-22a9e62dc93b None admin] RBAC: Adding query filter params (name=service) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:42.049240 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ccbd06-40c8-409f-89e1-22a9e62dc93b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:42.051406 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ccbd06-40c8-409f-89e1-22a9e62dc93b None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:42.064318 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 304/621] 10.222.0.47 () {56 vars in 1103 bytes} [Mon Aug 29 22:32:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:42.065352 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ccbd06-40c8-409f-89e1-22a9e62dc93b None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:42.081469 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a83429-464c-4931-8b5e-fa3b59d53a70 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:42.136209 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4967726-b844-40ae-8b78-2e8d514704c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:42.136893 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4967726-b844-40ae-8b78-2e8d514704c0 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:42.137284 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4967726-b844-40ae-8b78-2e8d514704c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:42.137657 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4967726-b844-40ae-8b78-2e8d514704c0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:42.150119 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4967726-b844-40ae-8b78-2e8d514704c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:32:42.155857 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-c4967726-b844-40ae-8b78-2e8d514704c0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:32:42.155857 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:42.155857 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:42.155857 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:42.155857 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:42.155857 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:42.155857 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:42.155857 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:42.155857 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:42.155857 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:42.155857 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:42.155857 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:42.155857 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:32:42.155857 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:32:42.155857 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:32:42.155857 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:32:42.156808 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:32:42.156808 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:32:42.156808 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:32:42.156808 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:32:42.156808 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:42.156808 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:42.156808 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:42.156808 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:42.156808 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:42.156808 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:42.156808 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:42.156808 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:42.156808 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:42.156808 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:42.156808 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:42.156808 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:42.157705 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:42.157705 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:42.157705 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:42.157705 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:42.157705 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:32:42.157705 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:32:42.157705 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:32:42.157705 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:32:42.157705 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:32:42.157705 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:32:42.157705 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:32:42.157705 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:32:42.157705 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 318/622] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Aug 29 22:32:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:42.158455 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4967726-b844-40ae-8b78-2e8d514704c0 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:42.198089 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ccbd06-40c8-409f-89e1-22a9e62dc93b None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:42.216003 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:42.236065 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da473d6e-6f31-466c-9b27-4aeb4e3d33da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:42.237001 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da473d6e-6f31-466c-9b27-4aeb4e3d33da None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:42.237497 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da473d6e-6f31-466c-9b27-4aeb4e3d33da None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:42.237949 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da473d6e-6f31-466c-9b27-4aeb4e3d33da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:42.246448 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:42.283997 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4967726-b844-40ae-8b78-2e8d514704c0 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:42.312386 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da473d6e-6f31-466c-9b27-4aeb4e3d33da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:42.314171 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da473d6e-6f31-466c-9b27-4aeb4e3d33da None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:42.323613 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdea81bb-dead-459c-afe3-ccaa08c6e82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:42.324246 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea81bb-dead-459c-afe3-ccaa08c6e82c None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:42.324527 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea81bb-dead-459c-afe3-ccaa08c6e82c None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:42.324803 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea81bb-dead-459c-afe3-ccaa08c6e82c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:42.336700 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdea81bb-dead-459c-afe3-ccaa08c6e82c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:42.338407 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdea81bb-dead-459c-afe3-ccaa08c6e82c None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:42.355050 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-fdea81bb-dead-459c-afe3-ccaa08c6e82c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:42.355050 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:42.355050 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:42.355050 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:42.355050 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:42.355050 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:42.355050 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:42.355050 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:42.355050 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:42.355050 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:42.355050 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:42.355050 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:42.355050 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:32:42.355050 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:32:42.355050 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:32:42.355050 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:32:42.356041 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:42.356041 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:42.356041 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:42.356041 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:42.356041 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:42.356041 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:42.356041 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:42.356041 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:42.356041 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:42.356041 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:42.356041 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:42.356041 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:42.356041 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:42.356041 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:42.356041 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:42.356041 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:42.356041 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:32:42.356923 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:32:42.356923 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:42.356923 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:32:42.360885 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 319/623] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:32:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:42.361758 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdea81bb-dead-459c-afe3-ccaa08c6e82c None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:42.425284 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 305/624] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Aug 29 22:32:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:32:42.426594 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06127dc8-0a8d-42f1-bff8-ae51a46dfd21 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:42.426881 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06127dc8-0a8d-42f1-bff8-ae51a46dfd21 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:42.427160 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06127dc8-0a8d-42f1-bff8-ae51a46dfd21 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:42.428543 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 306/625] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:32:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:32:42.430121 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06127dc8-0a8d-42f1-bff8-ae51a46dfd21 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:42.451712 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:42.483569 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdea81bb-dead-459c-afe3-ccaa08c6e82c None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:42.508396 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:42.521377 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212925a0-e926-4f19-945a-a1a9528efae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:42.521987 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212925a0-e926-4f19-945a-a1a9528efae3 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:42.522266 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212925a0-e926-4f19-945a-a1a9528efae3 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:42.522560 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212925a0-e926-4f19-945a-a1a9528efae3 None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:42.523930 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212925a0-e926-4f19-945a-a1a9528efae3 None admin] RBAC: Adding query filter params (name=service) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:42.524394 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212925a0-e926-4f19-945a-a1a9528efae3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:42.525799 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212925a0-e926-4f19-945a-a1a9528efae3 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:42.538982 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 320/626] 10.222.0.47 () {56 vars in 1103 bytes} [Mon Aug 29 22:32:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:42.538982 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212925a0-e926-4f19-945a-a1a9528efae3 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:42.552168 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06127dc8-0a8d-42f1-bff8-ae51a46dfd21 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:42.592102 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac802c36-c2cf-4308-985e-63bba30cca68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:42.592707 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac802c36-c2cf-4308-985e-63bba30cca68 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:42.592989 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac802c36-c2cf-4308-985e-63bba30cca68 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:42.593263 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac802c36-c2cf-4308-985e-63bba30cca68 None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:42.594006 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac802c36-c2cf-4308-985e-63bba30cca68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:42.594267 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac802c36-c2cf-4308-985e-63bba30cca68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:42.595601 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac802c36-c2cf-4308-985e-63bba30cca68 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:42.612301 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 307/627] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:32:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:42.612301 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6a654-9d2e-4de6-8f02-d9ef7557b856 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:42.612301 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6a654-9d2e-4de6-8f02-d9ef7557b856 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:42.612301 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6a654-9d2e-4de6-8f02-d9ef7557b856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:42.630212 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-b8c6a654-9d2e-4de6-8f02-d9ef7557b856 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:32:42.631417 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-b8c6a654-9d2e-4de6-8f02-d9ef7557b856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:42.642735 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212925a0-e926-4f19-945a-a1a9528efae3 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:42.677825 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda215e-072d-4571-b9d6-e910a6f5abb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:42.678456 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda215e-072d-4571-b9d6-e910a6f5abb4 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:42.678733 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda215e-072d-4571-b9d6-e910a6f5abb4 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:42.679092 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda215e-072d-4571-b9d6-e910a6f5abb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:42.689900 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda215e-072d-4571-b9d6-e910a6f5abb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:42.691349 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda215e-072d-4571-b9d6-e910a6f5abb4 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:42.713430 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 308/628] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:32:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:32:42.713430 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6a654-9d2e-4de6-8f02-d9ef7557b856 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:42.713725 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-ecda215e-072d-4571-b9d6-e910a6f5abb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:42.713725 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:42.713725 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:42.713725 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:42.713725 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:42.713725 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:42.713725 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:42.713725 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:42.713725 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:42.713725 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:42.713725 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:42.713725 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:42.713725 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:32:42.713725 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:32:42.713725 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:32:42.713725 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:32:42.714784 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:42.714784 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:42.714784 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:42.714784 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:42.714784 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:42.714784 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:42.714784 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:42.714784 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:42.714784 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:42.714784 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:42.714784 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:42.714784 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:42.714784 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:42.714784 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:42.714784 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:42.714784 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:42.714784 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:32:42.715861 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:32:42.715861 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:42.715861 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:32:42.715861 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 321/629] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:32:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:42.715861 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda215e-072d-4571-b9d6-e910a6f5abb4 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:42.723564 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:42.764148 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:42.831092 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6a654-9d2e-4de6-8f02-d9ef7557b856 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:42.855255 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda215e-072d-4571-b9d6-e910a6f5abb4 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:42.868255 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5947fed1-ad7f-4cac-b956-9c73fc85357f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:42.868893 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5947fed1-ad7f-4cac-b956-9c73fc85357f None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:42.869172 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5947fed1-ad7f-4cac-b956-9c73fc85357f None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:42.869482 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5947fed1-ad7f-4cac-b956-9c73fc85357f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:42.880994 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5947fed1-ad7f-4cac-b956-9c73fc85357f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:42.883071 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5947fed1-ad7f-4cac-b956-9c73fc85357f None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:42.894566 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f916e-c115-4e40-b165-9593ecc7937b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:42.895249 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f916e-c115-4e40-b165-9593ecc7937b None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:42.895472 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f916e-c115-4e40-b165-9593ecc7937b None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:42.895744 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f916e-c115-4e40-b165-9593ecc7937b None admin] PATH_INFO: `/v3/users/swift` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:42.899385 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-5947fed1-ad7f-4cac-b956-9c73fc85357f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:42.899385 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:42.899385 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:42.899385 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:42.899385 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:42.899385 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:42.899385 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:42.899385 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:42.899385 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:42.899385 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:42.899385 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:42.899385 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:42.899385 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:32:42.899385 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:32:42.899385 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:32:42.899385 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:32:42.900315 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:42.900315 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:42.900315 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:42.900315 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:42.900315 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:42.900315 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:42.900315 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:42.900315 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:42.900315 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:42.900315 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:42.900315 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:42.900315 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:42.900315 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:42.900315 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:42.900315 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:42.900315 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:42.900315 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:32:42.901233 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:32:42.901233 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:42.901233 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:32:42.903495 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139f916e-c115-4e40-b165-9593ecc7937b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:42.904938 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139f916e-c115-4e40-b165-9593ecc7937b None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:42.905894 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 309/630] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:32:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:42.906501 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5947fed1-ad7f-4cac-b956-9c73fc85357f None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:42.917185 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-139f916e-c115-4e40-b165-9593ecc7937b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 22:32:42.917185 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:42.917185 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:42.917185 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:42.917185 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:42.917185 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:42.917185 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:42.917185 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:42.917185 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:42.917185 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:42.917185 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:42.917185 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:42.917185 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:32:42.917185 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:32:42.917185 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:32:42.917185 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:32:42.918229 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:42.918229 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:42.918229 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:32:42.918229 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:32:42.918229 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:32:42.918229 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:32:42.918229 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:42.918229 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:42.918229 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:42.918229 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:42.918229 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:42.918229 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:42.918229 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:42.918229 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:42.918229 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:42.918229 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:42.918229 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:42.918229 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:42.919238 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:42.919238 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:42.919238 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:32:42.919238 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:32:42.919238 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:32:42.919238 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:32:42.919238 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:32:42.919238 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:32:42.919238 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 22:32:42.919238 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:32:42.922986 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 322/631] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Aug 29 22:32:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:42.924212 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0738c2-4e48-4545-b873-55c4f8e997cd None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:42.924495 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0738c2-4e48-4545-b873-55c4f8e997cd None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:42.924773 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0738c2-4e48-4545-b873-55c4f8e997cd None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:42.926196 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 323/632] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:32:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:32:42.926749 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0738c2-4e48-4545-b873-55c4f8e997cd None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:42.974592 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:43.022285 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5947fed1-ad7f-4cac-b956-9c73fc85357f None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:43.035108 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:43.042796 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0738c2-4e48-4545-b873-55c4f8e997cd None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:43.061011 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6860fb2f-494a-4637-a7c9-88c3a5c85eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:43.061659 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6860fb2f-494a-4637-a7c9-88c3a5c85eb5 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:43.061941 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6860fb2f-494a-4637-a7c9-88c3a5c85eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:43.062215 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6860fb2f-494a-4637-a7c9-88c3a5c85eb5 None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:43.062858 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6860fb2f-494a-4637-a7c9-88c3a5c85eb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:43.063157 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6860fb2f-494a-4637-a7c9-88c3a5c85eb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:43.064539 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6860fb2f-494a-4637-a7c9-88c3a5c85eb5 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:43.081574 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 310/633] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:32:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:43.081574 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6860fb2f-494a-4637-a7c9-88c3a5c85eb5 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:43.085780 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d2df6d-9e3d-484f-bbed-69abb32805a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:43.086834 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d2df6d-9e3d-484f-bbed-69abb32805a0 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:43.087116 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d2df6d-9e3d-484f-bbed-69abb32805a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:43.087388 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d2df6d-9e3d-484f-bbed-69abb32805a0 None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:43.088397 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d2df6d-9e3d-484f-bbed-69abb32805a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:43.088705 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d2df6d-9e3d-484f-bbed-69abb32805a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:43.090435 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d2df6d-9e3d-484f-bbed-69abb32805a0 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:43.102262 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 324/634] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:32:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:43.103455 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd70c3-1673-45b5-a85f-03be33d863f2 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:43.103736 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd70c3-1673-45b5-a85f-03be33d863f2 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:43.104009 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd70c3-1673-45b5-a85f-03be33d863f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:43.122287 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-8bdd70c3-1673-45b5-a85f-03be33d863f2 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:32:43.123486 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-8bdd70c3-1673-45b5-a85f-03be33d863f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:43.178116 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6860fb2f-494a-4637-a7c9-88c3a5c85eb5 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:43.190369 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 325/635] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:32:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:32:43.191204 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdd70c3-1673-45b5-a85f-03be33d863f2 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:43.196293 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:43.213993 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d949cfa4-6d72-43af-9dbf-dd9ae8865b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:43.214978 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949cfa4-6d72-43af-9dbf-dd9ae8865b80 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:43.215267 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949cfa4-6d72-43af-9dbf-dd9ae8865b80 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:43.215544 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949cfa4-6d72-43af-9dbf-dd9ae8865b80 None admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:43.216283 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d949cfa4-6d72-43af-9dbf-dd9ae8865b80 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:43.216589 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d949cfa4-6d72-43af-9dbf-dd9ae8865b80 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:43.218051 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d949cfa4-6d72-43af-9dbf-dd9ae8865b80 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:43.240872 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 311/636] 10.222.0.47 () {56 vars in 1135 bytes} [Mon Aug 29 22:32:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:43.240872 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d949cfa4-6d72-43af-9dbf-dd9ae8865b80 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:43.290754 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:43.310997 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdd70c3-1673-45b5-a85f-03be33d863f2 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:43.347246 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ff9db4-6886-45ae-b43c-1e973b15fc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:43.347986 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff9db4-6886-45ae-b43c-1e973b15fc68 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:43.348328 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff9db4-6886-45ae-b43c-1e973b15fc68 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:43.348670 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff9db4-6886-45ae-b43c-1e973b15fc68 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:43.353550 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d949cfa4-6d72-43af-9dbf-dd9ae8865b80 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:43.362007 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ff9db4-6886-45ae-b43c-1e973b15fc68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:32:43.370726 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-d7ff9db4-6886-45ae-b43c-1e973b15fc68 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:32:43.370726 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:43.370726 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:43.370726 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:43.370726 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:43.370726 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:43.370726 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:43.370726 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:43.370726 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:43.370726 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:43.370726 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:43.370726 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:43.370726 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:32:43.370726 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:32:43.370726 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:32:43.370726 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:32:43.371858 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:32:43.371858 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:32:43.371858 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:32:43.371858 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:32:43.371858 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:43.371858 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:43.371858 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:43.371858 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:43.371858 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:43.371858 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:43.371858 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:43.371858 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:43.371858 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:43.371858 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:43.371858 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:43.371858 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:43.372880 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:43.372880 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:43.372880 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:43.372880 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:43.372880 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:32:43.372880 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:32:43.372880 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:32:43.372880 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:32:43.372880 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:32:43.372880 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:32:43.372880 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:32:43.372880 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:32:43.379358 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 326/637] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Aug 29 22:32:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:43.379358 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ff9db4-6886-45ae-b43c-1e973b15fc68 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:43.399220 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60feccbf-8165-40de-b3ed-35f6a0e2ec50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:43.399959 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60feccbf-8165-40de-b3ed-35f6a0e2ec50 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:43.400301 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60feccbf-8165-40de-b3ed-35f6a0e2ec50 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:43.400581 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60feccbf-8165-40de-b3ed-35f6a0e2ec50 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:43.408341 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60feccbf-8165-40de-b3ed-35f6a0e2ec50 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:43.409952 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60feccbf-8165-40de-b3ed-35f6a0e2ec50 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:43.422711 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-60feccbf-8165-40de-b3ed-35f6a0e2ec50 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:32:43.422711 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:43.422711 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:43.422711 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:43.422711 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:43.422711 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:43.422711 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:43.422711 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:43.422711 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:43.422711 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:43.422711 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:43.422711 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:43.422711 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:32:43.422711 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:32:43.422711 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:32:43.423659 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:32:43.423659 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:43.423659 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:43.423659 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:43.423659 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:43.423659 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:43.423659 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:43.423659 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:43.423659 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:43.423659 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:43.423659 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:43.423659 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:43.423659 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:43.423659 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:43.423659 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:43.423659 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:43.423659 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:43.430678 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:32:43.430678 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:32:43.430678 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:32:43.430678 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:32:43.430678 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:32:43.430678 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:32:43.430678 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:32:43.430678 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:32:43.430678 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 312/638] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Aug 29 22:32:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:43.430678 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60feccbf-8165-40de-b3ed-35f6a0e2ec50 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:43.463108 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:43.496359 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ff9db4-6886-45ae-b43c-1e973b15fc68 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:43.530194 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60feccbf-8165-40de-b3ed-35f6a0e2ec50 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:43.531292 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbcf129-34a6-42c3-8026-a95bc1fb3374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:43.531915 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbcf129-34a6-42c3-8026-a95bc1fb3374 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:43.532199 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbcf129-34a6-42c3-8026-a95bc1fb3374 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:43.532473 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbcf129-34a6-42c3-8026-a95bc1fb3374 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:43.540321 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbcf129-34a6-42c3-8026-a95bc1fb3374 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:43.541827 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbcf129-34a6-42c3-8026-a95bc1fb3374 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:43.554002 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-ddbcf129-34a6-42c3-8026-a95bc1fb3374 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 29 22:32:43.554002 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:43.554002 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:43.554002 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:43.554002 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:43.554002 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:43.554002 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:43.554002 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:43.554002 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:43.554002 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:43.554002 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:43.554002 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:43.554002 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:32:43.554002 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:32:43.554002 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:32:43.554002 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:32:43.554982 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:43.554982 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:43.554982 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:32:43.554982 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:32:43.554982 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:32:43.554982 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:32:43.554982 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:43.554982 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:43.554982 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:43.554982 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:43.554982 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:43.554982 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:43.554982 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:43.554982 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:43.554982 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:43.554982 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:43.554982 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:43.554982 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:43.555883 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:43.555883 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:43.555883 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:32:43.555883 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:32:43.555883 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:32:43.555883 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:32:43.555883 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:32:43.555883 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:32:43.555883 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 29 22:32:43.555883 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:32:43.555883 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 327/639] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Aug 29 22:32:43 2022] GET /identity/v3/users/glance => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:43.555883 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbcf129-34a6-42c3-8026-a95bc1fb3374 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:43.564353 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:43.568706 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f89553-7822-4b51-a7bd-e6f36062c736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:43.569374 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f89553-7822-4b51-a7bd-e6f36062c736 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:43.569742 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f89553-7822-4b51-a7bd-e6f36062c736 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:43.570934 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f89553-7822-4b51-a7bd-e6f36062c736 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:43.581952 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f89553-7822-4b51-a7bd-e6f36062c736 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:43.583748 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f89553-7822-4b51-a7bd-e6f36062c736 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:43.598529 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-d4f89553-7822-4b51-a7bd-e6f36062c736 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:43.598529 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:43.598529 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:43.598529 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:43.598529 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:43.598529 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:43.598529 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:43.598529 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:43.598529 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:43.598529 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:43.598529 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:43.598529 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:43.598529 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:32:43.598529 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:32:43.598529 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:32:43.598529 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:32:43.599595 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:43.599595 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:43.599595 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:43.599595 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:43.599595 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:43.599595 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:43.599595 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:43.599595 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:43.599595 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:43.599595 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:43.599595 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:43.599595 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:43.599595 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:43.599595 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:43.599595 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:43.599595 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:43.599595 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:32:43.600497 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:32:43.600497 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:43.600497 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:32:43.600497 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 313/640] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:32:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:43.600497 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f89553-7822-4b51-a7bd-e6f36062c736 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:43.661681 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbcf129-34a6-42c3-8026-a95bc1fb3374 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:43.690924 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:43.696665 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98123ad-c575-49dd-8e77-06c35f7fe640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:43.697426 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98123ad-c575-49dd-8e77-06c35f7fe640 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:43.697707 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98123ad-c575-49dd-8e77-06c35f7fe640 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:43.697975 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98123ad-c575-49dd-8e77-06c35f7fe640 None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:43.698634 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98123ad-c575-49dd-8e77-06c35f7fe640 None admin] RBAC: Adding query filter params (name=service) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:43.698929 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98123ad-c575-49dd-8e77-06c35f7fe640 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:43.701069 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98123ad-c575-49dd-8e77-06c35f7fe640 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:43.703862 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f89553-7822-4b51-a7bd-e6f36062c736 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:43.717843 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 328/641] 10.222.0.47 () {56 vars in 1103 bytes} [Mon Aug 29 22:32:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:43.717843 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98123ad-c575-49dd-8e77-06c35f7fe640 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:43.744195 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2f8459-ce06-4591-92ff-348a55729605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:43.744800 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f8459-ce06-4591-92ff-348a55729605 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:43.745078 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f8459-ce06-4591-92ff-348a55729605 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:43.745377 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f8459-ce06-4591-92ff-348a55729605 None admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:43.746076 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2f8459-ce06-4591-92ff-348a55729605 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:43.746427 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2f8459-ce06-4591-92ff-348a55729605 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:43.747844 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2f8459-ce06-4591-92ff-348a55729605 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:43.759851 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 314/642] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Aug 29 22:32:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:43.760650 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2f8459-ce06-4591-92ff-348a55729605 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:43.791257 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:43.825653 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98123ad-c575-49dd-8e77-06c35f7fe640 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:43.859878 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6ef0b9-5d2b-4427-92ae-de7fd8b872e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:43.860495 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ef0b9-5d2b-4427-92ae-de7fd8b872e2 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:43.860770 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ef0b9-5d2b-4427-92ae-de7fd8b872e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:43.861043 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ef0b9-5d2b-4427-92ae-de7fd8b872e2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:43.862994 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2f8459-ce06-4591-92ff-348a55729605 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:43.871291 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6ef0b9-5d2b-4427-92ae-de7fd8b872e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:32:43.876526 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-2b6ef0b9-5d2b-4427-92ae-de7fd8b872e2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:32:43.876526 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:43.876526 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:43.876526 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:43.876526 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:43.876526 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:43.876526 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:43.876526 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:43.876526 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:43.876526 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:43.876526 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:43.876526 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:43.876526 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:32:43.876526 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:32:43.876526 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:32:43.876526 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:32:43.877641 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:32:43.877641 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:32:43.877641 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:32:43.877641 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:32:43.877641 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:43.877641 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:43.877641 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:43.877641 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:43.877641 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:43.877641 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:43.877641 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:43.877641 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:43.877641 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:43.877641 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:43.877641 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:43.877641 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:43.878733 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:43.878733 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:43.878733 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:43.878733 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:43.878733 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:32:43.878733 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:32:43.878733 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:32:43.878733 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:32:43.878733 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:32:43.878733 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:32:43.878733 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:32:43.878733 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:32:43.878733 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 329/643] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Aug 29 22:32:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:43.879686 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6ef0b9-5d2b-4427-92ae-de7fd8b872e2 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:43.902711 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8046044-4a69-49aa-8b28-2482e90a1a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:43.903323 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8046044-4a69-49aa-8b28-2482e90a1a5b None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:43.903606 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8046044-4a69-49aa-8b28-2482e90a1a5b None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:43.903885 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8046044-4a69-49aa-8b28-2482e90a1a5b None admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:43.904617 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8046044-4a69-49aa-8b28-2482e90a1a5b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:43.904925 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8046044-4a69-49aa-8b28-2482e90a1a5b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:43.906653 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8046044-4a69-49aa-8b28-2482e90a1a5b None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:43.923780 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 315/644] 10.222.0.47 () {56 vars in 1137 bytes} [Mon Aug 29 22:32:43 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:43.924583 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8046044-4a69-49aa-8b28-2482e90a1a5b None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:43.932919 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:43.981038 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6ef0b9-5d2b-4427-92ae-de7fd8b872e2 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:44.007394 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:44.015667 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a9f913-a198-49c2-8f64-fbaa21a6fd55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:44.016273 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9f913-a198-49c2-8f64-fbaa21a6fd55 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:44.016552 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9f913-a198-49c2-8f64-fbaa21a6fd55 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:44.016826 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9f913-a198-49c2-8f64-fbaa21a6fd55 None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:44.017501 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a9f913-a198-49c2-8f64-fbaa21a6fd55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:44.017805 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a9f913-a198-49c2-8f64-fbaa21a6fd55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:44.019179 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a9f913-a198-49c2-8f64-fbaa21a6fd55 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:44.025292 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8046044-4a69-49aa-8b28-2482e90a1a5b None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:44.031607 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 330/645] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:32:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:44.032408 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a9f913-a198-49c2-8f64-fbaa21a6fd55 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:44.061626 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6424d278-be53-4bff-87c5-de766e9c0645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:44.062263 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424d278-be53-4bff-87c5-de766e9c0645 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:44.062545 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424d278-be53-4bff-87c5-de766e9c0645 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:44.062821 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424d278-be53-4bff-87c5-de766e9c0645 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:44.073858 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6424d278-be53-4bff-87c5-de766e9c0645 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:44.075297 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6424d278-be53-4bff-87c5-de766e9c0645 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:44.090538 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-6424d278-be53-4bff-87c5-de766e9c0645 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:44.090538 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:44.090538 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:44.090538 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:44.090538 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:44.090538 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:44.090538 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:44.090538 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:44.090538 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:44.090538 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:44.090538 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:44.090538 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:44.090538 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:32:44.090538 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:32:44.090538 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:32:44.090538 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:32:44.091447 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:44.091447 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:44.091447 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:44.091447 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:44.091447 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:44.091447 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:44.091447 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:44.091447 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:44.091447 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:44.091447 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:44.091447 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:44.091447 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:44.091447 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:44.091447 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:44.091447 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:44.091447 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:44.091447 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:32:44.092323 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:32:44.092323 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:44.092323 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:32:44.092323 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 316/646] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:32:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:44.092772 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6424d278-be53-4bff-87c5-de766e9c0645 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:44.143111 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a9f913-a198-49c2-8f64-fbaa21a6fd55 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:44.150846 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:44.178847 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e66d75-68be-46b2-ae01-47cead98c3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:44.179436 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e66d75-68be-46b2-ae01-47cead98c3e3 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:44.179716 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e66d75-68be-46b2-ae01-47cead98c3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:44.179991 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e66d75-68be-46b2-ae01-47cead98c3e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:44.180711 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e66d75-68be-46b2-ae01-47cead98c3e3 None admin] RBAC: Adding query filter params (role.id=938d531e06764249874d708978e7a0e9, scope.project.id=ce09f0beb1a342febbb4a8b3c7cf60c2, user.id=35441c061e514b1b9341e7694ec2c0bc) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:44.181018 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e66d75-68be-46b2-ae01-47cead98c3e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:44.182500 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e66d75-68be-46b2-ae01-47cead98c3e3 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:44.188348 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 331/647] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Aug 29 22:32:44 2022] GET /identity/v3/role_assignments?user.id=35441c061e514b1b9341e7694ec2c0bc&scope.project.id=ce09f0beb1a342febbb4a8b3c7cf60c2&role.id=938d531e06764249874d708978e7a0e9 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:44.189058 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e66d75-68be-46b2-ae01-47cead98c3e3 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:44.196568 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6424d278-be53-4bff-87c5-de766e9c0645 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:44.238303 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42a02f5-c4e1-44f8-8f37-52cd92aa753b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:44.238937 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a02f5-c4e1-44f8-8f37-52cd92aa753b None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:44.239221 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a02f5-c4e1-44f8-8f37-52cd92aa753b None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:44.239505 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a02f5-c4e1-44f8-8f37-52cd92aa753b None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:44.240193 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42a02f5-c4e1-44f8-8f37-52cd92aa753b None admin] RBAC: Adding query filter params (name=service) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:44.240500 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42a02f5-c4e1-44f8-8f37-52cd92aa753b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:44.242824 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42a02f5-c4e1-44f8-8f37-52cd92aa753b None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:44.253876 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:44.257869 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 317/648] 10.222.0.47 () {56 vars in 1103 bytes} [Mon Aug 29 22:32:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:44.258833 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42a02f5-c4e1-44f8-8f37-52cd92aa753b None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:44.323055 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e66d75-68be-46b2-ae01-47cead98c3e3 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:44.365206 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c361754-a665-4ad4-afce-3c00bf420421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:44.365860 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c361754-a665-4ad4-afce-3c00bf420421 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:44.366137 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c361754-a665-4ad4-afce-3c00bf420421 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:44.367155 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c361754-a665-4ad4-afce-3c00bf420421 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:44.374754 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42a02f5-c4e1-44f8-8f37-52cd92aa753b None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:44.399268 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:44.420581 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e1ceba-b072-4628-80dc-63d9f7616309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:44.421240 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1ceba-b072-4628-80dc-63d9f7616309 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:44.421569 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1ceba-b072-4628-80dc-63d9f7616309 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:44.421849 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1ceba-b072-4628-80dc-63d9f7616309 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:44.429805 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e1ceba-b072-4628-80dc-63d9f7616309 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:44.431267 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e1ceba-b072-4628-80dc-63d9f7616309 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:44.444027 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-87e1ceba-b072-4628-80dc-63d9f7616309 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:32:44.444027 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:44.444027 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:44.444027 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:44.444027 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:44.444027 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:44.444027 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:44.444027 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:44.444027 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:44.444027 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:44.444027 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:44.444027 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:44.444027 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:32:44.444027 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:32:44.444027 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:32:44.449673 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:32:44.449673 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:44.449673 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:44.449673 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:44.449673 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:44.449673 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:44.449673 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:44.449673 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:44.449673 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:44.449673 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:44.449673 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:44.449673 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:44.449673 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:44.449673 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:44.449673 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:44.449673 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:44.449673 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:44.450865 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:32:44.450865 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:32:44.450865 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:32:44.450865 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:32:44.450865 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:32:44.450865 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:32:44.450865 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:32:44.450865 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:32:44.450865 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 318/649] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Aug 29 22:32:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:44.450865 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e1ceba-b072-4628-80dc-63d9f7616309 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:44.455246 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c361754-a665-4ad4-afce-3c00bf420421 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:44.456736 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c361754-a665-4ad4-afce-3c00bf420421 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:44.516427 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:44.559702 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e1ceba-b072-4628-80dc-63d9f7616309 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:44.572830 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 332/650] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Aug 29 22:32:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:32:44.572830 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c361754-a665-4ad4-afce-3c00bf420421 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:44.601406 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82984c3c-2dfc-4452-8925-da72e0e87a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:44.601998 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82984c3c-2dfc-4452-8925-da72e0e87a32 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:44.602399 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82984c3c-2dfc-4452-8925-da72e0e87a32 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:44.602686 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82984c3c-2dfc-4452-8925-da72e0e87a32 None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:44.603339 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82984c3c-2dfc-4452-8925-da72e0e87a32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:44.603645 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82984c3c-2dfc-4452-8925-da72e0e87a32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:44.605013 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82984c3c-2dfc-4452-8925-da72e0e87a32 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:44.623445 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 319/651] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:32:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:44.623445 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82984c3c-2dfc-4452-8925-da72e0e87a32 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:44.666710 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:44.682349 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c361754-a665-4ad4-afce-3c00bf420421 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:44.720976 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f40f811-f579-4c58-8a8b-9f6e44169743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:44.721635 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40f811-f579-4c58-8a8b-9f6e44169743 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:44.721909 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40f811-f579-4c58-8a8b-9f6e44169743 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:44.722178 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40f811-f579-4c58-8a8b-9f6e44169743 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:44.733033 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f40f811-f579-4c58-8a8b-9f6e44169743 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:44.734506 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f40f811-f579-4c58-8a8b-9f6e44169743 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:44.736228 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82984c3c-2dfc-4452-8925-da72e0e87a32 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:44.750483 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-5f40f811-f579-4c58-8a8b-9f6e44169743 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:44.750483 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:44.750483 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:44.750483 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:44.750483 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:44.750483 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:44.750483 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:44.750483 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:44.750483 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:44.750483 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:44.750483 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:44.750483 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:44.750483 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:32:44.750483 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:32:44.750483 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:32:44.750483 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:32:44.751478 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:44.751478 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:44.751478 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:44.751478 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:44.751478 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:44.751478 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:44.751478 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:44.751478 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:44.751478 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:44.751478 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:44.751478 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:44.751478 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:44.751478 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:44.751478 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:44.751478 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:44.751478 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:44.751478 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:32:44.752362 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:32:44.752362 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:44.752362 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:32:44.752362 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 333/652] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:32:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:44.753508 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f40f811-f579-4c58-8a8b-9f6e44169743 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:44.757654 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:44.790908 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd14bdbe-cd3f-4a78-a76a-68472500d7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:44.791718 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd14bdbe-cd3f-4a78-a76a-68472500d7c9 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:44.792004 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd14bdbe-cd3f-4a78-a76a-68472500d7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:44.792281 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd14bdbe-cd3f-4a78-a76a-68472500d7c9 None admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:44.792995 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd14bdbe-cd3f-4a78-a76a-68472500d7c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:44.793492 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd14bdbe-cd3f-4a78-a76a-68472500d7c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:44.795756 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd14bdbe-cd3f-4a78-a76a-68472500d7c9 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:44.816036 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 320/653] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Aug 29 22:32:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:44.816036 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd14bdbe-cd3f-4a78-a76a-68472500d7c9 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:44.863087 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f40f811-f579-4c58-8a8b-9f6e44169743 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:44.900198 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee97c51f-3939-4a78-98e5-d6edf9781234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:44.900835 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee97c51f-3939-4a78-98e5-d6edf9781234 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:44.901118 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee97c51f-3939-4a78-98e5-d6edf9781234 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:44.901421 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee97c51f-3939-4a78-98e5-d6edf9781234 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:44.915254 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee97c51f-3939-4a78-98e5-d6edf9781234 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:44.916737 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee97c51f-3939-4a78-98e5-d6edf9781234 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:44.931334 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-ee97c51f-3939-4a78-98e5-d6edf9781234 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:44.931334 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:44.931334 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:44.931334 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:44.931334 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:44.931334 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:44.931334 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:44.931334 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:44.931334 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:44.931334 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:44.931334 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:44.931334 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:44.931334 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:32:44.931334 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:32:44.931334 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:32:44.931334 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:32:44.932426 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:44.932426 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:44.932426 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:44.932426 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:44.932426 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:44.932426 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:44.932426 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:44.932426 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:44.932426 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:44.932426 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:44.932426 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:44.932426 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:44.932426 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:44.932426 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:44.932426 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:44.932426 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:44.932426 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:32:44.933380 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:32:44.933380 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:44.933380 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:32:44.933380 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 334/654] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:32:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:44.933628 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee97c51f-3939-4a78-98e5-d6edf9781234 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:44.938393 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:44.941653 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd14bdbe-cd3f-4a78-a76a-68472500d7c9 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:44.981431 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50284be-5bf0-48c6-b8cd-313da7e2ed4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:44.982443 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50284be-5bf0-48c6-b8cd-313da7e2ed4a None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:44.982899 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50284be-5bf0-48c6-b8cd-313da7e2ed4a None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:44.983439 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50284be-5bf0-48c6-b8cd-313da7e2ed4a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:44.991889 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50284be-5bf0-48c6-b8cd-313da7e2ed4a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:44.993398 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:44.994522 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50284be-5bf0-48c6-b8cd-313da7e2ed4a None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:45.008306 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-c50284be-5bf0-48c6-b8cd-313da7e2ed4a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 22:32:45.008306 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:45.008306 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:45.008306 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:45.008306 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:45.008306 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:45.008306 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:45.008306 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:45.008306 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:45.008306 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:45.008306 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:45.008306 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:45.008306 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:32:45.008306 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:32:45.008306 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:32:45.008306 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:32:45.009237 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:45.009237 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:45.009237 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:32:45.009237 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:32:45.009237 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:32:45.009237 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:32:45.009237 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:45.009237 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:45.009237 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:45.009237 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:45.009237 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:45.009237 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:45.009237 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:45.009237 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:45.009237 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:45.009237 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:45.009237 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:45.009237 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:45.010342 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:45.010342 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:45.010342 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:32:45.010342 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:32:45.010342 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:32:45.010342 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:32:45.010342 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:32:45.010342 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:32:45.010342 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 22:32:45.010342 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:32:45.010342 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 321/655] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Aug 29 22:32:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:45.010342 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50284be-5bf0-48c6-b8cd-313da7e2ed4a None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:45.047884 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee97c51f-3939-4a78-98e5-d6edf9781234 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:45.088907 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf69ea-08dd-4314-8994-5d3c38985f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:45.089603 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf69ea-08dd-4314-8994-5d3c38985f59 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:45.089886 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf69ea-08dd-4314-8994-5d3c38985f59 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:45.090158 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf69ea-08dd-4314-8994-5d3c38985f59 None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:45.090805 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdf69ea-08dd-4314-8994-5d3c38985f59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:45.091105 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdf69ea-08dd-4314-8994-5d3c38985f59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:45.092489 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdf69ea-08dd-4314-8994-5d3c38985f59 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:45.112910 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 335/656] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:32:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:45.112910 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf69ea-08dd-4314-8994-5d3c38985f59 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:45.131382 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50284be-5bf0-48c6-b8cd-313da7e2ed4a None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:45.175513 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff582c-af0a-4a0a-932b-9a15fbe6d358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:45.176176 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff582c-af0a-4a0a-932b-9a15fbe6d358 None admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:45.176541 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff582c-af0a-4a0a-932b-9a15fbe6d358 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:45.176717 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff582c-af0a-4a0a-932b-9a15fbe6d358 None admin] PATH_INFO: `/v3/projects/ce09f0beb1a342febbb4a8b3c7cf60c2/users/388d8dea2edf4fb888d42ca878c1434d/roles/938d531e06764249874d708978e7a0e9` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:45.196522 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ff582c-af0a-4a0a-932b-9a15fbe6d358 None admin] RBAC: Authorizing `identity:create_grant(project_id=ce09f0beb1a342febbb4a8b3c7cf60c2, user_id=388d8dea2edf4fb888d42ca878c1434d, role_id=938d531e06764249874d708978e7a0e9)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:45.199711 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ff582c-af0a-4a0a-932b-9a15fbe6d358 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:45.215283 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 322/657] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Aug 29 22:32:45 2022] PUT /identity/v3/projects/ce09f0beb1a342febbb4a8b3c7cf60c2/users/388d8dea2edf4fb888d42ca878c1434d/roles/938d531e06764249874d708978e7a0e9 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:32:45.216106 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff582c-af0a-4a0a-932b-9a15fbe6d358 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:45.238122 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:45.248291 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf69ea-08dd-4314-8994-5d3c38985f59 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:45.293830 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:45.308297 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a829b7f1-b479-4156-822f-13769fd45dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:45.309031 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a829b7f1-b479-4156-822f-13769fd45dd3 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:45.309650 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a829b7f1-b479-4156-822f-13769fd45dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:45.309936 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a829b7f1-b479-4156-822f-13769fd45dd3 None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:45.310603 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a829b7f1-b479-4156-822f-13769fd45dd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:45.310987 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a829b7f1-b479-4156-822f-13769fd45dd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:45.312417 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a829b7f1-b479-4156-822f-13769fd45dd3 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:45.325876 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 336/658] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:32:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:45.326808 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a829b7f1-b479-4156-822f-13769fd45dd3 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:45.382634 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff582c-af0a-4a0a-932b-9a15fbe6d358 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:45.435334 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a8298b-039d-4d61-a515-79b94c621e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:45.435993 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8298b-039d-4d61-a515-79b94c621e39 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:45.436278 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8298b-039d-4d61-a515-79b94c621e39 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:45.436588 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8298b-039d-4d61-a515-79b94c621e39 None admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:45.437868 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a8298b-039d-4d61-a515-79b94c621e39 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:45.438175 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a8298b-039d-4d61-a515-79b94c621e39 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:45.439903 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a8298b-039d-4d61-a515-79b94c621e39 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:45.456765 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a829b7f1-b479-4156-822f-13769fd45dd3 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:45.466782 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 323/659] 10.222.0.47 () {56 vars in 1137 bytes} [Mon Aug 29 22:32:45 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:45.467799 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a8298b-039d-4d61-a515-79b94c621e39 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:45.509348 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeecf65-5d46-41b6-935a-4e2e777a4b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:45.509988 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeecf65-5d46-41b6-935a-4e2e777a4b80 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:45.510269 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeecf65-5d46-41b6-935a-4e2e777a4b80 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:45.510557 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeecf65-5d46-41b6-935a-4e2e777a4b80 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:45.521566 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeecf65-5d46-41b6-935a-4e2e777a4b80 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:45.524603 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeecf65-5d46-41b6-935a-4e2e777a4b80 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:45.544327 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-5eeecf65-5d46-41b6-935a-4e2e777a4b80 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 22:32:45.544327 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:45.544327 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:45.544327 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:45.544327 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:45.544327 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:45.544327 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:45.544327 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:45.544327 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:45.544327 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:45.544327 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:45.544327 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:45.544327 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:32:45.544327 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:32:45.544327 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:32:45.544327 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:32:45.545377 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:45.545377 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:45.545377 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:32:45.545377 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:32:45.545377 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:32:45.545377 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:32:45.545377 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:45.545377 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:45.545377 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:45.545377 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:45.545377 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:45.545377 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:45.545377 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:45.545377 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:45.545377 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:45.545377 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:45.545377 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:45.545377 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:45.546319 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:45.546319 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:45.546319 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:32:45.546319 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:32:45.546319 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:32:45.546319 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:32:45.546319 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:32:45.546319 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:32:45.546319 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 22:32:45.546319 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:32:45.546319 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 337/660] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Aug 29 22:32:45 2022] GET /identity/v3/users/neutron => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:45.550863 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeecf65-5d46-41b6-935a-4e2e777a4b80 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:45.564517 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:45.598177 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:45.615903 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a8298b-039d-4d61-a515-79b94c621e39 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:45.666075 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee8152-baae-48d0-aa40-4283db481a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:45.666890 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee8152-baae-48d0-aa40-4283db481a85 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:45.667307 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee8152-baae-48d0-aa40-4283db481a85 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:45.667597 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee8152-baae-48d0-aa40-4283db481a85 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:45.672559 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeecf65-5d46-41b6-935a-4e2e777a4b80 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:45.677064 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ee8152-baae-48d0-aa40-4283db481a85 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:45.678600 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ee8152-baae-48d0-aa40-4283db481a85 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:45.695047 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-d3ee8152-baae-48d0-aa40-4283db481a85 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:32:45.695047 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:45.695047 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:45.695047 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:45.695047 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:45.695047 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:45.695047 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:45.695047 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:45.695047 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:45.695047 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:45.695047 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:45.695047 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:45.695047 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:32:45.695047 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:32:45.695047 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:32:45.696289 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:32:45.696289 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:45.696289 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:45.696289 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:45.696289 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:45.696289 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:45.696289 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:45.696289 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:45.696289 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:45.696289 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:45.696289 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:45.696289 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:45.696289 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:45.696289 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:45.696289 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:45.696289 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:45.696289 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:45.697240 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:32:45.697240 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:32:45.697240 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:32:45.697240 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:32:45.697240 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:32:45.697240 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:32:45.697240 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:32:45.697240 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:32:45.697240 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 324/661] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Aug 29 22:32:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:45.702569 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee8152-baae-48d0-aa40-4283db481a85 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:45.722242 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fd969c-d09f-4705-bd1d-7039a39d2094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:45.723222 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd969c-d09f-4705-bd1d-7039a39d2094 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:45.723762 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd969c-d09f-4705-bd1d-7039a39d2094 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:45.724230 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd969c-d09f-4705-bd1d-7039a39d2094 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:45.799851 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fd969c-d09f-4705-bd1d-7039a39d2094 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:45.801693 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fd969c-d09f-4705-bd1d-7039a39d2094 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:45.842177 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee8152-baae-48d0-aa40-4283db481a85 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:45.848727 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:45.881376 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:45.895935 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0367b958-0962-4bfc-bc4a-81833b8c99f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:45.896561 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367b958-0962-4bfc-bc4a-81833b8c99f4 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:45.896845 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367b958-0962-4bfc-bc4a-81833b8c99f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:45.897124 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367b958-0962-4bfc-bc4a-81833b8c99f4 None admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:45.898046 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0367b958-0962-4bfc-bc4a-81833b8c99f4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:45.898358 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0367b958-0962-4bfc-bc4a-81833b8c99f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:45.900397 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0367b958-0962-4bfc-bc4a-81833b8c99f4 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:45.924696 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 325/662] 10.222.0.47 () {56 vars in 1139 bytes} [Mon Aug 29 22:32:45 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:45.925892 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0367b958-0962-4bfc-bc4a-81833b8c99f4 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:45.936556 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 338/663] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Aug 29 22:32:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:32:45.937549 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fd969c-d09f-4705-bd1d-7039a39d2094 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:46.043935 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0367b958-0962-4bfc-bc4a-81833b8c99f4 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:46.050320 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fd969c-d09f-4705-bd1d-7039a39d2094 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:46.084822 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d21a6e-9905-4ca7-a154-a0418190d290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:46.086207 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d21a6e-9905-4ca7-a154-a0418190d290 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:46.086593 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d21a6e-9905-4ca7-a154-a0418190d290 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:46.087192 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d21a6e-9905-4ca7-a154-a0418190d290 None admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:46.088224 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d21a6e-9905-4ca7-a154-a0418190d290 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:46.088724 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d21a6e-9905-4ca7-a154-a0418190d290 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:46.089426 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a5a610-6cbf-412e-ba21-146c92b786ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:46.090207 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5a610-6cbf-412e-ba21-146c92b786ea None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:46.090448 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d21a6e-9905-4ca7-a154-a0418190d290 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:46.090792 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5a610-6cbf-412e-ba21-146c92b786ea None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:46.091204 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5a610-6cbf-412e-ba21-146c92b786ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:46.095275 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:46.104985 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 326/664] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Aug 29 22:32:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:46.106050 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d21a6e-9905-4ca7-a154-a0418190d290 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:46.156219 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:46.171493 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a5a610-6cbf-412e-ba21-146c92b786ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:46.173306 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a5a610-6cbf-412e-ba21-146c92b786ea None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:46.217726 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d21a6e-9905-4ca7-a154-a0418190d290 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:46.257446 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09716fb-3fdc-4692-b9fe-c0e5f549ed72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:46.258673 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09716fb-3fdc-4692-b9fe-c0e5f549ed72 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:46.258954 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09716fb-3fdc-4692-b9fe-c0e5f549ed72 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:46.259258 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09716fb-3fdc-4692-b9fe-c0e5f549ed72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:46.271281 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09716fb-3fdc-4692-b9fe-c0e5f549ed72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:46.273212 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09716fb-3fdc-4692-b9fe-c0e5f549ed72 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:46.289531 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-b09716fb-3fdc-4692-b9fe-c0e5f549ed72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:46.289531 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:46.289531 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:46.289531 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:46.289531 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:46.289531 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:46.289531 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:46.289531 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:46.289531 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:46.289531 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:46.289531 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:46.289531 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:46.289531 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:32:46.289531 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:32:46.289531 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:32:46.289531 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:32:46.290644 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:46.290644 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:46.290644 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:46.290644 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:46.290644 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:46.290644 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:46.290644 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:46.290644 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:46.290644 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:46.290644 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:46.290644 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:46.290644 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:46.290644 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:46.290644 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:46.290644 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:46.290644 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:46.290644 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:32:46.291819 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:32:46.291819 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:46.291819 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:32:46.295017 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 327/665] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:32:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:46.295528 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 339/666] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Aug 29 22:32:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:32:46.295858 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09716fb-3fdc-4692-b9fe-c0e5f549ed72 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:46.297193 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6d094-1930-47b7-9a04-6c07ee505ce7 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:46.297645 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6d094-1930-47b7-9a04-6c07ee505ce7 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:46.298041 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6d094-1930-47b7-9a04-6c07ee505ce7 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:46.299397 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 340/667] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:32:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:32:46.300435 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac6d094-1930-47b7-9a04-6c07ee505ce7 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:46.344083 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:46.411050 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:46.416219 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09716fb-3fdc-4692-b9fe-c0e5f549ed72 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:46.427449 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac6d094-1930-47b7-9a04-6c07ee505ce7 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:46.456408 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dda278c-89c6-4b51-8f96-0763ce465637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:46.457111 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda278c-89c6-4b51-8f96-0763ce465637 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:46.457497 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda278c-89c6-4b51-8f96-0763ce465637 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:46.457776 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda278c-89c6-4b51-8f96-0763ce465637 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:46.458503 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dda278c-89c6-4b51-8f96-0763ce465637 None admin] RBAC: Adding query filter params (role.id=938d531e06764249874d708978e7a0e9, scope.project.id=ce09f0beb1a342febbb4a8b3c7cf60c2, user.id=a5c4e692fd714354b96bd3ef4fcecdd0) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:46.458811 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dda278c-89c6-4b51-8f96-0763ce465637 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:46.460731 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dda278c-89c6-4b51-8f96-0763ce465637 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:46.466236 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3eae7d-c4e9-4c85-af4e-5c9d52e1792b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:46.477596 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 328/668] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Aug 29 22:32:46 2022] GET /identity/v3/role_assignments?user.id=a5c4e692fd714354b96bd3ef4fcecdd0&scope.project.id=ce09f0beb1a342febbb4a8b3c7cf60c2&role.id=938d531e06764249874d708978e7a0e9 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:46.477801 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3eae7d-c4e9-4c85-af4e-5c9d52e1792b None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:46.477801 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3eae7d-c4e9-4c85-af4e-5c9d52e1792b None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:46.477801 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3eae7d-c4e9-4c85-af4e-5c9d52e1792b None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:46.478026 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dda278c-89c6-4b51-8f96-0763ce465637 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:46.478104 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3eae7d-c4e9-4c85-af4e-5c9d52e1792b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:46.478104 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3eae7d-c4e9-4c85-af4e-5c9d52e1792b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:46.478104 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3eae7d-c4e9-4c85-af4e-5c9d52e1792b None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:46.483645 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 341/669] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:32:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:46.484955 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865bdb0b-476a-4ccf-8194-0902772135e7 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:46.485242 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865bdb0b-476a-4ccf-8194-0902772135e7 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:46.485548 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865bdb0b-476a-4ccf-8194-0902772135e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:46.508021 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-865bdb0b-476a-4ccf-8194-0902772135e7 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:32:46.509262 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-865bdb0b-476a-4ccf-8194-0902772135e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:46.586656 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 342/670] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:32:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:32:46.587624 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865bdb0b-476a-4ccf-8194-0902772135e7 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:46.623293 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dda278c-89c6-4b51-8f96-0763ce465637 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:46.639741 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:46.682752 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a156d6-1006-40cd-8fb0-b845bce7ecb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:46.683566 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a156d6-1006-40cd-8fb0-b845bce7ecb7 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:46.683852 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a156d6-1006-40cd-8fb0-b845bce7ecb7 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:46.684536 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a156d6-1006-40cd-8fb0-b845bce7ecb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:46.699619 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a156d6-1006-40cd-8fb0-b845bce7ecb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:46.701650 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a156d6-1006-40cd-8fb0-b845bce7ecb7 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:46.723519 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-31a156d6-1006-40cd-8fb0-b845bce7ecb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:46.723519 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:46.723519 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:46.723519 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:46.723519 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:46.723519 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:46.723519 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:46.723519 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:46.723519 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:46.723519 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:46.723519 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:46.723519 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:46.723519 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:32:46.723519 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:32:46.723519 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:32:46.723519 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:32:46.724509 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:46.724509 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:46.724509 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:46.724509 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:46.724509 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:46.724509 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:46.724509 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:46.724509 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:46.724509 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:46.724509 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:46.724509 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:46.724509 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:46.724509 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:46.724509 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:46.724509 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:46.724509 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:46.724509 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:32:46.725461 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:32:46.725461 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:46.725461 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:32:46.726270 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 329/671] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:32:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:46.739356 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a156d6-1006-40cd-8fb0-b845bce7ecb7 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:46.744851 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865bdb0b-476a-4ccf-8194-0902772135e7 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:46.761295 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:46.787590 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cae054-405d-45b1-8e8c-6e9ed729c660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:46.788786 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cae054-405d-45b1-8e8c-6e9ed729c660 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:46.789112 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cae054-405d-45b1-8e8c-6e9ed729c660 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:46.789417 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cae054-405d-45b1-8e8c-6e9ed729c660 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:46.796652 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cae054-405d-45b1-8e8c-6e9ed729c660 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:46.799215 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cae054-405d-45b1-8e8c-6e9ed729c660 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:46.811605 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-38cae054-405d-45b1-8e8c-6e9ed729c660 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:32:46.811605 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:46.811605 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:46.811605 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:46.811605 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:46.811605 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:46.811605 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:46.811605 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:46.811605 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:46.811605 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:46.811605 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:46.811605 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:46.811605 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:32:46.811605 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:32:46.811605 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:32:46.813677 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:32:46.813677 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:46.813677 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:46.813677 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:46.813677 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:46.813677 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:46.813677 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:46.813677 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:46.813677 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:46.813677 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:46.813677 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:46.813677 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:46.813677 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:46.813677 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:46.813677 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:46.813677 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:46.813677 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:46.815778 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:32:46.815778 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:32:46.815778 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:32:46.815778 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:32:46.815778 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:32:46.815778 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:32:46.815778 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:32:46.815778 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:32:46.820261 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 343/672] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Aug 29 22:32:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:46.820261 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cae054-405d-45b1-8e8c-6e9ed729c660 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:46.858595 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a156d6-1006-40cd-8fb0-b845bce7ecb7 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:46.899049 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f48c23c-f6c2-4085-8680-0ddd863f6afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:46.899730 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f48c23c-f6c2-4085-8680-0ddd863f6afc None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:46.900014 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f48c23c-f6c2-4085-8680-0ddd863f6afc None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:46.900495 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f48c23c-f6c2-4085-8680-0ddd863f6afc None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:46.901584 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f48c23c-f6c2-4085-8680-0ddd863f6afc None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:46.902011 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f48c23c-f6c2-4085-8680-0ddd863f6afc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:46.903406 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f48c23c-f6c2-4085-8680-0ddd863f6afc None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:46.920022 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 330/673] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:32:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:46.920894 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f48c23c-f6c2-4085-8680-0ddd863f6afc None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:46.925543 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:46.944571 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cae054-405d-45b1-8e8c-6e9ed729c660 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:46.989652 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc15008-bc9f-40a7-b348-55293a02c066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:46.990362 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc15008-bc9f-40a7-b348-55293a02c066 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:46.990646 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc15008-bc9f-40a7-b348-55293a02c066 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:46.990920 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc15008-bc9f-40a7-b348-55293a02c066 None admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:46.992330 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc15008-bc9f-40a7-b348-55293a02c066 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:46.992635 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc15008-bc9f-40a7-b348-55293a02c066 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:46.994641 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc15008-bc9f-40a7-b348-55293a02c066 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:47.010867 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 344/674] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Aug 29 22:32:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:47.012898 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc15008-bc9f-40a7-b348-55293a02c066 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:47.023233 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:47.065223 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f48c23c-f6c2-4085-8680-0ddd863f6afc None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:47.109500 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b4b09-fdc3-4590-8dec-5efed4c71e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:47.110535 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b4b09-fdc3-4590-8dec-5efed4c71e49 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:47.111041 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b4b09-fdc3-4590-8dec-5efed4c71e49 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:47.111521 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b4b09-fdc3-4590-8dec-5efed4c71e49 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:47.123308 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178b4b09-fdc3-4590-8dec-5efed4c71e49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:32:47.128795 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-178b4b09-fdc3-4590-8dec-5efed4c71e49 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:32:47.128795 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:47.128795 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:47.128795 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:47.128795 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:47.128795 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:47.128795 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:47.128795 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:47.128795 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:47.128795 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:47.128795 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:47.128795 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:47.128795 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:32:47.128795 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:32:47.128795 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:32:47.128795 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:32:47.129754 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:32:47.129754 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:32:47.129754 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:32:47.129754 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:32:47.129754 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:47.129754 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:47.129754 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:47.129754 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:47.129754 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:47.129754 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:47.129754 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:47.129754 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:47.129754 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:47.129754 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:47.129754 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:47.129754 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:47.130568 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:47.130568 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:47.130568 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:47.130568 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:47.130568 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:32:47.130568 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:32:47.130568 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:32:47.130568 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:32:47.130568 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:32:47.130568 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:32:47.130568 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:32:47.130568 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:32:47.134097 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 331/675] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Aug 29 22:32:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:47.135233 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b4b09-fdc3-4590-8dec-5efed4c71e49 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:47.140925 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc15008-bc9f-40a7-b348-55293a02c066 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:47.182651 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b43eea-b58c-46b5-aae6-03415116ab91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:47.183813 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b43eea-b58c-46b5-aae6-03415116ab91 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:47.184310 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b43eea-b58c-46b5-aae6-03415116ab91 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:47.184774 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b43eea-b58c-46b5-aae6-03415116ab91 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:47.192330 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b43eea-b58c-46b5-aae6-03415116ab91 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:47.194054 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b43eea-b58c-46b5-aae6-03415116ab91 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:47.207015 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-53b43eea-b58c-46b5-aae6-03415116ab91 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:32:47.207015 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:47.207015 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:47.207015 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:47.207015 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:47.207015 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:47.207015 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:47.207015 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:47.207015 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:47.207015 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:47.207015 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:47.207015 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:47.207015 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:32:47.207015 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:32:47.207015 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:32:47.207938 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:32:47.207938 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:47.207938 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:47.207938 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:47.207938 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:47.207938 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:47.207938 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:47.207938 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:47.207938 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:47.207938 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:47.207938 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:47.207938 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:47.207938 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:47.207938 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:47.207938 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:47.207938 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:47.207938 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:47.208795 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:32:47.208795 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:32:47.208795 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:32:47.208795 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:32:47.208795 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:32:47.208795 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:32:47.208795 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:32:47.208795 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:32:47.216222 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 345/676] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Aug 29 22:32:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:47.216222 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b43eea-b58c-46b5-aae6-03415116ab91 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:47.225802 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:47.259350 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b4b09-fdc3-4590-8dec-5efed4c71e49 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:47.301099 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7fe014-5b5f-4838-85f6-bcd9498013c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:47.301750 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fe014-5b5f-4838-85f6-bcd9498013c0 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:47.302027 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fe014-5b5f-4838-85f6-bcd9498013c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:47.302299 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fe014-5b5f-4838-85f6-bcd9498013c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:47.306253 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7fe014-5b5f-4838-85f6-bcd9498013c0 None admin] RBAC: Adding query filter params (role.id=938d531e06764249874d708978e7a0e9, scope.project.id=ce09f0beb1a342febbb4a8b3c7cf60c2, user.id=d6a05d7ad37e4547bada8aabc0fcb64b) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:47.306253 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7fe014-5b5f-4838-85f6-bcd9498013c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:47.306253 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7fe014-5b5f-4838-85f6-bcd9498013c0 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:47.309166 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:47.315670 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 332/677] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Aug 29 22:32:47 2022] GET /identity/v3/role_assignments?user.id=d6a05d7ad37e4547bada8aabc0fcb64b&scope.project.id=ce09f0beb1a342febbb4a8b3c7cf60c2&role.id=938d531e06764249874d708978e7a0e9 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:47.316972 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db785bfd-3c14-4c24-a382-7ce517ba66f2 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:47.317316 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db785bfd-3c14-4c24-a382-7ce517ba66f2 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:47.317675 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db785bfd-3c14-4c24-a382-7ce517ba66f2 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:47.323884 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 333/678] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:32:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:32:47.324922 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db785bfd-3c14-4c24-a382-7ce517ba66f2 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:47.334124 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b43eea-b58c-46b5-aae6-03415116ab91 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:47.372711 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8688ede6-3d87-4475-b6be-07940d8fdf16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:47.373654 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8688ede6-3d87-4475-b6be-07940d8fdf16 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:47.374116 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8688ede6-3d87-4475-b6be-07940d8fdf16 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:47.374535 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8688ede6-3d87-4475-b6be-07940d8fdf16 None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:47.375410 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8688ede6-3d87-4475-b6be-07940d8fdf16 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:47.375880 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8688ede6-3d87-4475-b6be-07940d8fdf16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:47.377272 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8688ede6-3d87-4475-b6be-07940d8fdf16 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:47.391949 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 346/679] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Aug 29 22:32:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:47.393431 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70447775-1b2a-4225-b960-5d8d1c748f3f None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:47.393727 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70447775-1b2a-4225-b960-5d8d1c748f3f None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:47.394003 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70447775-1b2a-4225-b960-5d8d1c748f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:47.415127 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-70447775-1b2a-4225-b960-5d8d1c748f3f None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:32:47.416487 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-70447775-1b2a-4225-b960-5d8d1c748f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:47.473488 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db785bfd-3c14-4c24-a382-7ce517ba66f2 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:47.493655 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:47.501409 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 347/680] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:32:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:32:47.502954 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70447775-1b2a-4225-b960-5d8d1c748f3f None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:47.517401 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1216b7d-6d86-4ae1-bdcb-7017aa67cec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:47.518002 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1216b7d-6d86-4ae1-bdcb-7017aa67cec2 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:47.518282 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1216b7d-6d86-4ae1-bdcb-7017aa67cec2 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:47.518549 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1216b7d-6d86-4ae1-bdcb-7017aa67cec2 None admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:47.519427 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1216b7d-6d86-4ae1-bdcb-7017aa67cec2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:47.519735 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1216b7d-6d86-4ae1-bdcb-7017aa67cec2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:47.521169 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1216b7d-6d86-4ae1-bdcb-7017aa67cec2 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:47.541365 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 334/681] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Aug 29 22:32:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:47.543542 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1216b7d-6d86-4ae1-bdcb-7017aa67cec2 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:47.614035 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:47.646964 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70447775-1b2a-4225-b960-5d8d1c748f3f None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:47.668621 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1216b7d-6d86-4ae1-bdcb-7017aa67cec2 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:47.698370 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c0882-9baf-42c9-945d-9d5501379a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:47.699936 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c0882-9baf-42c9-945d-9d5501379a06 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:47.700434 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c0882-9baf-42c9-945d-9d5501379a06 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:47.701060 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c0882-9baf-42c9-945d-9d5501379a06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:47.706522 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ebec7e-7eea-44a7-b040-50ff3c30de84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:47.707138 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ebec7e-7eea-44a7-b040-50ff3c30de84 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:47.707419 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ebec7e-7eea-44a7-b040-50ff3c30de84 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:47.707691 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ebec7e-7eea-44a7-b040-50ff3c30de84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:47.708419 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ebec7e-7eea-44a7-b040-50ff3c30de84 None admin] RBAC: Adding query filter params (role.id=938d531e06764249874d708978e7a0e9, scope.project.id=ce09f0beb1a342febbb4a8b3c7cf60c2, user.id=27abbf7b40e54fc091ebfe10aa6da90d) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:47.708727 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ebec7e-7eea-44a7-b040-50ff3c30de84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:47.710397 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ebec7e-7eea-44a7-b040-50ff3c30de84 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:47.716258 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6c0882-9baf-42c9-945d-9d5501379a06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:47.716677 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 335/682] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Aug 29 22:32:47 2022] GET /identity/v3/role_assignments?user.id=27abbf7b40e54fc091ebfe10aa6da90d&scope.project.id=ce09f0beb1a342febbb4a8b3c7cf60c2&role.id=938d531e06764249874d708978e7a0e9 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:47.718407 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6c0882-9baf-42c9-945d-9d5501379a06 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:47.737468 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-8c6c0882-9baf-42c9-945d-9d5501379a06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:47.737468 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:47.737468 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:47.737468 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:47.737468 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:47.737468 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:47.737468 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:47.737468 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:47.737468 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:47.737468 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:47.737468 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:47.737468 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:47.737468 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:32:47.737468 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:32:47.737468 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:32:47.737468 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:32:47.738452 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:47.738452 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:47.738452 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:47.738452 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:47.738452 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:47.738452 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:47.738452 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:47.738452 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:47.738452 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:47.738452 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:47.738452 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:47.738452 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:47.738452 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:47.738452 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:47.738452 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:47.738452 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:47.738452 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:32:47.739431 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:32:47.739431 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:47.739431 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:32:47.742465 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 348/683] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:32:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:47.750486 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ebec7e-7eea-44a7-b040-50ff3c30de84 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:47.824703 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c0882-9baf-42c9-945d-9d5501379a06 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:47.935499 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:47.959294 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ebec7e-7eea-44a7-b040-50ff3c30de84 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:47.988957 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:48.004364 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d043654f-fcd7-4f5b-94b2-e956d0e6c0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:48.005478 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d043654f-fcd7-4f5b-94b2-e956d0e6c0eb None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:48.005985 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d043654f-fcd7-4f5b-94b2-e956d0e6c0eb None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:48.006477 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d043654f-fcd7-4f5b-94b2-e956d0e6c0eb None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:48.008047 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d043654f-fcd7-4f5b-94b2-e956d0e6c0eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:48.008563 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d043654f-fcd7-4f5b-94b2-e956d0e6c0eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:48.010352 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d043654f-fcd7-4f5b-94b2-e956d0e6c0eb None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:48.011933 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c0882-9baf-42c9-945d-9d5501379a06 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:48.032603 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 336/684] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:32:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:48.038312 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d043654f-fcd7-4f5b-94b2-e956d0e6c0eb None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:48.056824 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb136d-af14-4735-9f99-6b59889d4e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:48.057898 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb136d-af14-4735-9f99-6b59889d4e40 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:48.058403 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb136d-af14-4735-9f99-6b59889d4e40 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:48.058936 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb136d-af14-4735-9f99-6b59889d4e40 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:48.072300 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cb136d-af14-4735-9f99-6b59889d4e40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:32:48.078260 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-c1cb136d-af14-4735-9f99-6b59889d4e40 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:32:48.078260 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:48.078260 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:48.078260 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:48.078260 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:48.078260 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:48.078260 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:48.078260 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:48.078260 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:48.078260 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:48.078260 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:48.078260 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:48.078260 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:32:48.078260 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:32:48.078260 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:32:48.078260 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:32:48.079173 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:32:48.079173 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:32:48.079173 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:32:48.079173 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:32:48.079173 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:48.079173 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:48.079173 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:48.079173 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:48.079173 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:48.079173 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:48.079173 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:48.079173 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:48.079173 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:48.079173 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:48.079173 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:48.079173 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:48.080012 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:48.080012 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:48.080012 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:48.080012 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:48.080012 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:32:48.080012 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:32:48.080012 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:32:48.080012 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:32:48.080012 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:32:48.080012 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:32:48.080012 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:32:48.080012 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:32:48.082640 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 349/685] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Aug 29 22:32:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:32:48.088087 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb136d-af14-4735-9f99-6b59889d4e40 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:48.215568 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb136d-af14-4735-9f99-6b59889d4e40 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:48.231267 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:48.262920 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d043654f-fcd7-4f5b-94b2-e956d0e6c0eb None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:48.270138 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a21a38c-39c1-4506-83d7-f957d92fa321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:48.271086 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21a38c-39c1-4506-83d7-f957d92fa321 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:48.271595 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21a38c-39c1-4506-83d7-f957d92fa321 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:48.272072 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21a38c-39c1-4506-83d7-f957d92fa321 None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:48.273749 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a21a38c-39c1-4506-83d7-f957d92fa321 None admin] RBAC: Adding query filter params (name=service) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:48.275950 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a21a38c-39c1-4506-83d7-f957d92fa321 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:48.277646 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a21a38c-39c1-4506-83d7-f957d92fa321 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:48.301525 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 350/686] 10.222.0.47 () {56 vars in 1103 bytes} [Mon Aug 29 22:32:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:32:48.314777 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a21a38c-39c1-4506-83d7-f957d92fa321 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:48.342240 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97596ca9-5c91-4264-bdef-57366e8ead2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:48.342935 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97596ca9-5c91-4264-bdef-57366e8ead2e None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:48.343222 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97596ca9-5c91-4264-bdef-57366e8ead2e None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:48.343499 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97596ca9-5c91-4264-bdef-57366e8ead2e None admin] PATH_INFO: `/v3/users/nova` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:48.361418 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97596ca9-5c91-4264-bdef-57366e8ead2e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:48.362961 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97596ca9-5c91-4264-bdef-57366e8ead2e None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:48.393858 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-97596ca9-5c91-4264-bdef-57366e8ead2e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 22:32:48.393858 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:48.393858 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:48.393858 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:48.393858 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:48.393858 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:48.393858 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:48.393858 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:48.393858 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:48.393858 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:48.393858 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:48.393858 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:48.393858 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:32:48.393858 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:32:48.393858 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:32:48.393858 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:32:48.394852 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:48.394852 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:48.394852 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:32:48.394852 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:32:48.394852 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:32:48.394852 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:32:48.394852 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:48.394852 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:48.394852 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:48.394852 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:48.394852 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:48.394852 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:48.394852 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:48.394852 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:48.394852 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:48.394852 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:48.394852 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:48.394852 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:48.396040 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:48.396040 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:48.396040 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:32:48.396040 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:32:48.396040 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:32:48.396040 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:32:48.396040 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:32:48.396040 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:32:48.396040 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 22:32:48.396040 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:32:48.396040 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 337/687] 10.222.0.47 () {56 vars in 1093 bytes} [Mon Aug 29 22:32:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:48.406494 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97596ca9-5c91-4264-bdef-57366e8ead2e None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:48.478442 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a21a38c-39c1-4506-83d7-f957d92fa321 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:48.492168 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:48.515866 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d884425-b836-4fca-9693-b93d722c0b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:48.516424 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d884425-b836-4fca-9693-b93d722c0b90 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:48.516703 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d884425-b836-4fca-9693-b93d722c0b90 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:48.516976 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d884425-b836-4fca-9693-b93d722c0b90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:48.531704 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d884425-b836-4fca-9693-b93d722c0b90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:48.533286 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d884425-b836-4fca-9693-b93d722c0b90 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:48.550654 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-0d884425-b836-4fca-9693-b93d722c0b90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:48.550654 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:48.550654 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:48.550654 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:48.550654 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:48.550654 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:48.550654 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:48.550654 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:48.550654 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:48.550654 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:48.550654 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:48.550654 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:48.550654 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:32:48.550654 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:32:48.550654 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:32:48.550654 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:32:48.553303 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:48.553303 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:48.553303 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:48.553303 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:48.553303 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:48.553303 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:48.553303 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:48.553303 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:48.553303 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:48.553303 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:48.553303 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:48.553303 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:48.553303 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:48.553303 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:48.553303 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:48.553303 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:48.553303 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:32:48.555833 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:32:48.555833 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:48.555833 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:32:48.555833 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 351/688] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:32:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:48.562786 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d884425-b836-4fca-9693-b93d722c0b90 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:48.615460 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97596ca9-5c91-4264-bdef-57366e8ead2e None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:48.621683 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:48.674040 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc369ce5-948a-4cfa-9296-18a7502d401c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:48.674711 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc369ce5-948a-4cfa-9296-18a7502d401c None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:48.675001 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc369ce5-948a-4cfa-9296-18a7502d401c None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:48.675279 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc369ce5-948a-4cfa-9296-18a7502d401c None admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:48.676018 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc369ce5-948a-4cfa-9296-18a7502d401c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:48.676324 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc369ce5-948a-4cfa-9296-18a7502d401c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:48.677804 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc369ce5-948a-4cfa-9296-18a7502d401c None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:48.722893 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 338/689] 10.222.0.47 () {56 vars in 1133 bytes} [Mon Aug 29 22:32:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:48.730328 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc369ce5-948a-4cfa-9296-18a7502d401c None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:48.781601 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d884425-b836-4fca-9693-b93d722c0b90 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:48.852872 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b251e3-7c0c-4269-8f9b-814512102eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:48.853210 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:48.854115 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b251e3-7c0c-4269-8f9b-814512102eec None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:48.854641 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b251e3-7c0c-4269-8f9b-814512102eec None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:48.855094 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b251e3-7c0c-4269-8f9b-814512102eec None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:48.856006 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b251e3-7c0c-4269-8f9b-814512102eec None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:48.856526 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b251e3-7c0c-4269-8f9b-814512102eec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:48.856913 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc369ce5-948a-4cfa-9296-18a7502d401c None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:48.858380 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b251e3-7c0c-4269-8f9b-814512102eec None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:48.871771 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 352/690] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:32:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:48.873439 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5774e4-489d-45a6-97c2-627cae1fcb79 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:48.873922 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5774e4-489d-45a6-97c2-627cae1fcb79 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:48.874390 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5774e4-489d-45a6-97c2-627cae1fcb79 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:48.880074 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 353/691] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:32:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:32:48.881049 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5774e4-489d-45a6-97c2-627cae1fcb79 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:48.899687 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fef504-eddd-460b-80fb-bf003e5d3238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:48.900313 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fef504-eddd-460b-80fb-bf003e5d3238 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:48.900593 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fef504-eddd-460b-80fb-bf003e5d3238 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:48.900881 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fef504-eddd-460b-80fb-bf003e5d3238 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:48.991689 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fef504-eddd-460b-80fb-bf003e5d3238 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:48.993949 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fef504-eddd-460b-80fb-bf003e5d3238 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:49.005661 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:49.020520 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5774e4-489d-45a6-97c2-627cae1fcb79 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:49.071403 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb6dc33-b6f4-4300-94f6-7837e223f836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:49.072049 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6dc33-b6f4-4300-94f6-7837e223f836 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:49.072330 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6dc33-b6f4-4300-94f6-7837e223f836 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:49.072667 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6dc33-b6f4-4300-94f6-7837e223f836 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:49.083934 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb6dc33-b6f4-4300-94f6-7837e223f836 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:49.086648 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb6dc33-b6f4-4300-94f6-7837e223f836 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:49.105093 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-bfb6dc33-b6f4-4300-94f6-7837e223f836 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 22:32:49.105093 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:49.105093 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:49.105093 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:49.105093 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:49.105093 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:49.105093 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:49.105093 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:49.105093 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:49.105093 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:49.105093 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:49.105093 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:49.105093 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:32:49.105093 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:32:49.105093 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:32:49.105093 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:32:49.106128 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:49.106128 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:49.106128 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:32:49.106128 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:32:49.106128 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:32:49.106128 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:32:49.106128 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:49.106128 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:49.106128 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:49.106128 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:49.106128 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:49.106128 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:49.106128 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:49.106128 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:49.106128 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:49.106128 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:49.106128 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:49.106128 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:49.107067 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:49.107067 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:49.107067 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:32:49.107067 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:32:49.107067 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:32:49.107067 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:32:49.107067 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:32:49.107067 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:32:49.107067 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 22:32:49.107067 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:32:49.107067 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 354/692] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Aug 29 22:32:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:49.108140 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382a1d8-3426-46a1-88a1-d178b78e00a2 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:49.113352 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382a1d8-3426-46a1-88a1-d178b78e00a2 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:49.113352 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382a1d8-3426-46a1-88a1-d178b78e00a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:49.132009 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-7382a1d8-3426-46a1-88a1-d178b78e00a2 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:32:49.133486 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-7382a1d8-3426-46a1-88a1-d178b78e00a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:49.136222 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:49.142098 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 339/693] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Aug 29 22:32:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:32:49.143152 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fef504-eddd-460b-80fb-bf003e5d3238 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:49.206953 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 355/694] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:32:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:32:49.208106 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7382a1d8-3426-46a1-88a1-d178b78e00a2 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:49.260317 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fef504-eddd-460b-80fb-bf003e5d3238 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:49.288564 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:49.313442 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1f7fba-874b-4461-aaac-51fb263591bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:49.313442 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f7fba-874b-4461-aaac-51fb263591bc None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:49.313442 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f7fba-874b-4461-aaac-51fb263591bc None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:49.313442 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f7fba-874b-4461-aaac-51fb263591bc None admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:49.314103 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1f7fba-874b-4461-aaac-51fb263591bc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:49.314103 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1f7fba-874b-4461-aaac-51fb263591bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:49.315332 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1f7fba-874b-4461-aaac-51fb263591bc None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:49.316454 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7382a1d8-3426-46a1-88a1-d178b78e00a2 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:49.336356 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 340/695] 10.222.0.47 () {56 vars in 1135 bytes} [Mon Aug 29 22:32:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:49.341887 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1f7fba-874b-4461-aaac-51fb263591bc None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:49.354063 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aef83bb-5079-464a-a3fd-998c4dff8909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:49.354700 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef83bb-5079-464a-a3fd-998c4dff8909 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:49.354979 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef83bb-5079-464a-a3fd-998c4dff8909 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:49.355251 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef83bb-5079-464a-a3fd-998c4dff8909 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:49.367510 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aef83bb-5079-464a-a3fd-998c4dff8909 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:49.369032 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aef83bb-5079-464a-a3fd-998c4dff8909 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:49.384995 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-8aef83bb-5079-464a-a3fd-998c4dff8909 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:49.384995 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:49.384995 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:49.384995 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:49.384995 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:49.384995 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:49.384995 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:49.384995 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:49.384995 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:49.384995 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:49.384995 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:49.384995 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:49.384995 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:32:49.384995 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:32:49.384995 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:32:49.384995 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:32:49.385953 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:49.385953 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:49.385953 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:49.385953 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:49.385953 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:49.385953 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:49.385953 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:49.385953 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:49.385953 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:49.385953 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:49.385953 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:49.385953 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:49.385953 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:49.385953 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:49.385953 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:49.385953 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:49.385953 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:32:49.387327 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:32:49.387327 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:49.387327 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:32:49.387327 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 356/696] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:32:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:49.393108 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aef83bb-5079-464a-a3fd-998c4dff8909 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:49.503407 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aef83bb-5079-464a-a3fd-998c4dff8909 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:49.505116 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:49.532629 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:49.542881 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0fa948-b63d-46ae-a0b4-0f30e0db9bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:49.543508 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0fa948-b63d-46ae-a0b4-0f30e0db9bdf None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:49.543857 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0fa948-b63d-46ae-a0b4-0f30e0db9bdf None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:49.544276 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0fa948-b63d-46ae-a0b4-0f30e0db9bdf None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:49.544983 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0fa948-b63d-46ae-a0b4-0f30e0db9bdf None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:49.545514 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0fa948-b63d-46ae-a0b4-0f30e0db9bdf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:49.546900 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0fa948-b63d-46ae-a0b4-0f30e0db9bdf None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:49.560424 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 357/697] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:32:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:32:49.566159 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0fa948-b63d-46ae-a0b4-0f30e0db9bdf None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:49.593893 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1f7fba-874b-4461-aaac-51fb263591bc None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:49.641955 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bba770-f165-4e48-a97d-51b308ddb265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:49.642817 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bba770-f165-4e48-a97d-51b308ddb265 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:49.643105 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bba770-f165-4e48-a97d-51b308ddb265 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:49.643794 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bba770-f165-4e48-a97d-51b308ddb265 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:49.701755 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0fa948-b63d-46ae-a0b4-0f30e0db9bdf None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:49.727633 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bba770-f165-4e48-a97d-51b308ddb265 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:49.729668 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bba770-f165-4e48-a97d-51b308ddb265 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:49.743234 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb18f7c-e3ea-4a2d-9a44-45eceff09dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:49.743867 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb18f7c-e3ea-4a2d-9a44-45eceff09dd9 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:49.744148 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb18f7c-e3ea-4a2d-9a44-45eceff09dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:49.744423 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb18f7c-e3ea-4a2d-9a44-45eceff09dd9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:49.751838 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb18f7c-e3ea-4a2d-9a44-45eceff09dd9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:49.753395 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb18f7c-e3ea-4a2d-9a44-45eceff09dd9 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:49.766425 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-edb18f7c-e3ea-4a2d-9a44-45eceff09dd9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:32:49.766425 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:49.766425 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:49.766425 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:49.766425 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:49.766425 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:49.766425 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:49.766425 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:49.766425 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:49.766425 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:49.766425 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:49.766425 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:49.766425 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:32:49.766425 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:32:49.766425 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:32:49.768927 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:32:49.768927 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:49.768927 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:49.768927 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:49.768927 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:49.768927 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:49.768927 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:49.768927 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:49.768927 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:49.768927 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:49.768927 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:49.768927 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:49.768927 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:49.768927 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:49.768927 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:49.768927 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:49.768927 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:49.772106 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:32:49.772106 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:32:49.772106 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:32:49.772106 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:32:49.772106 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:32:49.772106 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:32:49.772106 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:32:49.772106 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:32:49.772106 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 358/698] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Aug 29 22:32:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:49.772106 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb18f7c-e3ea-4a2d-9a44-45eceff09dd9 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:49.799382 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:49.830444 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:49.852468 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 341/699] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Aug 29 22:32:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 22:32:49.852468 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb30b0a5-5ac9-4941-ba78-112dc1cf774f None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:49.852468 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb30b0a5-5ac9-4941-ba78-112dc1cf774f None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:49.852468 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb30b0a5-5ac9-4941-ba78-112dc1cf774f None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:49.852468 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 342/700] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:32:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:32:49.852468 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb30b0a5-5ac9-4941-ba78-112dc1cf774f None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:49.898632 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb18f7c-e3ea-4a2d-9a44-45eceff09dd9 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:49.937367 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5f7ec0-e18c-497d-b803-92426b43ce67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:49.937981 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f7ec0-e18c-497d-b803-92426b43ce67 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:49.938259 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f7ec0-e18c-497d-b803-92426b43ce67 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:49.938529 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f7ec0-e18c-497d-b803-92426b43ce67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:49.950617 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5f7ec0-e18c-497d-b803-92426b43ce67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:49.952055 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5f7ec0-e18c-497d-b803-92426b43ce67 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:49.958282 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb30b0a5-5ac9-4941-ba78-112dc1cf774f None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:49.967821 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-fa5f7ec0-e18c-497d-b803-92426b43ce67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:49.967821 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:49.967821 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:49.967821 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:49.967821 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:49.967821 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:49.967821 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:49.967821 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:49.967821 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:49.967821 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:49.967821 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:49.967821 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:49.967821 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:32:49.967821 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:32:49.967821 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:32:49.967821 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:32:49.968970 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:49.968970 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:49.968970 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:49.968970 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:49.968970 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:49.968970 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:49.968970 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:49.968970 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:49.968970 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:49.968970 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:49.968970 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:49.968970 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:49.968970 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:49.968970 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:49.968970 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:49.968970 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:49.968970 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:32:49.969869 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:32:49.969869 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:49.969869 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:32:49.969869 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 359/701] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:32:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:49.969869 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5f7ec0-e18c-497d-b803-92426b43ce67 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:50.007494 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3caac95-b022-448a-92a2-f1bb22534c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:50.008296 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3caac95-b022-448a-92a2-f1bb22534c54 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:50.008600 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3caac95-b022-448a-92a2-f1bb22534c54 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:50.008955 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3caac95-b022-448a-92a2-f1bb22534c54 None admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:50.009757 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3caac95-b022-448a-92a2-f1bb22534c54 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:50.010057 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3caac95-b022-448a-92a2-f1bb22534c54 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:50.011507 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3caac95-b022-448a-92a2-f1bb22534c54 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:50.029778 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 343/702] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Aug 29 22:32:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:50.031365 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38167735-48d9-49b9-825f-776f2b6ad2c3 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:50.031653 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38167735-48d9-49b9-825f-776f2b6ad2c3 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:50.031924 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38167735-48d9-49b9-825f-776f2b6ad2c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:50.052160 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-38167735-48d9-49b9-825f-776f2b6ad2c3 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:32:50.054127 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-38167735-48d9-49b9-825f-776f2b6ad2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:50.068848 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:50.071961 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:50.076318 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5f7ec0-e18c-497d-b803-92426b43ce67 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:50.115525 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c82c1c-b769-49aa-a750-d68f2eac351e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:50.116719 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c82c1c-b769-49aa-a750-d68f2eac351e None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:50.117255 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c82c1c-b769-49aa-a750-d68f2eac351e None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:50.117368 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c82c1c-b769-49aa-a750-d68f2eac351e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:50.129096 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c82c1c-b769-49aa-a750-d68f2eac351e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:50.130571 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c82c1c-b769-49aa-a750-d68f2eac351e None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:50.137379 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 344/703] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:32:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:32:50.137379 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38167735-48d9-49b9-825f-776f2b6ad2c3 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:50.151276 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-76c82c1c-b769-49aa-a750-d68f2eac351e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:50.151276 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:50.151276 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:50.151276 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:50.151276 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:50.151276 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:50.151276 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:50.151276 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:50.151276 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:50.151276 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:50.151276 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:50.151276 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:50.151276 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:32:50.151276 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:32:50.151276 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:32:50.151276 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:32:50.152442 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:50.152442 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:50.152442 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:50.152442 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:50.152442 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:50.152442 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:50.152442 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:50.152442 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:50.152442 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:50.152442 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:50.152442 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:50.152442 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:50.152442 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:50.152442 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:50.152442 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:50.152442 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:50.152442 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:32:50.153313 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:32:50.153313 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:50.153313 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:32:50.153313 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 360/704] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:32:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:50.153675 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c82c1c-b769-49aa-a750-d68f2eac351e None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:50.260151 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38167735-48d9-49b9-825f-776f2b6ad2c3 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:50.264108 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c82c1c-b769-49aa-a750-d68f2eac351e None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:50.298989 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20396eb7-b002-499b-be73-438ad97bab3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:50.299603 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20396eb7-b002-499b-be73-438ad97bab3f None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:50.299935 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20396eb7-b002-499b-be73-438ad97bab3f None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:50.300158 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20396eb7-b002-499b-be73-438ad97bab3f None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:50.300803 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20396eb7-b002-499b-be73-438ad97bab3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:50.301109 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20396eb7-b002-499b-be73-438ad97bab3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:50.304686 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20396eb7-b002-499b-be73-438ad97bab3f None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:50.305891 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d2d002-cae5-4757-8706-eb49d127e4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:50.306507 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d2d002-cae5-4757-8706-eb49d127e4ec None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:50.306783 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d2d002-cae5-4757-8706-eb49d127e4ec None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:50.307059 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d2d002-cae5-4757-8706-eb49d127e4ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:50.307779 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d2d002-cae5-4757-8706-eb49d127e4ec None admin] RBAC: Adding query filter params (role.id=d00eabaec96a4956aaec2c37a5819c25, scope.project.id=ce09f0beb1a342febbb4a8b3c7cf60c2, user.id=35441c061e514b1b9341e7694ec2c0bc) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:50.308078 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d2d002-cae5-4757-8706-eb49d127e4ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:50.309986 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d2d002-cae5-4757-8706-eb49d127e4ec None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:50.314636 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 345/705] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:32:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:50.320309 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09c881-da33-4b49-a20a-01026cc46fa2 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:50.320309 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09c881-da33-4b49-a20a-01026cc46fa2 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:50.320309 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09c881-da33-4b49-a20a-01026cc46fa2 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:50.320309 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 346/706] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:32:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:32:50.320565 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d09c881-da33-4b49-a20a-01026cc46fa2 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:50.322697 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 361/707] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Aug 29 22:32:50 2022] GET /identity/v3/role_assignments?user.id=35441c061e514b1b9341e7694ec2c0bc&scope.project.id=ce09f0beb1a342febbb4a8b3c7cf60c2&role.id=d00eabaec96a4956aaec2c37a5819c25 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:50.323348 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d2d002-cae5-4757-8706-eb49d127e4ec None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:50.337063 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:50.345130 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:50.448507 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d2d002-cae5-4757-8706-eb49d127e4ec None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:50.452975 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d09c881-da33-4b49-a20a-01026cc46fa2 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:50.487730 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee5468a-c6f0-478a-952e-8f27de67c097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:50.488233 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5468a-c6f0-478a-952e-8f27de67c097 None admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:50.488516 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5468a-c6f0-478a-952e-8f27de67c097 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:50.488793 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5468a-c6f0-478a-952e-8f27de67c097 None admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:50.489514 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee5468a-c6f0-478a-952e-8f27de67c097 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:50.491057 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee5468a-c6f0-478a-952e-8f27de67c097 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:50.497501 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddddeedb-8ecd-40ec-925e-ee57d5fc5682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:50.498337 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddddeedb-8ecd-40ec-925e-ee57d5fc5682 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:50.498793 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddddeedb-8ecd-40ec-925e-ee57d5fc5682 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:50.499242 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddddeedb-8ecd-40ec-925e-ee57d5fc5682 None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:50.500169 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddddeedb-8ecd-40ec-925e-ee57d5fc5682 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:50.500481 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddddeedb-8ecd-40ec-925e-ee57d5fc5682 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:50.502266 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddddeedb-8ecd-40ec-925e-ee57d5fc5682 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:50.514065 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 362/708] 10.222.0.47 () {60 vars in 1132 bytes} [Mon Aug 29 22:32:50 2022] POST /identity/v3/users => generated 254 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:32:50.515328 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51f39e-17f4-45b5-b2c3-65f7c3e05960 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:50.515619 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51f39e-17f4-45b5-b2c3-65f7c3e05960 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:50.515896 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51f39e-17f4-45b5-b2c3-65f7c3e05960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:50.526970 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 347/709] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:32:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:50.528248 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddddeedb-8ecd-40ec-925e-ee57d5fc5682 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:50.545085 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-4d51f39e-17f4-45b5-b2c3-65f7c3e05960 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:32:50.546432 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-4d51f39e-17f4-45b5-b2c3-65f7c3e05960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:50.616408 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:50.642940 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:50.653757 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 363/710] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:32:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:32:50.654809 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d51f39e-17f4-45b5-b2c3-65f7c3e05960 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:50.661732 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddddeedb-8ecd-40ec-925e-ee57d5fc5682 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:50.710688 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10212fac-cda3-4dbb-b830-266b35127fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:50.711656 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10212fac-cda3-4dbb-b830-266b35127fa9 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:50.712115 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10212fac-cda3-4dbb-b830-266b35127fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:50.712574 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10212fac-cda3-4dbb-b830-266b35127fa9 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:50.713991 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10212fac-cda3-4dbb-b830-266b35127fa9 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:50.716048 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10212fac-cda3-4dbb-b830-266b35127fa9 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:50.732867 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-10212fac-cda3-4dbb-b830-266b35127fa9 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 22:32:50.732867 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:50.732867 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:32:50.732867 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:32:50.732867 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:32:50.732867 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:32:50.732867 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:32:50.732867 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:32:50.732867 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 22:32:50.732867 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:32:50.732867 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:32:50.732867 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:32:50.732867 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:50.732867 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:50.732867 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:50.732867 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:50.732867 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:50.734000 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:50.734000 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:50.734000 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:50.734000 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:50.734000 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:50.734000 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:50.734000 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:32:50.734000 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:32:50.734000 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:32:50.734000 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:32:50.734000 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:50.734000 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:50.734000 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:50.734000 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:50.734000 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:50.734000 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:50.734832 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:50.734832 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:50.734832 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:50.734832 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:50.734832 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:50.734832 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:50.734832 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:50.734832 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:50.734832 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:50.734832 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:50.734832 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:32:50.734832 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:32:50.734832 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 22:32:50.734832 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:32:50.737893 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 348/711] 10.222.0.47 () {56 vars in 1129 bytes} [Mon Aug 29 22:32:50 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:50.744429 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10212fac-cda3-4dbb-b830-266b35127fa9 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:50.787154 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d51f39e-17f4-45b5-b2c3-65f7c3e05960 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:50.826426 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c6607-8a27-4d32-ab8f-29d2c79f6208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:50.827301 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c6607-8a27-4d32-ab8f-29d2c79f6208 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:50.827726 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c6607-8a27-4d32-ab8f-29d2c79f6208 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:50.828142 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c6607-8a27-4d32-ab8f-29d2c79f6208 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:50.836412 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154c6607-8a27-4d32-ab8f-29d2c79f6208 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:50.838132 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154c6607-8a27-4d32-ab8f-29d2c79f6208 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:50.851144 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-154c6607-8a27-4d32-ab8f-29d2c79f6208 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:32:50.851144 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:50.851144 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:50.851144 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:50.851144 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:50.851144 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:50.851144 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:50.851144 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:50.851144 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:50.851144 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:50.851144 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:50.851144 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:50.851144 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:32:50.851144 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:32:50.851144 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:32:50.852299 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:32:50.852299 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:50.852299 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:50.852299 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:50.852299 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:50.852299 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:50.852299 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:50.852299 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:50.852299 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:50.852299 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:50.852299 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:50.852299 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:50.852299 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:50.852299 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:50.852299 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:50.852299 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:50.852299 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:50.853240 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:32:50.853240 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:32:50.853240 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:32:50.853240 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:32:50.853240 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:32:50.853240 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:32:50.853240 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:32:50.853240 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:32:50.855468 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 364/712] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Aug 29 22:32:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:50.860934 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c6607-8a27-4d32-ab8f-29d2c79f6208 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:50.872474 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10212fac-cda3-4dbb-b830-266b35127fa9 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:50.910512 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:50.917773 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2dde28-41e3-4249-bffe-e829d1b2091a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:50.918479 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2dde28-41e3-4249-bffe-e829d1b2091a None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:50.919058 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2dde28-41e3-4249-bffe-e829d1b2091a None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:50.919471 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2dde28-41e3-4249-bffe-e829d1b2091a None admin] PATH_INFO: `/v3/services` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:50.920206 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2dde28-41e3-4249-bffe-e829d1b2091a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:50.921018 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2dde28-41e3-4249-bffe-e829d1b2091a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:50.922842 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2dde28-41e3-4249-bffe-e829d1b2091a None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:50.933489 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 349/713] 10.222.0.47 () {56 vars in 1124 bytes} [Mon Aug 29 22:32:50 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:32:50.936136 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2dde28-41e3-4249-bffe-e829d1b2091a None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:50.944774 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:51.008314 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c6607-8a27-4d32-ab8f-29d2c79f6208 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:51.047770 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31615a75-a2a3-4585-b39a-2eb0ec0066ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:51.048336 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31615a75-a2a3-4585-b39a-2eb0ec0066ff None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:51.048573 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31615a75-a2a3-4585-b39a-2eb0ec0066ff None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:51.048845 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31615a75-a2a3-4585-b39a-2eb0ec0066ff None admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:51.049644 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31615a75-a2a3-4585-b39a-2eb0ec0066ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:51.049953 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31615a75-a2a3-4585-b39a-2eb0ec0066ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:51.051592 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31615a75-a2a3-4585-b39a-2eb0ec0066ff None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:51.060554 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2dde28-41e3-4249-bffe-e829d1b2091a None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:51.069703 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 365/714] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Aug 29 22:32:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:32:51.070843 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31615a75-a2a3-4585-b39a-2eb0ec0066ff None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:51.097147 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9054482b-7034-46ca-8040-76e8471cb50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:51.098123 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9054482b-7034-46ca-8040-76e8471cb50f None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:51.098598 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9054482b-7034-46ca-8040-76e8471cb50f None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:51.099083 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9054482b-7034-46ca-8040-76e8471cb50f None admin] PATH_INFO: `/v3/services` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:51.099921 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9054482b-7034-46ca-8040-76e8471cb50f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:51.100512 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9054482b-7034-46ca-8040-76e8471cb50f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:51.102134 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9054482b-7034-46ca-8040-76e8471cb50f None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:51.113444 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 350/715] 10.222.0.47 () {56 vars in 1124 bytes} [Mon Aug 29 22:32:50 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:51.114781 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9054482b-7034-46ca-8040-76e8471cb50f None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:51.189350 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31615a75-a2a3-4585-b39a-2eb0ec0066ff None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:51.214491 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:51.233655 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd2b2a-00d2-4874-b2b7-1bd0adda4a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:51.234413 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd2b2a-00d2-4874-b2b7-1bd0adda4a59 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:51.234708 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd2b2a-00d2-4874-b2b7-1bd0adda4a59 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:51.234982 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd2b2a-00d2-4874-b2b7-1bd0adda4a59 None admin] PATH_INFO: `/v3/services/network` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:51.235586 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cd2b2a-00d2-4874-b2b7-1bd0adda4a59 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:51.236969 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cd2b2a-00d2-4874-b2b7-1bd0adda4a59 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:51.249377 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-84cd2b2a-00d2-4874-b2b7-1bd0adda4a59 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 22:32:51.249377 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:51.249377 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:32:51.249377 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:32:51.249377 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:32:51.249377 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:32:51.249377 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:32:51.249377 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:32:51.249377 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 22:32:51.249377 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:32:51.249377 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:32:51.249377 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:32:51.249377 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:51.249377 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:51.249377 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:51.249377 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:51.249377 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:51.250471 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:51.250471 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:51.250471 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:51.250471 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:51.250471 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:51.250471 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:51.250471 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:32:51.250471 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:32:51.250471 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:32:51.250471 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:32:51.250471 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:51.250471 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:51.250471 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:51.250471 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:51.250471 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:51.250471 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:51.251704 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:51.251704 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:51.251704 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:51.251704 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:51.251704 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:51.251704 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:51.251704 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:51.251704 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:51.251704 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:51.251704 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:51.251704 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:32:51.251704 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:32:51.251704 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 22:32:51.251704 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:32:51.251704 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 366/716] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Aug 29 22:32:51 2022] GET /identity/v3/services/network => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:51.256696 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd2b2a-00d2-4874-b2b7-1bd0adda4a59 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:51.268160 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:51.346859 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9054482b-7034-46ca-8040-76e8471cb50f None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:51.379318 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd2b2a-00d2-4874-b2b7-1bd0adda4a59 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:51.396227 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e239cd-db5a-4f5c-8d6c-abf0336e5ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:51.398415 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e239cd-db5a-4f5c-8d6c-abf0336e5ba8 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:51.399176 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e239cd-db5a-4f5c-8d6c-abf0336e5ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:51.399672 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e239cd-db5a-4f5c-8d6c-abf0336e5ba8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:51.400864 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e239cd-db5a-4f5c-8d6c-abf0336e5ba8 None admin] RBAC: Adding query filter params (role.id=938d531e06764249874d708978e7a0e9, scope.project.id=ce09f0beb1a342febbb4a8b3c7cf60c2, user.id=388d8dea2edf4fb888d42ca878c1434d) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:51.401735 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e239cd-db5a-4f5c-8d6c-abf0336e5ba8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:51.403384 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e239cd-db5a-4f5c-8d6c-abf0336e5ba8 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:51.415939 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 351/717] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Aug 29 22:32:51 2022] GET /identity/v3/role_assignments?user.id=388d8dea2edf4fb888d42ca878c1434d&scope.project.id=ce09f0beb1a342febbb4a8b3c7cf60c2&role.id=938d531e06764249874d708978e7a0e9 => generated 608 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:51.425180 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e3d990-50b6-4efc-9b37-220577be05ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:51.426083 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3d990-50b6-4efc-9b37-220577be05ce None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:51.426528 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3d990-50b6-4efc-9b37-220577be05ce None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:51.426946 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3d990-50b6-4efc-9b37-220577be05ce None admin] PATH_INFO: `/v3/services` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:51.427753 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e3d990-50b6-4efc-9b37-220577be05ce None admin] RBAC: Adding query filter params (name=network) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:51.428217 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e3d990-50b6-4efc-9b37-220577be05ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:51.430225 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e3d990-50b6-4efc-9b37-220577be05ce None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:51.436069 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 367/718] 10.222.0.47 () {56 vars in 1112 bytes} [Mon Aug 29 22:32:51 2022] GET /identity/v3/services?name=network => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:51.445383 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e239cd-db5a-4f5c-8d6c-abf0336e5ba8 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:51.583772 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e239cd-db5a-4f5c-8d6c-abf0336e5ba8 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:51.619587 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:51.623411 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d1890-42fa-4ec0-b1f0-075cfefe2ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:51.624040 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d1890-42fa-4ec0-b1f0-075cfefe2ff1 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:51.624326 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d1890-42fa-4ec0-b1f0-075cfefe2ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:51.624652 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d1890-42fa-4ec0-b1f0-075cfefe2ff1 None admin] PATH_INFO: `/v3/services` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:51.625298 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525d1890-42fa-4ec0-b1f0-075cfefe2ff1 None admin] RBAC: Adding query filter params (type=network) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:51.625644 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525d1890-42fa-4ec0-b1f0-075cfefe2ff1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:51.627326 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525d1890-42fa-4ec0-b1f0-075cfefe2ff1 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:51.633552 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 352/719] 10.222.0.47 () {56 vars in 1112 bytes} [Mon Aug 29 22:32:51 2022] GET /identity/v3/services?type=network => generated 124 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:52.531567 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51a09d-b230-4ba4-b4e3-bee886d9376a None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:52.532389 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51a09d-b230-4ba4-b4e3-bee886d9376a None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:52.532389 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51a09d-b230-4ba4-b4e3-bee886d9376a None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:52.533887 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 368/720] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:32:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:32:52.539572 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690eebeb-f440-41fc-9297-222ddc0811b5 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:52.540124 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690eebeb-f440-41fc-9297-222ddc0811b5 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:52.540124 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690eebeb-f440-41fc-9297-222ddc0811b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:52.570106 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-690eebeb-f440-41fc-9297-222ddc0811b5 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:32:52.571349 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-690eebeb-f440-41fc-9297-222ddc0811b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:52.666949 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 353/721] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:32:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:32:52.970508 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37719161-c965-42d0-a923-3bf419dd512c None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:52.970752 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37719161-c965-42d0-a923-3bf419dd512c None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:52.971157 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37719161-c965-42d0-a923-3bf419dd512c None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:52.972534 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 369/722] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:32:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:32:52.977910 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04612156-ac00-4073-a4ce-2e18c3177558 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:52.978220 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04612156-ac00-4073-a4ce-2e18c3177558 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:52.978783 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04612156-ac00-4073-a4ce-2e18c3177558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:52.997253 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-04612156-ac00-4073-a4ce-2e18c3177558 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:32:52.998537 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-04612156-ac00-4073-a4ce-2e18c3177558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:53.085741 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 354/723] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:32:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:32:53.111256 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37719161-c965-42d0-a923-3bf419dd512c None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:53.168208 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:53.351484 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37719161-c965-42d0-a923-3bf419dd512c None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:53.400955 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225e8362-3dc5-4c77-94cc-cd6bfb08deb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:53.402210 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e8362-3dc5-4c77-94cc-cd6bfb08deb3 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:53.402704 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e8362-3dc5-4c77-94cc-cd6bfb08deb3 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:53.403184 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e8362-3dc5-4c77-94cc-cd6bfb08deb3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:53.417000 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225e8362-3dc5-4c77-94cc-cd6bfb08deb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:32:53.423113 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-225e8362-3dc5-4c77-94cc-cd6bfb08deb3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:32:53.423113 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:53.423113 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:53.423113 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:53.423113 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:53.423113 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:53.423113 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:53.423113 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:53.423113 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:53.423113 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:53.423113 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:53.423113 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:53.423113 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:32:53.423113 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:32:53.423113 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:32:53.423113 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:32:53.424521 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:32:53.424521 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:32:53.424521 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:32:53.424521 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:32:53.424521 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:53.424521 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:53.424521 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:53.424521 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:53.424521 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:53.424521 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:53.424521 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:53.424521 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:53.424521 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:53.424521 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:53.424521 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:53.424521 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:53.425873 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:53.425873 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:53.425873 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:53.425873 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:53.425873 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:32:53.425873 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:32:53.425873 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:32:53.425873 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:32:53.425873 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:32:53.425873 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:32:53.425873 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:32:53.425873 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:32:53.433428 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 370/724] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Aug 29 22:32:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:53.438438 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04612156-ac00-4073-a4ce-2e18c3177558 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:53.495348 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225e8362-3dc5-4c77-94cc-cd6bfb08deb3 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:53.561746 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:53.602728 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225e8362-3dc5-4c77-94cc-cd6bfb08deb3 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:53.613290 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:53.639353 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04612156-ac00-4073-a4ce-2e18c3177558 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:53.640835 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e1ee1-5138-47e1-8fb1-499bbf2b08a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:53.641769 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e1ee1-5138-47e1-8fb1-499bbf2b08a5 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:53.642258 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e1ee1-5138-47e1-8fb1-499bbf2b08a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:53.642773 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e1ee1-5138-47e1-8fb1-499bbf2b08a5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:53.653818 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958e1ee1-5138-47e1-8fb1-499bbf2b08a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:32:53.659347 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-958e1ee1-5138-47e1-8fb1-499bbf2b08a5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:32:53.659347 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:53.659347 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:53.659347 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:53.659347 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:53.659347 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:53.659347 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:53.659347 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:53.659347 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:53.659347 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:53.659347 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:53.659347 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:53.659347 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:32:53.659347 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:32:53.659347 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:32:53.659347 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:32:53.660333 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:32:53.660333 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:32:53.660333 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:32:53.660333 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:32:53.660333 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:53.660333 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:53.660333 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:53.660333 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:53.660333 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:53.660333 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:53.660333 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:53.660333 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:53.660333 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:53.660333 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:53.660333 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:53.660333 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:53.661173 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:53.661173 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:53.661173 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:53.661173 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:53.661173 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:32:53.661173 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:32:53.661173 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:32:53.661173 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:32:53.661173 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:32:53.661173 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:32:53.661173 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:32:53.661173 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:32:53.669061 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 371/725] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Aug 29 22:32:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:32:53.670636 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f71d9-f264-499e-96f6-904c0c82e27c None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:53.671151 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f71d9-f264-499e-96f6-904c0c82e27c None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:53.671635 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f71d9-f264-499e-96f6-904c0c82e27c None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:53.673695 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 372/726] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:32:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:32:53.678153 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f71d9-f264-499e-96f6-904c0c82e27c None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:53.681489 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781cf765-5102-427d-af77-3e9ef44117e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:53.682289 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781cf765-5102-427d-af77-3e9ef44117e1 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:53.682575 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781cf765-5102-427d-af77-3e9ef44117e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:53.682852 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781cf765-5102-427d-af77-3e9ef44117e1 None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:53.683656 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781cf765-5102-427d-af77-3e9ef44117e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:53.683968 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781cf765-5102-427d-af77-3e9ef44117e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:53.685474 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781cf765-5102-427d-af77-3e9ef44117e1 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:53.700936 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 355/727] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Aug 29 22:32:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:53.702586 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c6631-3f79-4808-9bdb-18a97e4864b6 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:53.703027 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c6631-3f79-4808-9bdb-18a97e4864b6 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:53.703490 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c6631-3f79-4808-9bdb-18a97e4864b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:53.722835 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-0a9c6631-3f79-4808-9bdb-18a97e4864b6 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:32:53.724414 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-0a9c6631-3f79-4808-9bdb-18a97e4864b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:53.794495 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f71d9-f264-499e-96f6-904c0c82e27c None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:53.822186 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 356/728] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:32:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:32:53.823165 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9c6631-3f79-4808-9bdb-18a97e4864b6 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:53.849532 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e800c-e844-4e5f-9580-151f3899101d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:53.850984 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e800c-e844-4e5f-9580-151f3899101d None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:53.851482 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e800c-e844-4e5f-9580-151f3899101d None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:53.851952 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e800c-e844-4e5f-9580-151f3899101d None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:53.852762 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18e800c-e844-4e5f-9580-151f3899101d None admin] RBAC: Adding query filter params (name=service) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:53.853256 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18e800c-e844-4e5f-9580-151f3899101d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:53.858983 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18e800c-e844-4e5f-9580-151f3899101d None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:53.874679 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:53.877414 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 373/729] 10.222.0.47 () {56 vars in 1103 bytes} [Mon Aug 29 22:32:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:53.883368 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e800c-e844-4e5f-9580-151f3899101d None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:53.945878 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:53.986882 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9c6631-3f79-4808-9bdb-18a97e4864b6 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:54.070171 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b804623d-96de-4bb5-9764-d4bc2925d66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:54.070824 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804623d-96de-4bb5-9764-d4bc2925d66c None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:54.071105 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804623d-96de-4bb5-9764-d4bc2925d66c None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:54.071378 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804623d-96de-4bb5-9764-d4bc2925d66c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:54.089616 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b804623d-96de-4bb5-9764-d4bc2925d66c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:54.091017 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b804623d-96de-4bb5-9764-d4bc2925d66c None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:54.092257 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e800c-e844-4e5f-9580-151f3899101d None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:54.122723 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-b804623d-96de-4bb5-9764-d4bc2925d66c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:54.122723 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:54.122723 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:54.122723 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:54.122723 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:54.122723 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:54.122723 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:54.122723 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:54.122723 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:54.122723 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:54.122723 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:54.122723 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:54.122723 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:32:54.122723 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:32:54.122723 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:32:54.122723 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:32:54.123729 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:54.123729 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:54.123729 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:54.123729 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:54.123729 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:54.123729 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:54.123729 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:54.123729 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:54.123729 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:54.123729 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:54.123729 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:54.123729 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:54.123729 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:54.123729 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:54.123729 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:54.123729 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:54.123729 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:32:54.125064 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:32:54.125064 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:54.125064 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:32:54.125064 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 357/730] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:32:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:54.133384 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b804623d-96de-4bb5-9764-d4bc2925d66c None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:54.143429 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eddc57-833a-41c1-ade2-c53973b30b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:54.144073 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eddc57-833a-41c1-ade2-c53973b30b1a None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:54.144348 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eddc57-833a-41c1-ade2-c53973b30b1a None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:54.144618 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eddc57-833a-41c1-ade2-c53973b30b1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:54.156636 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eddc57-833a-41c1-ade2-c53973b30b1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:54.158696 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eddc57-833a-41c1-ade2-c53973b30b1a None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:54.175949 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-88eddc57-833a-41c1-ade2-c53973b30b1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:54.175949 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:54.175949 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:54.175949 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:54.175949 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:54.175949 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:54.175949 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:54.175949 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:54.175949 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:54.175949 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:54.175949 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:54.175949 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:54.175949 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:32:54.175949 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:32:54.175949 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:32:54.175949 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:32:54.176938 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:54.176938 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:54.176938 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:54.176938 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:54.176938 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:54.176938 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:54.176938 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:54.176938 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:54.176938 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:54.176938 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:54.176938 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:54.176938 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:54.176938 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:54.176938 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:54.176938 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:54.176938 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:54.176938 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:32:54.177865 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:32:54.177865 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:54.177865 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:32:54.182762 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 374/731] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:32:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:32:54.183739 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eddc57-833a-41c1-ade2-c53973b30b1a None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:54.247227 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:54.258151 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b804623d-96de-4bb5-9764-d4bc2925d66c None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:54.274849 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:54.295703 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eddc57-833a-41c1-ade2-c53973b30b1a None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:54.301014 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d994eca6-cb39-4e0f-b442-150e52b7c3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:54.301668 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994eca6-cb39-4e0f-b442-150e52b7c3e2 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:54.302001 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994eca6-cb39-4e0f-b442-150e52b7c3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:54.302223 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994eca6-cb39-4e0f-b442-150e52b7c3e2 None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:54.302878 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d994eca6-cb39-4e0f-b442-150e52b7c3e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:54.303184 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d994eca6-cb39-4e0f-b442-150e52b7c3e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:54.305172 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d994eca6-cb39-4e0f-b442-150e52b7c3e2 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:54.323849 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 358/732] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:32:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:32:54.323849 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785ab1a-db43-424f-818e-ba45cc207497 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:54.323849 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785ab1a-db43-424f-818e-ba45cc207497 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:54.323849 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785ab1a-db43-424f-818e-ba45cc207497 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:54.324258 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 359/733] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:32:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:32:54.325076 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785ab1a-db43-424f-818e-ba45cc207497 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:54.345386 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d819ea-cbd1-49a6-af7b-164dddfa7705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:54.346201 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d819ea-cbd1-49a6-af7b-164dddfa7705 None admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:54.346621 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d819ea-cbd1-49a6-af7b-164dddfa7705 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:54.347029 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d819ea-cbd1-49a6-af7b-164dddfa7705 None admin] PATH_INFO: `/v3/services` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:54.348327 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d819ea-cbd1-49a6-af7b-164dddfa7705 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:54.350729 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d819ea-cbd1-49a6-af7b-164dddfa7705 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:54.373394 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 375/734] 10.222.0.47 () {60 vars in 1141 bytes} [Mon Aug 29 22:32:54 2022] POST /identity/v3/services => generated 251 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:32:54.373394 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d819ea-cbd1-49a6-af7b-164dddfa7705 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:54.458870 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785ab1a-db43-424f-818e-ba45cc207497 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:54.497374 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d819ea-cbd1-49a6-af7b-164dddfa7705 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:54.502435 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dead6f4-191f-4952-b318-7ac958e1c911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:54.503066 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dead6f4-191f-4952-b318-7ac958e1c911 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:54.503347 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dead6f4-191f-4952-b318-7ac958e1c911 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:54.503618 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dead6f4-191f-4952-b318-7ac958e1c911 None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:54.504274 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dead6f4-191f-4952-b318-7ac958e1c911 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:54.504577 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dead6f4-191f-4952-b318-7ac958e1c911 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:54.505998 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dead6f4-191f-4952-b318-7ac958e1c911 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:54.520554 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 360/735] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:32:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:54.521839 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac355113-1ecb-41e2-a82e-78798c95ddcb None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:54.522983 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac355113-1ecb-41e2-a82e-78798c95ddcb None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:54.522983 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac355113-1ecb-41e2-a82e-78798c95ddcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:54.542646 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07210d5-e8a4-4371-9409-04b35b88b05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:54.543294 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07210d5-e8a4-4371-9409-04b35b88b05d None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:54.543531 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-ac355113-1ecb-41e2-a82e-78798c95ddcb None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:32:54.543637 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07210d5-e8a4-4371-9409-04b35b88b05d None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:54.544399 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07210d5-e8a4-4371-9409-04b35b88b05d None admin] PATH_INFO: `/v3/users/nova` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:54.544779 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-ac355113-1ecb-41e2-a82e-78798c95ddcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:54.548002 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:54.552393 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07210d5-e8a4-4371-9409-04b35b88b05d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:54.553908 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07210d5-e8a4-4371-9409-04b35b88b05d None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:54.567129 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-d07210d5-e8a4-4371-9409-04b35b88b05d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 22:32:54.567129 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:54.567129 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:54.567129 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:54.567129 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:54.567129 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:54.567129 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:54.567129 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:54.567129 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:54.567129 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:54.567129 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:54.567129 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:54.567129 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:32:54.567129 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:32:54.567129 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:32:54.567129 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:32:54.568080 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:54.568080 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:54.568080 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:32:54.568080 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:32:54.568080 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:32:54.568080 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:32:54.568080 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:54.568080 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:54.568080 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:54.568080 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:54.568080 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:54.568080 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:54.568080 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:54.568080 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:54.568080 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:54.568080 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:54.568080 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:54.568080 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:54.570640 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:54.570640 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:54.570640 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:32:54.570640 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:32:54.570640 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:32:54.570640 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:32:54.570640 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:32:54.570640 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:32:54.570640 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 22:32:54.570640 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:32:54.570640 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 376/736] 10.222.0.47 () {56 vars in 1093 bytes} [Mon Aug 29 22:32:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:54.570640 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a42d17-02ac-46ad-aab0-5f043ec1e9e8 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:54.570640 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a42d17-02ac-46ad-aab0-5f043ec1e9e8 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:54.571316 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a42d17-02ac-46ad-aab0-5f043ec1e9e8 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:54.572269 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 377/737] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:32:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:32:54.572993 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a42d17-02ac-46ad-aab0-5f043ec1e9e8 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:54.580000 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:54.624170 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 361/738] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:32:54 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:32:54.625776 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac355113-1ecb-41e2-a82e-78798c95ddcb None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:54.690404 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a42d17-02ac-46ad-aab0-5f043ec1e9e8 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:54.736666 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e401d73-3564-4324-84a2-63e3b92ff4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:54.737737 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e401d73-3564-4324-84a2-63e3b92ff4d5 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:54.738233 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e401d73-3564-4324-84a2-63e3b92ff4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:54.738716 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e401d73-3564-4324-84a2-63e3b92ff4d5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:54.747498 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e401d73-3564-4324-84a2-63e3b92ff4d5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:54.749360 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e401d73-3564-4324-84a2-63e3b92ff4d5 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:54.759234 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac355113-1ecb-41e2-a82e-78798c95ddcb None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:54.762444 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-7e401d73-3564-4324-84a2-63e3b92ff4d5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 22:32:54.762444 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:54.762444 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:54.762444 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:54.762444 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:54.762444 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:54.762444 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:54.762444 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:54.762444 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:54.762444 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:54.762444 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:54.762444 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:54.762444 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:32:54.762444 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:32:54.762444 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:32:54.762444 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:32:54.763338 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:54.763338 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:54.763338 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:32:54.763338 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:32:54.763338 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:32:54.763338 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:32:54.763338 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:54.763338 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:54.763338 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:54.763338 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:54.763338 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:54.763338 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:54.763338 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:54.763338 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:54.763338 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:54.763338 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:54.763338 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:54.763338 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:54.764286 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:54.764286 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:54.764286 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:32:54.764286 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:32:54.764286 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:32:54.764286 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:32:54.764286 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:32:54.764286 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:32:54.764286 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 22:32:54.764286 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:32:54.766797 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 378/739] 10.222.0.47 () {56 vars in 1117 bytes} [Mon Aug 29 22:32:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:54.768234 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c46c0d-69a3-4c96-9ad7-2efb60dcd406 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:54.768715 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c46c0d-69a3-4c96-9ad7-2efb60dcd406 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:54.769200 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c46c0d-69a3-4c96-9ad7-2efb60dcd406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:54.787827 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-f4c46c0d-69a3-4c96-9ad7-2efb60dcd406 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:32:54.789461 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-f4c46c0d-69a3-4c96-9ad7-2efb60dcd406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:54.796782 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12558b0d-c6fe-4a51-b76b-6dfc4a885c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:54.797430 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12558b0d-c6fe-4a51-b76b-6dfc4a885c19 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:54.797717 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12558b0d-c6fe-4a51-b76b-6dfc4a885c19 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:54.798356 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12558b0d-c6fe-4a51-b76b-6dfc4a885c19 None admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:54.798734 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12558b0d-c6fe-4a51-b76b-6dfc4a885c19 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:54.799042 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12558b0d-c6fe-4a51-b76b-6dfc4a885c19 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:54.800501 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12558b0d-c6fe-4a51-b76b-6dfc4a885c19 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:54.809983 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:54.827166 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 362/740] 10.222.0.47 () {56 vars in 1133 bytes} [Mon Aug 29 22:32:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:54.828194 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12558b0d-c6fe-4a51-b76b-6dfc4a885c19 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:54.864415 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:54.868773 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 379/741] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:32:54 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 22:32:54.870317 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c46c0d-69a3-4c96-9ad7-2efb60dcd406 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:54.939306 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12558b0d-c6fe-4a51-b76b-6dfc4a885c19 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:54.981676 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c46c0d-69a3-4c96-9ad7-2efb60dcd406 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:54.982542 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a2f46-8fa3-4ced-9f71-5a519ddb1f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:54.983526 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a2f46-8fa3-4ced-9f71-5a519ddb1f6d None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:54.984020 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a2f46-8fa3-4ced-9f71-5a519ddb1f6d None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:54.985250 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a2f46-8fa3-4ced-9f71-5a519ddb1f6d None admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:54.986229 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883a2f46-8fa3-4ced-9f71-5a519ddb1f6d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:54.986746 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883a2f46-8fa3-4ced-9f71-5a519ddb1f6d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:54.988500 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883a2f46-8fa3-4ced-9f71-5a519ddb1f6d None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:55.017197 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 363/742] 10.222.0.47 () {56 vars in 1149 bytes} [Mon Aug 29 22:32:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:55.018195 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a2f46-8fa3-4ced-9f71-5a519ddb1f6d None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:55.027966 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df62c58-f4ff-42b5-8c39-a7493f6254ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:55.028956 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df62c58-f4ff-42b5-8c39-a7493f6254ac None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:55.029483 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df62c58-f4ff-42b5-8c39-a7493f6254ac None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:55.029945 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df62c58-f4ff-42b5-8c39-a7493f6254ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:55.041652 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df62c58-f4ff-42b5-8c39-a7493f6254ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:55.043865 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df62c58-f4ff-42b5-8c39-a7493f6254ac None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:55.060314 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-7df62c58-f4ff-42b5-8c39-a7493f6254ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:55.060314 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:55.060314 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:55.060314 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:55.060314 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:55.060314 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:55.060314 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:55.060314 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:55.060314 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:55.060314 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:55.060314 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:55.060314 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:55.060314 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:32:55.060314 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:32:55.060314 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:32:55.060314 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:32:55.061305 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:55.061305 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:55.061305 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:55.061305 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:55.061305 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:55.061305 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:55.061305 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:55.061305 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:55.061305 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:55.061305 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:55.061305 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:55.061305 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:55.061305 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:55.061305 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:55.061305 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:55.061305 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:55.061305 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:32:55.062218 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:32:55.062218 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:55.062218 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:32:55.064333 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 380/743] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:32:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:55.065299 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df62c58-f4ff-42b5-8c39-a7493f6254ac None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:55.087204 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:55.114716 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:55.141471 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a2f46-8fa3-4ced-9f71-5a519ddb1f6d None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:55.173603 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df62c58-f4ff-42b5-8c39-a7493f6254ac None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:55.179508 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467039f1-5861-4a60-91e3-2d41e4ea79a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:55.180314 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467039f1-5861-4a60-91e3-2d41e4ea79a1 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:55.180595 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467039f1-5861-4a60-91e3-2d41e4ea79a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:55.180869 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467039f1-5861-4a60-91e3-2d41e4ea79a1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:55.191878 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467039f1-5861-4a60-91e3-2d41e4ea79a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:32:55.197124 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-467039f1-5861-4a60-91e3-2d41e4ea79a1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:32:55.197124 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:55.197124 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:55.197124 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:55.197124 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:55.197124 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:55.197124 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:55.197124 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:55.197124 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:55.197124 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:55.197124 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:55.197124 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:55.197124 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:32:55.197124 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:32:55.197124 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:32:55.197124 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:32:55.198252 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:32:55.198252 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:32:55.198252 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:32:55.198252 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:32:55.198252 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:55.198252 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:55.198252 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:55.198252 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:55.198252 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:55.198252 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:55.198252 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:55.198252 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:55.198252 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:55.198252 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:55.198252 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:55.198252 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:55.199075 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:55.199075 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:55.199075 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:55.199075 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:55.199075 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:32:55.199075 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:32:55.199075 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:32:55.199075 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:32:55.199075 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:32:55.199075 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:32:55.199075 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:32:55.199075 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:32:55.199075 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 364/744] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Aug 29 22:32:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:55.199754 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467039f1-5861-4a60-91e3-2d41e4ea79a1 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:55.215720 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98d367d-9af8-45ae-8709-f5481c4c8d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:55.216351 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d367d-9af8-45ae-8709-f5481c4c8d36 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:55.216625 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d367d-9af8-45ae-8709-f5481c4c8d36 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:55.216918 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d367d-9af8-45ae-8709-f5481c4c8d36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:55.291563 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98d367d-9af8-45ae-8709-f5481c4c8d36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:55.293029 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98d367d-9af8-45ae-8709-f5481c4c8d36 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:55.315208 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467039f1-5861-4a60-91e3-2d41e4ea79a1 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:55.332436 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:55.342326 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:55.357055 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74329f1-4884-4316-bc66-ded5e6cc32a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:55.357699 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74329f1-4884-4316-bc66-ded5e6cc32a4 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:55.357978 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74329f1-4884-4316-bc66-ded5e6cc32a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:55.358250 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74329f1-4884-4316-bc66-ded5e6cc32a4 None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:55.358891 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74329f1-4884-4316-bc66-ded5e6cc32a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:55.359192 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74329f1-4884-4316-bc66-ded5e6cc32a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:55.360555 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74329f1-4884-4316-bc66-ded5e6cc32a4 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:55.377321 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 365/745] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:32:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:55.377321 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74329f1-4884-4316-bc66-ded5e6cc32a4 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:55.405807 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 381/746] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Aug 29 22:32:55 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 22:32:55.406743 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98d367d-9af8-45ae-8709-f5481c4c8d36 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:55.489965 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74329f1-4884-4316-bc66-ded5e6cc32a4 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:55.510658 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98d367d-9af8-45ae-8709-f5481c4c8d36 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:55.527116 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcb5476-1823-4400-8e30-8ce118a09336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:55.527746 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcb5476-1823-4400-8e30-8ce118a09336 None admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:55.528028 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcb5476-1823-4400-8e30-8ce118a09336 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:55.528305 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcb5476-1823-4400-8e30-8ce118a09336 None admin] PATH_INFO: `/v3/services` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:55.528972 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcb5476-1823-4400-8e30-8ce118a09336 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:55.530644 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcb5476-1823-4400-8e30-8ce118a09336 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:55.548124 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 366/747] 10.222.0.47 () {60 vars in 1141 bytes} [Mon Aug 29 22:32:55 2022] POST /identity/v3/services => generated 240 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:32:55.548941 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcb5476-1823-4400-8e30-8ce118a09336 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:55.568048 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c9cf3a-c10e-4626-87fb-1a2f9ccd98ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:55.568691 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9cf3a-c10e-4626-87fb-1a2f9ccd98ea None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:55.569019 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9cf3a-c10e-4626-87fb-1a2f9ccd98ea None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:55.569296 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9cf3a-c10e-4626-87fb-1a2f9ccd98ea None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:55.570411 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c9cf3a-c10e-4626-87fb-1a2f9ccd98ea None admin] RBAC: Adding query filter params (name=admin) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:55.570718 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c9cf3a-c10e-4626-87fb-1a2f9ccd98ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:55.572447 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c9cf3a-c10e-4626-87fb-1a2f9ccd98ea None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:55.589525 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 382/748] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Aug 29 22:32:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:55.591872 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c9cf3a-c10e-4626-87fb-1a2f9ccd98ea None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:55.598937 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:55.605710 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:55.677624 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcb5476-1823-4400-8e30-8ce118a09336 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:55.719128 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93588f3c-c6d4-436a-8f56-11918a9da774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:55.720094 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93588f3c-c6d4-436a-8f56-11918a9da774 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:55.720455 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93588f3c-c6d4-436a-8f56-11918a9da774 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:55.721152 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93588f3c-c6d4-436a-8f56-11918a9da774 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:55.730480 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93588f3c-c6d4-436a-8f56-11918a9da774 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:55.732670 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93588f3c-c6d4-436a-8f56-11918a9da774 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:55.745555 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c9cf3a-c10e-4626-87fb-1a2f9ccd98ea None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:55.748906 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-93588f3c-c6d4-436a-8f56-11918a9da774 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:32:55.748906 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:55.748906 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:55.748906 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:55.748906 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:55.748906 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:55.748906 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:55.748906 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:55.748906 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:55.748906 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:55.748906 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:55.748906 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:55.748906 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:32:55.748906 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:32:55.748906 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:32:55.749792 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:32:55.749792 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:55.749792 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:55.749792 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:55.749792 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:55.749792 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:55.749792 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:55.749792 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:55.749792 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:55.749792 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:55.749792 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:55.749792 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:55.749792 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:55.749792 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:55.749792 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:55.749792 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:55.749792 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:55.750675 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:32:55.750675 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:32:55.750675 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:32:55.750675 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:32:55.750675 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:32:55.750675 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:32:55.750675 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:32:55.750675 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:32:55.751474 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 367/749] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Aug 29 22:32:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:55.752044 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93588f3c-c6d4-436a-8f56-11918a9da774 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:55.805575 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d58536d-6a33-4d8a-a655-5a0778fe4b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:55.806350 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58536d-6a33-4d8a-a655-5a0778fe4b61 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:55.806694 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58536d-6a33-4d8a-a655-5a0778fe4b61 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:55.807013 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58536d-6a33-4d8a-a655-5a0778fe4b61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:55.821528 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d58536d-6a33-4d8a-a655-5a0778fe4b61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:55.823690 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d58536d-6a33-4d8a-a655-5a0778fe4b61 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:55.842511 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-4d58536d-6a33-4d8a-a655-5a0778fe4b61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:55.842511 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:55.842511 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:55.842511 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:55.842511 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:55.842511 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:55.842511 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:55.842511 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:55.842511 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:55.842511 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:55.842511 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:55.842511 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:55.842511 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:32:55.842511 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:32:55.842511 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:32:55.842511 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:32:55.843506 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:55.843506 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:55.843506 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:55.843506 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:55.843506 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:55.843506 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:55.843506 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:55.843506 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:55.843506 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:55.843506 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:55.843506 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:55.843506 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:55.843506 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:55.843506 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:55.843506 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:55.843506 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:55.843506 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:32:55.844367 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:32:55.844367 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:55.844367 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:32:55.846484 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 383/750] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:32:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:55.847534 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d58536d-6a33-4d8a-a655-5a0778fe4b61 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:55.884625 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:55.895398 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93588f3c-c6d4-436a-8f56-11918a9da774 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:55.913586 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:55.936090 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb60877-0359-4c83-95af-d422a86caafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:55.937246 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb60877-0359-4c83-95af-d422a86caafa None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:55.937760 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb60877-0359-4c83-95af-d422a86caafa None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:55.938229 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb60877-0359-4c83-95af-d422a86caafa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:55.950673 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb60877-0359-4c83-95af-d422a86caafa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:55.952564 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb60877-0359-4c83-95af-d422a86caafa None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:55.968351 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-7fb60877-0359-4c83-95af-d422a86caafa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:55.968351 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:55.968351 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:55.968351 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:55.968351 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:55.968351 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:55.968351 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:55.968351 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:55.968351 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:55.968351 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:55.968351 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:55.968351 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:55.968351 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:32:55.968351 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:32:55.968351 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:32:55.968351 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:32:55.969315 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:55.969315 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:55.969315 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:55.969315 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:55.969315 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:55.969315 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:55.969315 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:55.969315 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:55.969315 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:55.969315 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:55.969315 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:55.969315 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:55.969315 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:55.969315 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:55.969315 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:55.969315 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:55.969315 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:32:55.970383 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:32:55.970383 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:55.970383 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:32:55.970592 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d58536d-6a33-4d8a-a655-5a0778fe4b61 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:55.972088 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 368/751] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:32:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:55.973207 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb60877-0359-4c83-95af-d422a86caafa None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:56.014815 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d682b5-a03b-45d8-ab5d-eabea88c23b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:56.015347 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d682b5-a03b-45d8-ab5d-eabea88c23b7 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:56.015627 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d682b5-a03b-45d8-ab5d-eabea88c23b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:56.015897 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d682b5-a03b-45d8-ab5d-eabea88c23b7 None admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:56.016599 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d682b5-a03b-45d8-ab5d-eabea88c23b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:56.016910 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d682b5-a03b-45d8-ab5d-eabea88c23b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:56.018349 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d682b5-a03b-45d8-ab5d-eabea88c23b7 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:56.036203 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 384/752] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Aug 29 22:32:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:56.038145 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d682b5-a03b-45d8-ab5d-eabea88c23b7 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:56.111797 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb60877-0359-4c83-95af-d422a86caafa None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:56.150597 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0585c2-d67f-4f2a-bb75-13073607e5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:56.151327 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0585c2-d67f-4f2a-bb75-13073607e5b8 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:56.151612 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0585c2-d67f-4f2a-bb75-13073607e5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:56.151885 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0585c2-d67f-4f2a-bb75-13073607e5b8 None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:56.152535 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0585c2-d67f-4f2a-bb75-13073607e5b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:56.153171 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0585c2-d67f-4f2a-bb75-13073607e5b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:56.154235 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0585c2-d67f-4f2a-bb75-13073607e5b8 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:56.167216 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d682b5-a03b-45d8-ab5d-eabea88c23b7 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:56.168202 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 369/753] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:32:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:56.169020 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0585c2-d67f-4f2a-bb75-13073607e5b8 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:56.177706 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:56.185887 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:56.208968 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e524012c-c8fe-40e6-a0a6-b4218e359b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:56.210935 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524012c-c8fe-40e6-a0a6-b4218e359b81 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:56.211423 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524012c-c8fe-40e6-a0a6-b4218e359b81 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:56.211938 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524012c-c8fe-40e6-a0a6-b4218e359b81 None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:56.212778 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e524012c-c8fe-40e6-a0a6-b4218e359b81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:56.213281 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e524012c-c8fe-40e6-a0a6-b4218e359b81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:56.214939 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e524012c-c8fe-40e6-a0a6-b4218e359b81 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:56.228736 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 385/754] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:32:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:56.229988 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e524012c-c8fe-40e6-a0a6-b4218e359b81 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:56.283575 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0585c2-d67f-4f2a-bb75-13073607e5b8 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:56.324034 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b6b40-ba1d-41e9-961e-1fc27fea2ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:56.324696 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b6b40-ba1d-41e9-961e-1fc27fea2ee4 None admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:56.325096 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b6b40-ba1d-41e9-961e-1fc27fea2ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:56.325408 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b6b40-ba1d-41e9-961e-1fc27fea2ee4 None admin] PATH_INFO: `/v3/projects/ce09f0beb1a342febbb4a8b3c7cf60c2/users/35441c061e514b1b9341e7694ec2c0bc/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:56.327395 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b6b40-ba1d-41e9-961e-1fc27fea2ee4 None admin] RBAC: Authorizing `identity:create_grant(project_id=ce09f0beb1a342febbb4a8b3c7cf60c2, user_id=35441c061e514b1b9341e7694ec2c0bc, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:56.328844 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b6b40-ba1d-41e9-961e-1fc27fea2ee4 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:56.345581 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e524012c-c8fe-40e6-a0a6-b4218e359b81 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:56.345865 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 370/755] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Aug 29 22:32:56 2022] PUT /identity/v3/projects/ce09f0beb1a342febbb4a8b3c7cf60c2/users/35441c061e514b1b9341e7694ec2c0bc/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:32:56.346680 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b6b40-ba1d-41e9-961e-1fc27fea2ee4 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:56.396735 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6447871e-b8d2-4f7d-a381-9bf3333439d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:56.398781 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447871e-b8d2-4f7d-a381-9bf3333439d5 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:56.399474 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447871e-b8d2-4f7d-a381-9bf3333439d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:56.400228 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447871e-b8d2-4f7d-a381-9bf3333439d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:56.413497 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6447871e-b8d2-4f7d-a381-9bf3333439d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:56.415843 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6447871e-b8d2-4f7d-a381-9bf3333439d5 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:56.429531 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:56.431090 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-6447871e-b8d2-4f7d-a381-9bf3333439d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:32:56.431090 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:56.431090 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:56.431090 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:56.431090 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:56.431090 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:56.431090 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:56.431090 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:56.431090 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:56.431090 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:56.431090 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:56.431090 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:56.431090 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:32:56.431090 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:32:56.431090 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:32:56.432547 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:32:56.432547 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:56.432547 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:56.432547 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:56.432547 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:56.432547 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:56.432547 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:56.432547 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:56.432547 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:56.432547 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:56.432547 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:56.432547 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:56.432547 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:56.432547 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:56.432547 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:56.432547 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:56.432547 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:56.433545 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:32:56.433545 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:32:56.433545 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:32:56.433545 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:32:56.433545 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:32:56.433545 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:32:56.433545 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:32:56.433545 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:32:56.436307 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 386/756] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Aug 29 22:32:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:56.438003 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060e78d-0362-46e8-8943-dfca80d04e60 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:56.438421 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060e78d-0362-46e8-8943-dfca80d04e60 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:56.438788 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060e78d-0362-46e8-8943-dfca80d04e60 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:56.440561 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 387/757] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:32:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:32:56.442426 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a060e78d-0362-46e8-8943-dfca80d04e60 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:56.474388 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b6b40-ba1d-41e9-961e-1fc27fea2ee4 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:56.485022 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:56.521205 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93edd67-8c75-47cb-8ffe-c07c9afb7f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:56.522552 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93edd67-8c75-47cb-8ffe-c07c9afb7f59 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:56.522837 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93edd67-8c75-47cb-8ffe-c07c9afb7f59 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:56.523123 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93edd67-8c75-47cb-8ffe-c07c9afb7f59 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:56.533532 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93edd67-8c75-47cb-8ffe-c07c9afb7f59 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:56.535064 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93edd67-8c75-47cb-8ffe-c07c9afb7f59 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:56.550019 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-b93edd67-8c75-47cb-8ffe-c07c9afb7f59 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 22:32:56.550019 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:56.550019 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:56.550019 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:56.550019 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:56.550019 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:56.550019 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:56.550019 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:56.550019 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:56.550019 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:56.550019 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:56.550019 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:56.550019 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:32:56.550019 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:32:56.550019 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:32:56.550019 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:32:56.551088 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:56.551088 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:56.551088 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:32:56.551088 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:32:56.551088 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:32:56.551088 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:32:56.551088 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:56.551088 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:56.551088 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:56.551088 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:56.551088 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:56.551088 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:56.551088 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:56.551088 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:56.551088 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:56.551088 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:56.551088 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:56.551088 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:56.552343 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:56.552343 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:56.552343 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:32:56.552343 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:32:56.552343 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:32:56.552343 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:32:56.552343 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:32:56.552343 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:32:56.552343 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 22:32:56.552343 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:32:56.552343 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 371/758] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Aug 29 22:32:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:56.553090 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7bb98b-ad45-4c6b-b504-1211e62d87fa None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:56.553090 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7bb98b-ad45-4c6b-b504-1211e62d87fa None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:56.553255 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7bb98b-ad45-4c6b-b504-1211e62d87fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:56.572102 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-3e7bb98b-ad45-4c6b-b504-1211e62d87fa None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:32:56.572985 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-3e7bb98b-ad45-4c6b-b504-1211e62d87fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:56.578660 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a060e78d-0362-46e8-8943-dfca80d04e60 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:56.618745 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6253dbd2-1a42-4674-9f8a-dfa84b24c333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:56.619380 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253dbd2-1a42-4674-9f8a-dfa84b24c333 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:56.619657 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253dbd2-1a42-4674-9f8a-dfa84b24c333 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:56.619924 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253dbd2-1a42-4674-9f8a-dfa84b24c333 None admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:56.620618 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6253dbd2-1a42-4674-9f8a-dfa84b24c333 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:56.620915 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6253dbd2-1a42-4674-9f8a-dfa84b24c333 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:56.623191 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6253dbd2-1a42-4674-9f8a-dfa84b24c333 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:56.637237 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 388/759] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Aug 29 22:32:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:56.638247 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6253dbd2-1a42-4674-9f8a-dfa84b24c333 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:56.665355 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 372/760] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:32:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:32:56.670347 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7bb98b-ad45-4c6b-b504-1211e62d87fa None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:56.752213 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:56.809501 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7bb98b-ad45-4c6b-b504-1211e62d87fa None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:56.826582 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:56.840999 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6253dbd2-1a42-4674-9f8a-dfa84b24c333 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:56.876136 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70713ae9-a23d-4e73-b983-43de6b5234e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:56.877174 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70713ae9-a23d-4e73-b983-43de6b5234e2 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:56.878375 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70713ae9-a23d-4e73-b983-43de6b5234e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:56.879433 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70713ae9-a23d-4e73-b983-43de6b5234e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:56.880455 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70713ae9-a23d-4e73-b983-43de6b5234e2 None admin] RBAC: Adding query filter params (role.id=938d531e06764249874d708978e7a0e9, scope.project.id=ce09f0beb1a342febbb4a8b3c7cf60c2, user.id=e49a4666712746d098ace9e1cb0bf07c) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:56.882685 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70713ae9-a23d-4e73-b983-43de6b5234e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:56.884497 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70713ae9-a23d-4e73-b983-43de6b5234e2 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:56.895200 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 373/761] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Aug 29 22:32:56 2022] GET /identity/v3/role_assignments?user.id=e49a4666712746d098ace9e1cb0bf07c&scope.project.id=ce09f0beb1a342febbb4a8b3c7cf60c2&role.id=938d531e06764249874d708978e7a0e9 => generated 259 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:56.900959 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26af40ae-83d3-4c66-ad7f-e843ff0e3947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:56.901877 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af40ae-83d3-4c66-ad7f-e843ff0e3947 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:56.902296 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af40ae-83d3-4c66-ad7f-e843ff0e3947 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:56.902707 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af40ae-83d3-4c66-ad7f-e843ff0e3947 None admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:56.903640 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26af40ae-83d3-4c66-ad7f-e843ff0e3947 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:56.904092 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26af40ae-83d3-4c66-ad7f-e843ff0e3947 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:56.906017 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26af40ae-83d3-4c66-ad7f-e843ff0e3947 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:56.937088 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 389/762] 10.222.0.47 () {56 vars in 1135 bytes} [Mon Aug 29 22:32:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:56.942795 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70713ae9-a23d-4e73-b983-43de6b5234e2 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:57.022624 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26af40ae-83d3-4c66-ad7f-e843ff0e3947 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:57.151803 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26af40ae-83d3-4c66-ad7f-e843ff0e3947 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:57.174420 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70713ae9-a23d-4e73-b983-43de6b5234e2 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:57.214804 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:57.221283 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27932ac3-90b8-44b3-a0c2-35cf6691ec23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:57.221945 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27932ac3-90b8-44b3-a0c2-35cf6691ec23 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:57.222223 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27932ac3-90b8-44b3-a0c2-35cf6691ec23 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:57.222489 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27932ac3-90b8-44b3-a0c2-35cf6691ec23 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:57.223070 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27932ac3-90b8-44b3-a0c2-35cf6691ec23 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:57.224431 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27932ac3-90b8-44b3-a0c2-35cf6691ec23 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:57.236972 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-27932ac3-90b8-44b3-a0c2-35cf6691ec23 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 22:32:57.236972 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:57.236972 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:32:57.236972 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:32:57.236972 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:32:57.236972 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:32:57.236972 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:32:57.236972 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:32:57.236972 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 22:32:57.236972 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:32:57.236972 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:32:57.236972 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:32:57.236972 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:57.236972 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:57.236972 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:57.236972 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:57.236972 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:57.238045 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:57.238045 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:57.238045 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:57.238045 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:57.238045 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:57.238045 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:57.238045 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:32:57.238045 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:32:57.238045 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:32:57.238045 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:32:57.238045 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:57.238045 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:57.238045 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:57.238045 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:57.238045 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:57.238045 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:57.240285 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:57.240285 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:57.240285 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:57.240285 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:57.240285 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:57.240285 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:57.240285 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:57.240285 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:57.240285 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:57.240285 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:57.240285 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:32:57.240285 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:32:57.240285 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 22:32:57.240285 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:32:57.240285 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 390/763] 10.222.0.47 () {56 vars in 1129 bytes} [Mon Aug 29 22:32:57 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:57.245370 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27932ac3-90b8-44b3-a0c2-35cf6691ec23 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:57.254025 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dfbf63-086d-4c77-97df-3c1f10e16dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:57.255031 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dfbf63-086d-4c77-97df-3c1f10e16dfa None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:57.255518 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dfbf63-086d-4c77-97df-3c1f10e16dfa None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:57.255997 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dfbf63-086d-4c77-97df-3c1f10e16dfa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:57.264790 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:57.357766 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27932ac3-90b8-44b3-a0c2-35cf6691ec23 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:57.379457 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dfbf63-086d-4c77-97df-3c1f10e16dfa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:57.381357 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dfbf63-086d-4c77-97df-3c1f10e16dfa None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:57.388653 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab01aa-1558-4166-a7ed-68ac830afe10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:57.390528 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab01aa-1558-4166-a7ed-68ac830afe10 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:57.390528 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab01aa-1558-4166-a7ed-68ac830afe10 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:57.390528 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab01aa-1558-4166-a7ed-68ac830afe10 None admin] PATH_INFO: `/v3/services` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:57.390528 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ab01aa-1558-4166-a7ed-68ac830afe10 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:57.390528 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ab01aa-1558-4166-a7ed-68ac830afe10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:57.391893 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ab01aa-1558-4166-a7ed-68ac830afe10 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:57.406984 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 391/764] 10.222.0.47 () {56 vars in 1124 bytes} [Mon Aug 29 22:32:57 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:32:57.414276 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab01aa-1558-4166-a7ed-68ac830afe10 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:57.577694 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:57.578940 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 374/765] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Aug 29 22:32:56 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 637 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 22:32:57.586524 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dfbf63-086d-4c77-97df-3c1f10e16dfa None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:57.622248 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab01aa-1558-4166-a7ed-68ac830afe10 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:57.624792 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:57.686666 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224643f8-f16d-4ed8-829b-11a8ccf6ed14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:57.687646 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224643f8-f16d-4ed8-829b-11a8ccf6ed14 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:57.687933 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224643f8-f16d-4ed8-829b-11a8ccf6ed14 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:57.688476 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224643f8-f16d-4ed8-829b-11a8ccf6ed14 None admin] PATH_INFO: `/v3/services` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:57.689123 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224643f8-f16d-4ed8-829b-11a8ccf6ed14 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:57.689727 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224643f8-f16d-4ed8-829b-11a8ccf6ed14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:57.691779 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224643f8-f16d-4ed8-829b-11a8ccf6ed14 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:57.701279 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 392/766] 10.222.0.47 () {56 vars in 1124 bytes} [Mon Aug 29 22:32:57 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:57.702706 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd699b0-c947-4470-a30f-47acb4942be9 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:57.702996 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd699b0-c947-4470-a30f-47acb4942be9 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:57.703272 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd699b0-c947-4470-a30f-47acb4942be9 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:57.708798 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 393/767] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:32:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:32:57.711356 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd699b0-c947-4470-a30f-47acb4942be9 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:57.742946 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dfbf63-086d-4c77-97df-3c1f10e16dfa None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:57.782861 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf8b894-e07d-402d-83cc-68df475f7da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:57.783506 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8b894-e07d-402d-83cc-68df475f7da4 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:57.783865 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8b894-e07d-402d-83cc-68df475f7da4 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:57.784205 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8b894-e07d-402d-83cc-68df475f7da4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:57.794985 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf8b894-e07d-402d-83cc-68df475f7da4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:57.796506 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf8b894-e07d-402d-83cc-68df475f7da4 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:57.812344 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-eaf8b894-e07d-402d-83cc-68df475f7da4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:57.812344 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:57.812344 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:57.812344 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:57.812344 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:57.812344 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:57.812344 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:57.812344 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:57.812344 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:57.812344 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:57.812344 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:57.812344 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:57.812344 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:32:57.812344 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:32:57.812344 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:32:57.812344 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:32:57.813292 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:57.813292 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:57.813292 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:57.813292 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:57.813292 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:57.813292 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:57.813292 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:57.813292 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:57.813292 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:57.813292 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:57.813292 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:57.813292 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:57.813292 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:57.813292 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:57.813292 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:57.813292 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:57.813292 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:32:57.814942 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:32:57.814942 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:57.814942 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:32:57.818374 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 375/768] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:32:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:57.820873 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b505f4-4495-4574-be9f-dca9b77e8ec7 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:57.821220 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b505f4-4495-4574-be9f-dca9b77e8ec7 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:57.821576 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b505f4-4495-4574-be9f-dca9b77e8ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:57.843648 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd699b0-c947-4470-a30f-47acb4942be9 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:57.844662 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-28b505f4-4495-4574-be9f-dca9b77e8ec7 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:32:57.846982 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-28b505f4-4495-4574-be9f-dca9b77e8ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:57.880565 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822d25ae-4417-499b-9807-0800a5ee54c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:57.881316 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d25ae-4417-499b-9807-0800a5ee54c6 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:57.881681 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d25ae-4417-499b-9807-0800a5ee54c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:57.882011 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d25ae-4417-499b-9807-0800a5ee54c6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:57.882774 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822d25ae-4417-499b-9807-0800a5ee54c6 None admin] RBAC: Adding query filter params (interface=public, service_id=17d829aab43648cc8038731454104a67, region_id=RegionOne) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:57.883139 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822d25ae-4417-499b-9807-0800a5ee54c6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:57.884642 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822d25ae-4417-499b-9807-0800a5ee54c6 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:57.898267 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 394/769] 10.222.0.47 () {56 vars in 1251 bytes} [Mon Aug 29 22:32:57 2022] GET /identity/v3/endpoints?service_id=17d829aab43648cc8038731454104a67&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:57.899124 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822d25ae-4417-499b-9807-0800a5ee54c6 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:57.911361 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:57.942922 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 376/770] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:32:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:32:57.942922 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b505f4-4495-4574-be9f-dca9b77e8ec7 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:57.950206 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:58.053716 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822d25ae-4417-499b-9807-0800a5ee54c6 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:58.093354 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df737d8-5103-4a94-984a-c6d3db95717c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:58.093354 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df737d8-5103-4a94-984a-c6d3db95717c None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:58.093354 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df737d8-5103-4a94-984a-c6d3db95717c None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:58.093354 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df737d8-5103-4a94-984a-c6d3db95717c None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:58.093791 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df737d8-5103-4a94-984a-c6d3db95717c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:58.093791 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df737d8-5103-4a94-984a-c6d3db95717c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:58.093791 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df737d8-5103-4a94-984a-c6d3db95717c None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:58.109353 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 395/771] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:32:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:58.112666 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df737d8-5103-4a94-984a-c6d3db95717c None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:58.124478 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b505f4-4495-4574-be9f-dca9b77e8ec7 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:58.164507 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e9772-63d5-45bb-ab08-905699423715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:58.165794 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e9772-63d5-45bb-ab08-905699423715 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:58.166275 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e9772-63d5-45bb-ab08-905699423715 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:58.166747 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e9772-63d5-45bb-ab08-905699423715 None admin] PATH_INFO: `/v3/services` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:58.167583 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50e9772-63d5-45bb-ab08-905699423715 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:58.169185 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50e9772-63d5-45bb-ab08-905699423715 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:58.175479 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 377/772] 10.222.0.47 () {56 vars in 1087 bytes} [Mon Aug 29 22:32:57 2022] GET /identity/v3/services => generated 772 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:58.217501 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:58.270082 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df737d8-5103-4a94-984a-c6d3db95717c None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:58.311457 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e9772-63d5-45bb-ab08-905699423715 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:58.338161 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbabafae-2cd1-4fdf-8bb5-cbfff2fc63e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:58.338819 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbabafae-2cd1-4fdf-8bb5-cbfff2fc63e9 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:58.339102 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbabafae-2cd1-4fdf-8bb5-cbfff2fc63e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:58.339374 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbabafae-2cd1-4fdf-8bb5-cbfff2fc63e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:58.351963 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbabafae-2cd1-4fdf-8bb5-cbfff2fc63e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:58.353495 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbabafae-2cd1-4fdf-8bb5-cbfff2fc63e9 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:58.373639 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-bbabafae-2cd1-4fdf-8bb5-cbfff2fc63e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:32:58.373639 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:58.373639 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:58.373639 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:58.373639 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:58.373639 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:58.373639 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:58.373639 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:58.373639 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:58.373639 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:58.373639 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:58.373639 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:58.373639 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:32:58.373639 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:32:58.373639 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:32:58.374576 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:32:58.374576 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:58.374576 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:58.374576 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:58.374576 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:58.374576 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:58.374576 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:58.374576 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:58.374576 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:58.374576 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:58.374576 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:58.374576 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:58.374576 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:58.374576 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:58.374576 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:58.374576 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:58.374576 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:58.375460 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:32:58.375460 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:32:58.375460 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:32:58.375460 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:32:58.375460 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:32:58.375460 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:32:58.375460 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:32:58.375460 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:32:58.375460 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 396/773] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Aug 29 22:32:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:32:58.380611 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbabafae-2cd1-4fdf-8bb5-cbfff2fc63e9 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:58.405318 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:58.455852 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e9772-63d5-45bb-ab08-905699423715 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:58.503510 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49978758-8602-4cab-b82c-8c8f58df6ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:58.503713 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49978758-8602-4cab-b82c-8c8f58df6ce7 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:58.503948 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49978758-8602-4cab-b82c-8c8f58df6ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:58.504162 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49978758-8602-4cab-b82c-8c8f58df6ce7 None admin] PATH_INFO: `/v3/services/network` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:58.504747 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49978758-8602-4cab-b82c-8c8f58df6ce7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:58.504946 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbabafae-2cd1-4fdf-8bb5-cbfff2fc63e9 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:58.506190 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49978758-8602-4cab-b82c-8c8f58df6ce7 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:58.518464 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-49978758-8602-4cab-b82c-8c8f58df6ce7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 22:32:58.518464 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:58.518464 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:32:58.518464 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:32:58.518464 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:32:58.518464 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:32:58.518464 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:32:58.518464 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:32:58.518464 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 22:32:58.518464 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:32:58.518464 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:32:58.518464 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:32:58.518464 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:58.518464 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:58.518464 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:58.518464 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:58.518464 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:58.519464 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:58.519464 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:58.519464 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:58.519464 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:58.519464 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:58.519464 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:58.519464 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:32:58.519464 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:32:58.519464 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:32:58.519464 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:32:58.519464 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:58.519464 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:58.519464 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:58.519464 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:58.519464 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:58.519464 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:58.520271 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:58.520271 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:58.520271 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:58.520271 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:58.520271 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:58.520271 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:58.520271 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:58.520271 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:58.520271 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:58.520271 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:58.520271 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:32:58.520271 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:32:58.520271 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 22:32:58.520271 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:32:58.520271 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 378/774] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Aug 29 22:32:58 2022] GET /identity/v3/services/network => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:58.526972 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49978758-8602-4cab-b82c-8c8f58df6ce7 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:58.543253 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:58.560702 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce6a827-7e74-484d-a077-4c13cb76bb51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:58.561505 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6a827-7e74-484d-a077-4c13cb76bb51 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:58.561792 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6a827-7e74-484d-a077-4c13cb76bb51 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:58.562421 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6a827-7e74-484d-a077-4c13cb76bb51 None admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:58.563457 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce6a827-7e74-484d-a077-4c13cb76bb51 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:58.563773 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce6a827-7e74-484d-a077-4c13cb76bb51 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:58.565733 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce6a827-7e74-484d-a077-4c13cb76bb51 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:58.583490 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 397/775] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Aug 29 22:32:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:58.585502 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a34f0-0255-4c33-a212-75383381839c None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:58.585787 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a34f0-0255-4c33-a212-75383381839c None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:58.586063 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a34f0-0255-4c33-a212-75383381839c None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:58.591800 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 398/776] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:32:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:32:58.592890 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a34f0-0255-4c33-a212-75383381839c None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:58.671247 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49978758-8602-4cab-b82c-8c8f58df6ce7 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:58.711228 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:58.719846 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90560a60-ed6c-4d7f-8363-f6c8853ff2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:58.720472 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90560a60-ed6c-4d7f-8363-f6c8853ff2fb None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:58.720824 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90560a60-ed6c-4d7f-8363-f6c8853ff2fb None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:58.721100 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90560a60-ed6c-4d7f-8363-f6c8853ff2fb None admin] PATH_INFO: `/v3/services` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:58.722033 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90560a60-ed6c-4d7f-8363-f6c8853ff2fb None admin] RBAC: Adding query filter params (name=network) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:58.722343 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90560a60-ed6c-4d7f-8363-f6c8853ff2fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:58.724459 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90560a60-ed6c-4d7f-8363-f6c8853ff2fb None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:58.735526 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 379/777] 10.222.0.47 () {56 vars in 1112 bytes} [Mon Aug 29 22:32:58 2022] GET /identity/v3/services?name=network => generated 124 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:32:58.735526 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a43ad-0598-4e48-9ba9-4f206d7a6946 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:58.735526 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a43ad-0598-4e48-9ba9-4f206d7a6946 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:58.735526 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a43ad-0598-4e48-9ba9-4f206d7a6946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:58.739582 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a34f0-0255-4c33-a212-75383381839c None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:58.754749 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-364a43ad-0598-4e48-9ba9-4f206d7a6946 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:32:58.756904 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-364a43ad-0598-4e48-9ba9-4f206d7a6946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:58.793409 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216a1e75-a447-4425-bf50-1fc0ea5f9450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:58.794570 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a1e75-a447-4425-bf50-1fc0ea5f9450 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:58.795005 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a1e75-a447-4425-bf50-1fc0ea5f9450 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:58.795651 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a1e75-a447-4425-bf50-1fc0ea5f9450 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:58.797007 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216a1e75-a447-4425-bf50-1fc0ea5f9450 None admin] RBAC: Adding query filter params (role.id=d00eabaec96a4956aaec2c37a5819c25, scope.project.id=ce09f0beb1a342febbb4a8b3c7cf60c2, user.id=388d8dea2edf4fb888d42ca878c1434d) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:58.797760 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216a1e75-a447-4425-bf50-1fc0ea5f9450 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:58.799438 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216a1e75-a447-4425-bf50-1fc0ea5f9450 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:58.807834 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 399/778] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Aug 29 22:32:58 2022] GET /identity/v3/role_assignments?user.id=388d8dea2edf4fb888d42ca878c1434d&scope.project.id=ce09f0beb1a342febbb4a8b3c7cf60c2&role.id=d00eabaec96a4956aaec2c37a5819c25 => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:58.808868 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216a1e75-a447-4425-bf50-1fc0ea5f9450 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:58.875228 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 380/779] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:32:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:32:58.919967 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:58.991073 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216a1e75-a447-4425-bf50-1fc0ea5f9450 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:59.032847 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382efc14-4fb1-4a75-aecf-a6cb74e48d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:59.033806 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382efc14-4fb1-4a75-aecf-a6cb74e48d01 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:59.034332 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382efc14-4fb1-4a75-aecf-a6cb74e48d01 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:59.034811 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382efc14-4fb1-4a75-aecf-a6cb74e48d01 None admin] PATH_INFO: `/v3/services` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:59.035682 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382efc14-4fb1-4a75-aecf-a6cb74e48d01 None admin] RBAC: Adding query filter params (type=network) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:59.036241 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382efc14-4fb1-4a75-aecf-a6cb74e48d01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:59.038211 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382efc14-4fb1-4a75-aecf-a6cb74e48d01 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:59.047522 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 400/780] 10.222.0.47 () {56 vars in 1112 bytes} [Mon Aug 29 22:32:58 2022] GET /identity/v3/services?type=network => generated 350 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:59.053724 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364a43ad-0598-4e48-9ba9-4f206d7a6946 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:59.196962 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364a43ad-0598-4e48-9ba9-4f206d7a6946 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:59.200357 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382efc14-4fb1-4a75-aecf-a6cb74e48d01 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:59.245631 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:59.270855 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d946a0b-54d8-45a4-adec-7c8248fbdb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:59.275252 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d946a0b-54d8-45a4-adec-7c8248fbdb82 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:59.275582 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d946a0b-54d8-45a4-adec-7c8248fbdb82 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:59.275860 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d946a0b-54d8-45a4-adec-7c8248fbdb82 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:59.276645 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d946a0b-54d8-45a4-adec-7c8248fbdb82 None admin] RBAC: Adding query filter params (interface=public, service_id=f7fdb68c4cf94364aa422bb5368c017c, region_id=RegionOne) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:59.276958 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d946a0b-54d8-45a4-adec-7c8248fbdb82 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:59.278368 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d946a0b-54d8-45a4-adec-7c8248fbdb82 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:59.288901 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 381/781] 10.222.0.47 () {56 vars in 1251 bytes} [Mon Aug 29 22:32:59 2022] GET /identity/v3/endpoints?service_id=f7fdb68c4cf94364aa422bb5368c017c&interface=public®ion_id=RegionOne => generated 194 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:59.290832 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598f69b-3fa5-4a0e-9cb4-168f26b3e74a None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:59.291279 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598f69b-3fa5-4a0e-9cb4-168f26b3e74a None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:59.291704 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598f69b-3fa5-4a0e-9cb4-168f26b3e74a None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:59.293906 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 382/782] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:32:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:32:59.298210 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7598f69b-3fa5-4a0e-9cb4-168f26b3e74a None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:59.354344 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382efc14-4fb1-4a75-aecf-a6cb74e48d01 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:59.372997 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:59.396090 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d07a6-0721-4298-9e95-abfa309b4c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:59.397278 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d07a6-0721-4298-9e95-abfa309b4c9c None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:59.397736 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d07a6-0721-4298-9e95-abfa309b4c9c None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:59.398201 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d07a6-0721-4298-9e95-abfa309b4c9c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:59.410077 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267d07a6-0721-4298-9e95-abfa309b4c9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:32:59.416261 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-267d07a6-0721-4298-9e95-abfa309b4c9c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:32:59.416261 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:59.416261 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:59.416261 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:59.416261 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:59.416261 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:59.416261 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:59.416261 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:59.416261 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:59.416261 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:59.416261 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:59.416261 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:59.416261 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:32:59.416261 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:32:59.416261 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:32:59.416261 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:32:59.417237 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:32:59.417237 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:32:59.417237 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:32:59.417237 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:32:59.417237 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:59.417237 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:59.417237 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:59.417237 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:59.417237 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:59.417237 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:59.417237 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:59.417237 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:59.417237 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:59.417237 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:59.417237 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:59.417237 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:59.418108 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:59.418108 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:59.418108 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:59.418108 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:59.418108 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:32:59.418108 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:32:59.418108 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:32:59.418108 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:32:59.418108 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:32:59.418108 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:32:59.418108 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:32:59.418108 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:32:59.423020 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 401/783] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Aug 29 22:32:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:59.424382 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec0df4-2cd2-4c6a-a910-f1455471cb46 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:59.424719 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec0df4-2cd2-4c6a-a910-f1455471cb46 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:59.424997 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec0df4-2cd2-4c6a-a910-f1455471cb46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:59.444928 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-dbec0df4-2cd2-4c6a-a910-f1455471cb46 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:32:59.446205 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-dbec0df4-2cd2-4c6a-a910-f1455471cb46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:32:59.451073 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7598f69b-3fa5-4a0e-9cb4-168f26b3e74a None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:59.497144 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c6f216-1e94-43cd-9951-c1b97f0e8a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:59.497799 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6f216-1e94-43cd-9951-c1b97f0e8a8c None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:59.498081 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6f216-1e94-43cd-9951-c1b97f0e8a8c None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:59.498645 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6f216-1e94-43cd-9951-c1b97f0e8a8c None admin] PATH_INFO: `/v3/services` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:59.498961 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c6f216-1e94-43cd-9951-c1b97f0e8a8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:59.500509 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c6f216-1e94-43cd-9951-c1b97f0e8a8c None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:59.506285 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 383/784] 10.222.0.47 () {56 vars in 1087 bytes} [Mon Aug 29 22:32:59 2022] GET /identity/v3/services => generated 772 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:59.507769 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c6f216-1e94-43cd-9951-c1b97f0e8a8c None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:59.533613 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 402/785] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:32:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:32:59.597735 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:59.674947 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c6f216-1e94-43cd-9951-c1b97f0e8a8c None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:59.715283 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc1d5f-ed2e-4904-b879-17b1c62b8b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:59.715901 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc1d5f-ed2e-4904-b879-17b1c62b8b9f None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:59.716187 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc1d5f-ed2e-4904-b879-17b1c62b8b9f None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:59.716459 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc1d5f-ed2e-4904-b879-17b1c62b8b9f None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:59.717121 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bc1d5f-ed2e-4904-b879-17b1c62b8b9f None admin] RBAC: Adding query filter params (name=admin) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:32:59.717456 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bc1d5f-ed2e-4904-b879-17b1c62b8b9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:59.718884 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bc1d5f-ed2e-4904-b879-17b1c62b8b9f None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:59.730609 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 384/786] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Aug 29 22:32:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:32:59.736178 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec0df4-2cd2-4c6a-a910-f1455471cb46 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:59.850867 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec0df4-2cd2-4c6a-a910-f1455471cb46 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:32:59.860556 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:32:59.869036 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc1d5f-ed2e-4904-b879-17b1c62b8b9f None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:32:59.910290 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529b4bb4-7cde-488c-badd-015335e1887a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:32:59.911162 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b4bb4-7cde-488c-badd-015335e1887a None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:32:59.911579 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b4bb4-7cde-488c-badd-015335e1887a None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:32:59.912095 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b4bb4-7cde-488c-badd-015335e1887a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:32:59.936662 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529b4bb4-7cde-488c-badd-015335e1887a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:32:59.938821 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529b4bb4-7cde-488c-badd-015335e1887a None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:32:59.962423 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-529b4bb4-7cde-488c-badd-015335e1887a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:59.962423 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:32:59.962423 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:32:59.962423 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:32:59.962423 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:32:59.962423 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:32:59.962423 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:32:59.962423 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:32:59.962423 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:32:59.962423 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:32:59.962423 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:32:59.962423 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:32:59.962423 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:32:59.962423 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:32:59.962423 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:32:59.962423 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:32:59.963593 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:32:59.963593 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:32:59.963593 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:32:59.963593 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:32:59.963593 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:32:59.963593 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:32:59.963593 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:32:59.963593 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:32:59.963593 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:32:59.963593 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:32:59.963593 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:32:59.963593 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:32:59.963593 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:32:59.963593 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:32:59.963593 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:32:59.963593 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:32:59.963593 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:32:59.964569 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:32:59.964569 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:32:59.964569 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:32:59.972080 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 403/787] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:32:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:32:59.978387 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529b4bb4-7cde-488c-badd-015335e1887a None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:00.027383 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc1d5f-ed2e-4904-b879-17b1c62b8b9f None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:00.057740 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:00.088214 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f840381-9ffb-45d6-a184-57f5e8a6809b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:00.090283 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f840381-9ffb-45d6-a184-57f5e8a6809b None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:00.090853 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f840381-9ffb-45d6-a184-57f5e8a6809b None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:00.092153 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f840381-9ffb-45d6-a184-57f5e8a6809b None admin] PATH_INFO: `/v3/roles/service` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:00.120288 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f840381-9ffb-45d6-a184-57f5e8a6809b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:33:00.130121 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-8f840381-9ffb-45d6-a184-57f5e8a6809b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:33:00.130121 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:00.130121 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:00.130121 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:00.130121 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:00.130121 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:00.130121 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:00.130121 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:00.130121 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:00.130121 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:00.130121 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:00.130121 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:00.130121 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:33:00.130121 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:33:00.130121 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:33:00.130121 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:33:00.131776 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:33:00.131776 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:33:00.131776 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:33:00.131776 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:33:00.131776 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:00.131776 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:00.131776 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:00.131776 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:00.131776 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:00.131776 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:00.131776 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:00.131776 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:00.131776 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:00.131776 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:00.131776 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:00.131776 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:00.132718 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:00.132718 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:00.132718 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:00.132718 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:00.132718 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:33:00.132718 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:33:00.132718 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:33:00.132718 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:33:00.132718 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:33:00.132718 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:33:00.132718 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:33:00.132718 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:33:00.137187 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 385/788] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Aug 29 22:32:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:33:00.141108 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f840381-9ffb-45d6-a184-57f5e8a6809b None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:00.184192 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529b4bb4-7cde-488c-badd-015335e1887a None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:00.223424 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ec6a4-0a38-4dd6-8159-06daf1d04574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:00.224432 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ec6a4-0a38-4dd6-8159-06daf1d04574 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:00.225019 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ec6a4-0a38-4dd6-8159-06daf1d04574 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:00.225670 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ec6a4-0a38-4dd6-8159-06daf1d04574 None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:00.226628 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22ec6a4-0a38-4dd6-8159-06daf1d04574 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:00.227141 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22ec6a4-0a38-4dd6-8159-06daf1d04574 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:00.228791 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22ec6a4-0a38-4dd6-8159-06daf1d04574 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:00.243489 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 404/789] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:32:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:00.253381 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ec6a4-0a38-4dd6-8159-06daf1d04574 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:00.281936 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:00.339518 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f840381-9ffb-45d6-a184-57f5e8a6809b None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:00.390140 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0450086a-628e-432f-a274-6cf17a8b988b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:00.390693 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0450086a-628e-432f-a274-6cf17a8b988b None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:00.390969 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0450086a-628e-432f-a274-6cf17a8b988b None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:00.391269 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0450086a-628e-432f-a274-6cf17a8b988b None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:00.391927 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0450086a-628e-432f-a274-6cf17a8b988b None admin] RBAC: Adding query filter params (name=service) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:00.392233 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0450086a-628e-432f-a274-6cf17a8b988b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:00.393775 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0450086a-628e-432f-a274-6cf17a8b988b None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:00.400726 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ec6a4-0a38-4dd6-8159-06daf1d04574 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:00.412657 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 386/790] 10.222.0.47 () {56 vars in 1103 bytes} [Mon Aug 29 22:33:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:00.418224 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0450086a-628e-432f-a274-6cf17a8b988b None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:00.442502 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53061043-75f9-4842-8c2d-06e6859a9d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:00.444150 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53061043-75f9-4842-8c2d-06e6859a9d79 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:00.445533 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53061043-75f9-4842-8c2d-06e6859a9d79 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:00.446664 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53061043-75f9-4842-8c2d-06e6859a9d79 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:00.462305 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53061043-75f9-4842-8c2d-06e6859a9d79 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:00.464675 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53061043-75f9-4842-8c2d-06e6859a9d79 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:00.482759 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-53061043-75f9-4842-8c2d-06e6859a9d79 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 22:33:00.482759 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:00.482759 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:00.482759 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:00.482759 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:00.482759 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:00.482759 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:00.482759 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:00.482759 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:00.482759 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:00.482759 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:00.482759 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:00.482759 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:33:00.482759 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:33:00.482759 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:33:00.482759 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:33:00.483767 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:00.483767 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:00.483767 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:33:00.483767 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:33:00.483767 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:33:00.483767 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:33:00.483767 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:00.483767 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:00.483767 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:00.483767 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:00.483767 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:00.483767 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:00.483767 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:00.483767 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:00.483767 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:00.483767 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:00.483767 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:00.483767 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:00.484697 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:00.484697 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:00.484697 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:33:00.484697 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:33:00.484697 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:33:00.484697 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:33:00.484697 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:33:00.484697 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:33:00.484697 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 22:33:00.484697 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:33:00.492777 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:00.494930 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 405/791] 10.222.0.47 () {56 vars in 1093 bytes} [Mon Aug 29 22:33:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:33:00.501084 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53061043-75f9-4842-8c2d-06e6859a9d79 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:00.630847 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0450086a-628e-432f-a274-6cf17a8b988b None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:00.641920 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:00.665623 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53061043-75f9-4842-8c2d-06e6859a9d79 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:00.678216 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812bc763-60f3-4e15-b759-b676e7ea6c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:00.679184 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812bc763-60f3-4e15-b759-b676e7ea6c6d None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:00.679482 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812bc763-60f3-4e15-b759-b676e7ea6c6d None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:00.679762 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812bc763-60f3-4e15-b759-b676e7ea6c6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:00.695296 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812bc763-60f3-4e15-b759-b676e7ea6c6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:00.697055 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812bc763-60f3-4e15-b759-b676e7ea6c6d None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:00.707596 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b927d8-759a-47f2-82d9-88aee63670f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:00.708508 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b927d8-759a-47f2-82d9-88aee63670f2 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:00.708791 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b927d8-759a-47f2-82d9-88aee63670f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:00.709067 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b927d8-759a-47f2-82d9-88aee63670f2 None admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:00.710725 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b927d8-759a-47f2-82d9-88aee63670f2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:00.711132 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b927d8-759a-47f2-82d9-88aee63670f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:00.712584 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b927d8-759a-47f2-82d9-88aee63670f2 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:00.715834 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-812bc763-60f3-4e15-b759-b676e7ea6c6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:33:00.715834 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:00.715834 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:00.715834 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:00.715834 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:00.715834 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:00.715834 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:00.715834 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:00.715834 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:00.715834 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:00.715834 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:00.715834 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:00.715834 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:33:00.715834 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:33:00.715834 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:33:00.715834 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:33:00.716734 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:00.716734 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:00.716734 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:00.716734 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:00.716734 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:00.716734 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:00.716734 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:00.716734 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:00.716734 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:00.716734 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:00.716734 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:00.716734 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:00.716734 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:00.716734 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:00.716734 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:00.716734 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:00.716734 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:33:00.717619 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:33:00.717619 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:33:00.717619 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:33:00.719858 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 387/792] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:33:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:33:00.721377 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680dbbb6-c945-407b-a7f0-b6dc086623fc None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:00.721861 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680dbbb6-c945-407b-a7f0-b6dc086623fc None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:00.722340 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680dbbb6-c945-407b-a7f0-b6dc086623fc None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:00.724009 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 388/793] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:33:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:33:00.730137 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa1069-0a5d-4db2-8f09-999abe7b1533 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:00.730718 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa1069-0a5d-4db2-8f09-999abe7b1533 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:00.731187 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa1069-0a5d-4db2-8f09-999abe7b1533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:00.733567 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 406/794] 10.222.0.47 () {56 vars in 1133 bytes} [Mon Aug 29 22:33:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:00.734407 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b927d8-759a-47f2-82d9-88aee63670f2 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:00.763251 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-0efa1069-0a5d-4db2-8f09-999abe7b1533 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:00.765027 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-0efa1069-0a5d-4db2-8f09-999abe7b1533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:00.847317 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b927d8-759a-47f2-82d9-88aee63670f2 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:00.849701 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 389/795] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:33:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:33:00.851859 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efa1069-0a5d-4db2-8f09-999abe7b1533 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:00.886728 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:00.904833 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda421a-7084-4dd9-9930-3bfaddf4901c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:00.906092 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda421a-7084-4dd9-9930-3bfaddf4901c None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:00.907306 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda421a-7084-4dd9-9930-3bfaddf4901c None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:00.907879 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda421a-7084-4dd9-9930-3bfaddf4901c None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:00.908832 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda421a-7084-4dd9-9930-3bfaddf4901c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:00.910471 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda421a-7084-4dd9-9930-3bfaddf4901c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:00.914299 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda421a-7084-4dd9-9930-3bfaddf4901c None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:00.918976 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:00.929388 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 407/796] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:33:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:00.942359 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda421a-7084-4dd9-9930-3bfaddf4901c None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:01.002770 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efa1069-0a5d-4db2-8f09-999abe7b1533 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:01.041215 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8fa2e6-c1dc-4168-b35f-801c05f971a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:01.042094 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8fa2e6-c1dc-4168-b35f-801c05f971a6 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:01.049510 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8fa2e6-c1dc-4168-b35f-801c05f971a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:01.049510 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8fa2e6-c1dc-4168-b35f-801c05f971a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:01.115671 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda421a-7084-4dd9-9930-3bfaddf4901c None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:01.156782 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0095a596-10b7-4701-836e-b918745e3987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:01.157795 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095a596-10b7-4701-836e-b918745e3987 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:01.158078 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095a596-10b7-4701-836e-b918745e3987 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:01.158350 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095a596-10b7-4701-836e-b918745e3987 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:01.167050 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0095a596-10b7-4701-836e-b918745e3987 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:01.168498 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0095a596-10b7-4701-836e-b918745e3987 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:01.182272 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-0095a596-10b7-4701-836e-b918745e3987 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 22:33:01.182272 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:01.182272 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:01.182272 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:01.182272 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:01.182272 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:01.182272 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:01.182272 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:01.182272 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:01.182272 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:01.182272 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:01.182272 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:01.182272 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:33:01.182272 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:33:01.182272 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:33:01.182272 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:33:01.183235 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:01.183235 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:01.183235 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:33:01.183235 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:33:01.183235 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:33:01.183235 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:33:01.183235 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:01.183235 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:01.183235 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:01.183235 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:01.183235 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:01.183235 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:01.183235 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:01.183235 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:01.183235 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:01.183235 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:01.183235 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:01.183235 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:01.184162 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:01.184162 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:01.184162 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:33:01.184162 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:33:01.184162 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:33:01.184162 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:33:01.184162 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:33:01.184162 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:33:01.184162 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 22:33:01.184162 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:33:01.184162 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 408/797] 10.222.0.47 () {56 vars in 1117 bytes} [Mon Aug 29 22:33:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:33:01.185219 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0accd-e5f3-468c-8dfd-476419c33b68 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:01.185219 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0accd-e5f3-468c-8dfd-476419c33b68 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:01.185494 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0accd-e5f3-468c-8dfd-476419c33b68 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:01.187573 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 409/798] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:33:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:33:01.188283 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c0accd-e5f3-468c-8dfd-476419c33b68 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:01.201561 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8fa2e6-c1dc-4168-b35f-801c05f971a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:01.203453 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8fa2e6-c1dc-4168-b35f-801c05f971a6 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:01.222912 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:01.261803 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:01.319233 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c0accd-e5f3-468c-8dfd-476419c33b68 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:01.330307 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 390/799] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Aug 29 22:33:00 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 22:33:01.330307 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8fa2e6-c1dc-4168-b35f-801c05f971a6 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:01.364126 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95680f2-5944-4044-bff9-1c81d776e3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:01.364915 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95680f2-5944-4044-bff9-1c81d776e3dd None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:01.365575 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95680f2-5944-4044-bff9-1c81d776e3dd None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:01.366425 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95680f2-5944-4044-bff9-1c81d776e3dd None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:01.367623 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95680f2-5944-4044-bff9-1c81d776e3dd None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:01.369166 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95680f2-5944-4044-bff9-1c81d776e3dd None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:01.380315 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-a95680f2-5944-4044-bff9-1c81d776e3dd None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 22:33:01.380315 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:01.380315 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:33:01.380315 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:33:01.380315 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:33:01.380315 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:33:01.380315 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:33:01.380315 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:33:01.380315 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 22:33:01.380315 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:33:01.380315 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:33:01.380315 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:33:01.380315 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:01.380315 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:01.380315 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:01.380315 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:01.380315 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:01.381586 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:01.381586 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:01.381586 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:01.381586 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:01.381586 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:01.381586 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:01.381586 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:33:01.381586 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:33:01.381586 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:33:01.381586 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:33:01.381586 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:01.381586 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:01.381586 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:01.381586 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:01.381586 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:01.381586 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:01.382580 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:01.382580 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:01.382580 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:01.382580 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:01.382580 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:01.382580 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:01.382580 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:01.382580 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:01.382580 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:01.382580 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:01.382580 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:33:01.382580 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:33:01.382580 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 22:33:01.382580 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:33:01.382580 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 410/800] 10.222.0.47 () {56 vars in 1129 bytes} [Mon Aug 29 22:33:01 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:33:01.384080 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b57b9-56ad-49d1-ad62-049818603bc6 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:01.384080 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b57b9-56ad-49d1-ad62-049818603bc6 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:01.384080 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b57b9-56ad-49d1-ad62-049818603bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:01.402942 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-990b57b9-56ad-49d1-ad62-049818603bc6 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:01.404131 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-990b57b9-56ad-49d1-ad62-049818603bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:01.444957 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8fa2e6-c1dc-4168-b35f-801c05f971a6 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:01.464032 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:01.478529 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 411/801] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:33:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:33:01.479498 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990b57b9-56ad-49d1-ad62-049818603bc6 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:01.492971 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb0f696-f6e5-407c-a251-7e677940a6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:01.493988 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0f696-f6e5-407c-a251-7e677940a6af None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:01.494451 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0f696-f6e5-407c-a251-7e677940a6af None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:01.494947 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0f696-f6e5-407c-a251-7e677940a6af None admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:01.496097 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb0f696-f6e5-407c-a251-7e677940a6af None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:01.496738 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb0f696-f6e5-407c-a251-7e677940a6af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:01.498448 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb0f696-f6e5-407c-a251-7e677940a6af None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:01.519726 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 391/802] 10.222.0.47 () {56 vars in 1149 bytes} [Mon Aug 29 22:33:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:01.520869 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb0f696-f6e5-407c-a251-7e677940a6af None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:01.534648 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:01.588540 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990b57b9-56ad-49d1-ad62-049818603bc6 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:01.625783 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5b6b2c-6308-48ea-be10-5bb2b417bab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:01.626451 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b6b2c-6308-48ea-be10-5bb2b417bab6 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:01.626815 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b6b2c-6308-48ea-be10-5bb2b417bab6 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:01.627167 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b6b2c-6308-48ea-be10-5bb2b417bab6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:01.638269 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5b6b2c-6308-48ea-be10-5bb2b417bab6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:01.639258 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb0f696-f6e5-407c-a251-7e677940a6af None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:01.639903 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5b6b2c-6308-48ea-be10-5bb2b417bab6 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:01.655856 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-dd5b6b2c-6308-48ea-be10-5bb2b417bab6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:33:01.655856 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:01.655856 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:01.655856 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:01.655856 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:01.655856 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:01.655856 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:01.655856 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:01.655856 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:01.655856 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:01.655856 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:01.655856 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:01.655856 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:33:01.655856 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:33:01.655856 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:33:01.655856 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:33:01.656828 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:01.656828 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:01.656828 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:01.656828 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:01.656828 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:01.656828 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:01.656828 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:01.656828 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:01.656828 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:01.656828 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:01.656828 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:01.656828 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:01.656828 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:01.656828 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:01.656828 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:01.656828 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:01.656828 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:33:01.657755 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:33:01.657755 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:33:01.657755 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:33:01.661838 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 412/803] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:33:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:33:01.663323 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5b6b2c-6308-48ea-be10-5bb2b417bab6 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:01.680934 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2bec88-f7a5-4be0-b866-626bc80b0538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:01.681933 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2bec88-f7a5-4be0-b866-626bc80b0538 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:01.682424 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2bec88-f7a5-4be0-b866-626bc80b0538 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:01.682911 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2bec88-f7a5-4be0-b866-626bc80b0538 None admin] PATH_INFO: `/v3/services` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:01.683828 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2bec88-f7a5-4be0-b866-626bc80b0538 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:01.684414 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2bec88-f7a5-4be0-b866-626bc80b0538 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:01.686098 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2bec88-f7a5-4be0-b866-626bc80b0538 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:01.691864 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 392/804] 10.222.0.47 () {56 vars in 1124 bytes} [Mon Aug 29 22:33:01 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:01.692870 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2bec88-f7a5-4be0-b866-626bc80b0538 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:01.769833 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5b6b2c-6308-48ea-be10-5bb2b417bab6 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:01.770025 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:01.773360 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:01.805500 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2bec88-f7a5-4be0-b866-626bc80b0538 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:01.807680 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f85130-6c6c-469a-b5ef-c827a11abeca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:01.808885 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f85130-6c6c-469a-b5ef-c827a11abeca None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:01.808885 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f85130-6c6c-469a-b5ef-c827a11abeca None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:01.808885 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f85130-6c6c-469a-b5ef-c827a11abeca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:01.819870 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f85130-6c6c-469a-b5ef-c827a11abeca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:01.821364 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f85130-6c6c-469a-b5ef-c827a11abeca None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:01.836345 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-e4f85130-6c6c-469a-b5ef-c827a11abeca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:33:01.836345 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:01.836345 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:01.836345 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:01.836345 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:01.836345 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:01.836345 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:01.836345 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:01.836345 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:01.836345 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:01.836345 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:01.836345 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:01.836345 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:33:01.836345 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:33:01.836345 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:33:01.836345 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:33:01.837293 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:01.837293 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:01.837293 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:01.837293 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:01.837293 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:01.837293 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:01.837293 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:01.837293 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:01.837293 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:01.837293 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:01.837293 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:01.837293 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:01.837293 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:01.837293 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:01.837293 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:01.837293 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:01.837293 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:33:01.843382 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:33:01.843382 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:33:01.843382 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:33:01.843382 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 413/805] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:33:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:33:01.843382 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f85130-6c6c-469a-b5ef-c827a11abeca None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:01.847370 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415b3740-aa29-4da4-bdf1-8d193eb00c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:01.847986 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b3740-aa29-4da4-bdf1-8d193eb00c6d None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:01.848267 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b3740-aa29-4da4-bdf1-8d193eb00c6d None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:01.848540 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b3740-aa29-4da4-bdf1-8d193eb00c6d None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:01.849191 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415b3740-aa29-4da4-bdf1-8d193eb00c6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:01.849528 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415b3740-aa29-4da4-bdf1-8d193eb00c6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:01.852126 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415b3740-aa29-4da4-bdf1-8d193eb00c6d None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:01.865842 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 393/806] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:33:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:01.866650 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415b3740-aa29-4da4-bdf1-8d193eb00c6d None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:01.961952 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f85130-6c6c-469a-b5ef-c827a11abeca None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:01.973793 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:01.977594 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415b3740-aa29-4da4-bdf1-8d193eb00c6d None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:01.996701 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5558bf5a-4cd8-48f6-aba5-5ad15ba1f8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:01.997298 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558bf5a-4cd8-48f6-aba5-5ad15ba1f8fe None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:01.997612 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558bf5a-4cd8-48f6-aba5-5ad15ba1f8fe None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:01.997881 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558bf5a-4cd8-48f6-aba5-5ad15ba1f8fe None admin] PATH_INFO: `/v3/services` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:01.998503 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5558bf5a-4cd8-48f6-aba5-5ad15ba1f8fe None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:01.998795 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5558bf5a-4cd8-48f6-aba5-5ad15ba1f8fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:02.000152 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5558bf5a-4cd8-48f6-aba5-5ad15ba1f8fe None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:02.004783 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 414/807] 10.222.0.47 () {56 vars in 1124 bytes} [Mon Aug 29 22:33:01 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:02.005570 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5558bf5a-4cd8-48f6-aba5-5ad15ba1f8fe None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:02.012561 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e4aac-4929-482f-95f5-e13413676712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:02.013196 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e4aac-4929-482f-95f5-e13413676712 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:02.013506 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e4aac-4929-482f-95f5-e13413676712 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:02.013780 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e4aac-4929-482f-95f5-e13413676712 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:02.024696 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2e4aac-4929-482f-95f5-e13413676712 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:33:02.024818 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:02.030301 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-8c2e4aac-4929-482f-95f5-e13413676712 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:33:02.030301 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:02.030301 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:02.030301 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:02.030301 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:02.030301 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:02.030301 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:02.030301 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:02.030301 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:02.030301 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:02.030301 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:02.030301 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:02.030301 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:33:02.030301 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:33:02.030301 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:33:02.030301 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:33:02.031234 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:33:02.031234 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:33:02.031234 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:33:02.031234 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:33:02.031234 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:02.031234 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:02.031234 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:02.031234 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:02.031234 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:02.031234 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:02.031234 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:02.031234 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:02.031234 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:02.031234 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:02.031234 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:02.031234 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:02.032057 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:02.032057 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:02.032057 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:02.032057 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:02.032057 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:33:02.032057 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:33:02.032057 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:33:02.032057 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:33:02.032057 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:33:02.032057 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:33:02.032057 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:33:02.032057 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:33:02.032057 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 394/808] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Aug 29 22:33:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:33:02.032740 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e4aac-4929-482f-95f5-e13413676712 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:02.110432 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5558bf5a-4cd8-48f6-aba5-5ad15ba1f8fe None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:02.133310 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e4aac-4929-482f-95f5-e13413676712 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:02.143405 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31113b78-4a98-428e-a834-0fd9fbbbee4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:02.144002 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31113b78-4a98-428e-a834-0fd9fbbbee4b None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:02.144282 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31113b78-4a98-428e-a834-0fd9fbbbee4b None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:02.144543 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31113b78-4a98-428e-a834-0fd9fbbbee4b None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:02.145176 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31113b78-4a98-428e-a834-0fd9fbbbee4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:02.145509 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31113b78-4a98-428e-a834-0fd9fbbbee4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:02.146916 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31113b78-4a98-428e-a834-0fd9fbbbee4b None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:02.158609 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 415/809] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:33:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:02.159841 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48ff5c-345b-4abf-828b-4a2a4d3457f9 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:02.160124 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48ff5c-345b-4abf-828b-4a2a4d3457f9 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:02.160392 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48ff5c-345b-4abf-828b-4a2a4d3457f9 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:02.161597 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 416/810] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:33:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:33:02.162801 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b48ff5c-345b-4abf-828b-4a2a4d3457f9 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:02.173054 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5dbf9f-311e-4df7-8f49-3dddf4d6f115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:02.173717 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5dbf9f-311e-4df7-8f49-3dddf4d6f115 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:02.174004 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5dbf9f-311e-4df7-8f49-3dddf4d6f115 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:02.174281 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5dbf9f-311e-4df7-8f49-3dddf4d6f115 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:02.181513 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5dbf9f-311e-4df7-8f49-3dddf4d6f115 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:02.182964 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5dbf9f-311e-4df7-8f49-3dddf4d6f115 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:02.194169 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-3b5dbf9f-311e-4df7-8f49-3dddf4d6f115 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:33:02.194169 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:02.194169 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:02.194169 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:02.194169 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:02.194169 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:02.194169 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:02.194169 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:02.194169 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:02.194169 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:02.194169 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:02.194169 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:02.194169 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:33:02.194169 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:33:02.194169 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:33:02.195394 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:33:02.195394 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:02.195394 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:02.195394 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:02.195394 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:02.195394 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:02.195394 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:02.195394 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:02.195394 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:02.195394 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:02.195394 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:02.195394 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:02.195394 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:02.195394 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:02.195394 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:02.195394 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:02.195394 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:02.196276 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:33:02.196276 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:33:02.196276 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:33:02.196276 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:33:02.196276 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:33:02.196276 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:33:02.196276 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:33:02.196276 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:33:02.196276 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 395/811] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Aug 29 22:33:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:33:02.196276 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5dbf9f-311e-4df7-8f49-3dddf4d6f115 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:02.219725 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:02.247683 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:02.271219 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b48ff5c-345b-4abf-828b-4a2a4d3457f9 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:02.300543 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5dbf9f-311e-4df7-8f49-3dddf4d6f115 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:02.310015 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ab3bb-c635-401d-b8e5-9791ccd08152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:02.310651 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ab3bb-c635-401d-b8e5-9791ccd08152 None admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:02.310931 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ab3bb-c635-401d-b8e5-9791ccd08152 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:02.311201 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ab3bb-c635-401d-b8e5-9791ccd08152 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:02.311868 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ab3bb-c635-401d-b8e5-9791ccd08152 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:02.313238 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ab3bb-c635-401d-b8e5-9791ccd08152 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:02.335053 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 417/812] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:33:02 2022] POST /identity/v3/endpoints => generated 346 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:33:02.335994 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ab3bb-c635-401d-b8e5-9791ccd08152 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:02.345183 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc07f677-d908-44f7-9612-b7565d6eeac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:02.346002 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07f677-d908-44f7-9612-b7565d6eeac2 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:02.346283 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07f677-d908-44f7-9612-b7565d6eeac2 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:02.346553 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07f677-d908-44f7-9612-b7565d6eeac2 None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:02.347234 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc07f677-d908-44f7-9612-b7565d6eeac2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:02.347533 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc07f677-d908-44f7-9612-b7565d6eeac2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:02.348951 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc07f677-d908-44f7-9612-b7565d6eeac2 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:02.359813 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 396/813] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Aug 29 22:33:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:02.361226 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cfbce9-ecc3-4bf0-8948-436078b71e5c None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:02.361547 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cfbce9-ecc3-4bf0-8948-436078b71e5c None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:02.361815 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cfbce9-ecc3-4bf0-8948-436078b71e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:02.383640 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-f6cfbce9-ecc3-4bf0-8948-436078b71e5c None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:02.384909 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-f6cfbce9-ecc3-4bf0-8948-436078b71e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:02.472282 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 397/814] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:33:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:33:02.472282 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cfbce9-ecc3-4bf0-8948-436078b71e5c None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:02.479573 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ab3bb-c635-401d-b8e5-9791ccd08152 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:02.483423 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:02.530032 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156bc77c-390f-4102-b4d7-4495d247c7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:02.531061 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156bc77c-390f-4102-b4d7-4495d247c7ae None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:02.531432 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156bc77c-390f-4102-b4d7-4495d247c7ae None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:02.531603 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156bc77c-390f-4102-b4d7-4495d247c7ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:02.534105 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:02.541806 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156bc77c-390f-4102-b4d7-4495d247c7ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:02.544805 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156bc77c-390f-4102-b4d7-4495d247c7ae None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:02.558322 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-156bc77c-390f-4102-b4d7-4495d247c7ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:33:02.558322 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:02.558322 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:02.558322 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:02.558322 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:02.558322 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:02.558322 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:02.558322 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:02.558322 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:02.558322 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:02.558322 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:02.558322 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:02.558322 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:33:02.558322 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:33:02.558322 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:33:02.559232 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:33:02.559232 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:02.559232 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:02.559232 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:02.559232 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:02.559232 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:02.559232 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:02.559232 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:02.559232 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:02.559232 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:02.559232 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:02.559232 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:02.559232 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:02.559232 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:02.559232 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:02.559232 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:02.559232 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:02.560119 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:33:02.560119 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:33:02.560119 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:33:02.560119 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:33:02.560119 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:33:02.560119 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:33:02.560119 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:33:02.560119 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:33:02.562478 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 418/815] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Aug 29 22:33:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:33:02.563478 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156bc77c-390f-4102-b4d7-4495d247c7ae None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:02.604690 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cfbce9-ecc3-4bf0-8948-436078b71e5c None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:02.650910 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16454fac-1fea-4f35-b64d-d7a3e0338dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:02.651883 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16454fac-1fea-4f35-b64d-d7a3e0338dd3 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:02.652363 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16454fac-1fea-4f35-b64d-d7a3e0338dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:02.652904 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16454fac-1fea-4f35-b64d-d7a3e0338dd3 None admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:02.653834 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16454fac-1fea-4f35-b64d-d7a3e0338dd3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:02.654341 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16454fac-1fea-4f35-b64d-d7a3e0338dd3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:02.656676 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16454fac-1fea-4f35-b64d-d7a3e0338dd3 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:02.673461 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 398/816] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Aug 29 22:33:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:02.675027 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16454fac-1fea-4f35-b64d-d7a3e0338dd3 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:02.681214 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156bc77c-390f-4102-b4d7-4495d247c7ae None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:02.724417 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f918a1-8261-41e1-b33a-256e632cb8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:02.725396 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f918a1-8261-41e1-b33a-256e632cb8de None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:02.725811 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f918a1-8261-41e1-b33a-256e632cb8de None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:02.726179 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f918a1-8261-41e1-b33a-256e632cb8de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:02.740321 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f918a1-8261-41e1-b33a-256e632cb8de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:02.742534 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f918a1-8261-41e1-b33a-256e632cb8de None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:02.761023 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:02.762457 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-50f918a1-8261-41e1-b33a-256e632cb8de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:33:02.762457 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:02.762457 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:02.762457 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:02.762457 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:02.762457 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:02.762457 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:02.762457 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:02.762457 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:02.762457 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:02.762457 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:02.762457 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:02.762457 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:33:02.762457 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:33:02.762457 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:33:02.762457 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:33:02.763828 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:02.763828 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:02.763828 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:02.763828 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:02.763828 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:02.763828 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:02.763828 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:02.763828 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:02.763828 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:02.763828 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:02.763828 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:02.763828 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:02.763828 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:02.763828 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:02.763828 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:02.763828 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:02.763828 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:33:02.764992 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:33:02.764992 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:33:02.764992 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:33:02.764992 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 419/817] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:33:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:33:02.768334 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f918a1-8261-41e1-b33a-256e632cb8de None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:02.799649 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16454fac-1fea-4f35-b64d-d7a3e0338dd3 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:02.816719 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:02.840198 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9eec9d-fe53-4f29-9c56-517e60bfdb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:02.841279 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9eec9d-fe53-4f29-9c56-517e60bfdb5f None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:02.841748 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9eec9d-fe53-4f29-9c56-517e60bfdb5f None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:02.842248 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9eec9d-fe53-4f29-9c56-517e60bfdb5f None admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:02.842984 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9eec9d-fe53-4f29-9c56-517e60bfdb5f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:02.843288 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9eec9d-fe53-4f29-9c56-517e60bfdb5f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:02.844714 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9eec9d-fe53-4f29-9c56-517e60bfdb5f None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:02.858459 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 399/818] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Aug 29 22:33:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:02.858991 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9eec9d-fe53-4f29-9c56-517e60bfdb5f None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:02.874894 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f918a1-8261-41e1-b33a-256e632cb8de None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:02.913554 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5ac15d-d073-4001-b7fc-ef1fd87bddd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:02.914524 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ac15d-d073-4001-b7fc-ef1fd87bddd2 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:02.915067 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ac15d-d073-4001-b7fc-ef1fd87bddd2 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:02.915522 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ac15d-d073-4001-b7fc-ef1fd87bddd2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:02.916423 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5ac15d-d073-4001-b7fc-ef1fd87bddd2 None admin] RBAC: Adding query filter params (role.id=d00eabaec96a4956aaec2c37a5819c25, scope.project.id=ce09f0beb1a342febbb4a8b3c7cf60c2, user.id=35441c061e514b1b9341e7694ec2c0bc) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:02.916932 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5ac15d-d073-4001-b7fc-ef1fd87bddd2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:02.918771 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5ac15d-d073-4001-b7fc-ef1fd87bddd2 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:02.925578 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 420/819] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Aug 29 22:33:02 2022] GET /identity/v3/role_assignments?user.id=35441c061e514b1b9341e7694ec2c0bc&scope.project.id=ce09f0beb1a342febbb4a8b3c7cf60c2&role.id=d00eabaec96a4956aaec2c37a5819c25 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:02.926577 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5ac15d-d073-4001-b7fc-ef1fd87bddd2 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:02.979126 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9eec9d-fe53-4f29-9c56-517e60bfdb5f None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:03.013290 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:03.024270 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee4e05-02b1-4774-bcaa-b6f4bd98c619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:03.025249 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee4e05-02b1-4774-bcaa-b6f4bd98c619 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:03.025628 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee4e05-02b1-4774-bcaa-b6f4bd98c619 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:03.026032 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee4e05-02b1-4774-bcaa-b6f4bd98c619 None admin] PATH_INFO: `/v3/services/network` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:03.026727 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ee4e05-02b1-4774-bcaa-b6f4bd98c619 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:03.028424 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ee4e05-02b1-4774-bcaa-b6f4bd98c619 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:03.039949 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-e4ee4e05-02b1-4774-bcaa-b6f4bd98c619 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 22:33:03.039949 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:03.039949 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:33:03.039949 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:33:03.039949 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:33:03.039949 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:33:03.039949 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:33:03.039949 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:33:03.039949 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 22:33:03.039949 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:33:03.039949 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:33:03.039949 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:33:03.039949 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:03.039949 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:03.039949 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:03.039949 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:03.039949 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:03.041139 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:03.041139 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:03.041139 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:03.041139 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:03.041139 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:03.041139 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:03.041139 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:33:03.041139 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:33:03.041139 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:33:03.041139 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:33:03.041139 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:03.041139 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:03.041139 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:03.041139 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:03.041139 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:03.041139 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:03.042063 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:03.042063 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:03.042063 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:03.042063 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:03.042063 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:03.042063 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:03.042063 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:03.042063 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:03.042063 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:03.042063 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:03.042063 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:33:03.042063 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:33:03.042063 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 22:33:03.042063 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:33:03.045271 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 400/820] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Aug 29 22:33:02 2022] GET /identity/v3/services/network => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:33:03.048369 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee4e05-02b1-4774-bcaa-b6f4bd98c619 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:03.080769 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5ac15d-d073-4001-b7fc-ef1fd87bddd2 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:03.097208 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:03.135550 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27bd9c8-51be-45bb-808b-e284161a2c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:03.136143 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27bd9c8-51be-45bb-808b-e284161a2c7c None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:03.136528 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27bd9c8-51be-45bb-808b-e284161a2c7c None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:03.136897 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27bd9c8-51be-45bb-808b-e284161a2c7c None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:03.137703 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27bd9c8-51be-45bb-808b-e284161a2c7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:03.138095 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27bd9c8-51be-45bb-808b-e284161a2c7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:03.139544 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27bd9c8-51be-45bb-808b-e284161a2c7c None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:03.153551 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 421/821] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:33:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:03.158332 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27bd9c8-51be-45bb-808b-e284161a2c7c None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:03.190714 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee4e05-02b1-4774-bcaa-b6f4bd98c619 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:03.243912 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9ea0d5-a7b2-4af0-80c4-aabfb0426506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:03.244612 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ea0d5-a7b2-4af0-80c4-aabfb0426506 None admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:03.244895 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ea0d5-a7b2-4af0-80c4-aabfb0426506 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:03.245176 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ea0d5-a7b2-4af0-80c4-aabfb0426506 None admin] PATH_INFO: `/v3/projects/ce09f0beb1a342febbb4a8b3c7cf60c2/users/e49a4666712746d098ace9e1cb0bf07c/roles/938d531e06764249874d708978e7a0e9` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:03.265503 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9ea0d5-a7b2-4af0-80c4-aabfb0426506 None admin] RBAC: Authorizing `identity:create_grant(project_id=ce09f0beb1a342febbb4a8b3c7cf60c2, user_id=e49a4666712746d098ace9e1cb0bf07c, role_id=938d531e06764249874d708978e7a0e9)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:03.267753 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9ea0d5-a7b2-4af0-80c4-aabfb0426506 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:03.276280 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27bd9c8-51be-45bb-808b-e284161a2c7c None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:03.290724 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 401/822] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Aug 29 22:33:03 2022] PUT /identity/v3/projects/ce09f0beb1a342febbb4a8b3c7cf60c2/users/e49a4666712746d098ace9e1cb0bf07c/roles/938d531e06764249874d708978e7a0e9 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:33:03.293851 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9ea0d5-a7b2-4af0-80c4-aabfb0426506 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:03.333783 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ab0e20-da81-44ca-a421-be819a74960f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:03.334891 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab0e20-da81-44ca-a421-be819a74960f None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:03.335325 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab0e20-da81-44ca-a421-be819a74960f None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:03.335814 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab0e20-da81-44ca-a421-be819a74960f None admin] PATH_INFO: `/v3/services` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:03.336504 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ab0e20-da81-44ca-a421-be819a74960f None admin] RBAC: Adding query filter params (name=network) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:03.336805 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ab0e20-da81-44ca-a421-be819a74960f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:03.339437 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ab0e20-da81-44ca-a421-be819a74960f None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:03.353983 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 422/823] 10.222.0.47 () {56 vars in 1112 bytes} [Mon Aug 29 22:33:03 2022] GET /identity/v3/services?name=network => generated 124 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:03.359840 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ab0e20-da81-44ca-a421-be819a74960f None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:03.394323 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:03.409068 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:03.497029 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ab0e20-da81-44ca-a421-be819a74960f None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:03.532739 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9ea0d5-a7b2-4af0-80c4-aabfb0426506 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:03.547284 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f5f68-3c1d-49e7-a3fd-e2257ea79e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:03.548305 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f5f68-3c1d-49e7-a3fd-e2257ea79e7f None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:03.548869 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f5f68-3c1d-49e7-a3fd-e2257ea79e7f None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:03.549292 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f5f68-3c1d-49e7-a3fd-e2257ea79e7f None admin] PATH_INFO: `/v3/services` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:03.550350 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879f5f68-3c1d-49e7-a3fd-e2257ea79e7f None admin] RBAC: Adding query filter params (type=network) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:03.550819 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879f5f68-3c1d-49e7-a3fd-e2257ea79e7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:03.552636 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879f5f68-3c1d-49e7-a3fd-e2257ea79e7f None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:03.559251 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 423/824] 10.222.0.47 () {56 vars in 1112 bytes} [Mon Aug 29 22:33:03 2022] GET /identity/v3/services?type=network => generated 350 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:03.564648 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f5f68-3c1d-49e7-a3fd-e2257ea79e7f None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:03.593590 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f11c8-b342-4f64-a89a-e05500f64117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:03.594158 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f11c8-b342-4f64-a89a-e05500f64117 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:03.594441 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f11c8-b342-4f64-a89a-e05500f64117 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:03.594713 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f11c8-b342-4f64-a89a-e05500f64117 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:03.610444 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655f11c8-b342-4f64-a89a-e05500f64117 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:03.611904 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655f11c8-b342-4f64-a89a-e05500f64117 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:03.630869 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-655f11c8-b342-4f64-a89a-e05500f64117 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 22:33:03.630869 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:03.630869 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:03.630869 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:03.630869 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:03.630869 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:03.630869 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:03.630869 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:03.630869 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:03.630869 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:03.630869 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:03.630869 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:03.630869 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:33:03.630869 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:33:03.630869 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:33:03.630869 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:33:03.632762 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:03.632762 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:03.632762 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:33:03.632762 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:33:03.632762 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:33:03.632762 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:33:03.632762 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:03.632762 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:03.632762 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:03.632762 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:03.632762 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:03.632762 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:03.632762 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:03.632762 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:03.632762 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:03.632762 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:03.632762 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:03.632762 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:03.633726 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:03.633726 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:03.633726 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:33:03.633726 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:33:03.633726 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:33:03.633726 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:33:03.633726 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:33:03.633726 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:33:03.633726 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 22:33:03.633726 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:33:03.641774 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 402/825] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Aug 29 22:33:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:33:03.649751 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f11c8-b342-4f64-a89a-e05500f64117 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:03.681827 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f5f68-3c1d-49e7-a3fd-e2257ea79e7f None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:03.689775 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:03.745568 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1cbf5f-86a3-4092-8439-3d3e0cb97676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:03.746186 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1cbf5f-86a3-4092-8439-3d3e0cb97676 None admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:03.746466 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1cbf5f-86a3-4092-8439-3d3e0cb97676 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:03.746738 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1cbf5f-86a3-4092-8439-3d3e0cb97676 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:03.747407 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1cbf5f-86a3-4092-8439-3d3e0cb97676 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:03.748783 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1cbf5f-86a3-4092-8439-3d3e0cb97676 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:03.792600 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 424/826] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:33:03 2022] POST /identity/v3/endpoints => generated 337 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:33:03.964920 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f11c8-b342-4f64-a89a-e05500f64117 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:03.966523 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:04.044412 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25be90c-ced9-4535-a58b-cd9ffd854a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:04.045525 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25be90c-ced9-4535-a58b-cd9ffd854a0f None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:04.045991 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25be90c-ced9-4535-a58b-cd9ffd854a0f None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:04.046314 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25be90c-ced9-4535-a58b-cd9ffd854a0f None admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:04.047259 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25be90c-ced9-4535-a58b-cd9ffd854a0f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:04.047702 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25be90c-ced9-4535-a58b-cd9ffd854a0f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:04.049316 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25be90c-ced9-4535-a58b-cd9ffd854a0f None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:04.076936 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 403/827] 10.222.0.47 () {56 vars in 1135 bytes} [Mon Aug 29 22:33:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 427 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:04.084098 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1cbf5f-86a3-4092-8439-3d3e0cb97676 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:04.206764 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1cbf5f-86a3-4092-8439-3d3e0cb97676 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:04.248021 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb827ca3-3e33-44fe-b2b8-172cfcde225e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:04.248984 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb827ca3-3e33-44fe-b2b8-172cfcde225e None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:04.249530 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb827ca3-3e33-44fe-b2b8-172cfcde225e None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:04.250029 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb827ca3-3e33-44fe-b2b8-172cfcde225e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:04.263217 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb827ca3-3e33-44fe-b2b8-172cfcde225e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:04.264976 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb827ca3-3e33-44fe-b2b8-172cfcde225e None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:04.286041 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-eb827ca3-3e33-44fe-b2b8-172cfcde225e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:33:04.286041 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:04.286041 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:04.286041 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:04.286041 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:04.286041 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:04.286041 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:04.286041 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:04.286041 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:04.286041 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:04.286041 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:04.286041 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:04.286041 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:33:04.286041 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:33:04.286041 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:33:04.286041 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:33:04.287034 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:04.287034 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:04.287034 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:04.287034 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:04.287034 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:04.287034 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:04.287034 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:04.287034 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:04.287034 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:04.287034 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:04.287034 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:04.287034 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:04.287034 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:04.287034 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:04.287034 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:04.287034 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:04.287034 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:33:04.288073 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:33:04.288073 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:33:04.288073 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:33:04.290354 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 425/828] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:33:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:33:04.297376 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25be90c-ced9-4535-a58b-cd9ffd854a0f None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:04.414769 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25be90c-ced9-4535-a58b-cd9ffd854a0f None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:04.418243 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d9990-0150-46e0-90e8-1bd67adc3524 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:04.418754 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d9990-0150-46e0-90e8-1bd67adc3524 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:04.419255 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d9990-0150-46e0-90e8-1bd67adc3524 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:04.421157 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 426/829] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:33:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:33:04.427598 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2f812-924f-4c94-ab16-14e408649846 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:04.428160 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2f812-924f-4c94-ab16-14e408649846 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:04.428667 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2f812-924f-4c94-ab16-14e408649846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:04.441809 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:04.450785 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-97c2f812-924f-4c94-ab16-14e408649846 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:04.452249 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-97c2f812-924f-4c94-ab16-14e408649846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:04.453179 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e1a544-d362-4ce6-b033-f8cc05315098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:04.453831 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e1a544-d362-4ce6-b033-f8cc05315098 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:04.454111 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e1a544-d362-4ce6-b033-f8cc05315098 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:04.454383 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e1a544-d362-4ce6-b033-f8cc05315098 None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:04.455029 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e1a544-d362-4ce6-b033-f8cc05315098 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:04.455327 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e1a544-d362-4ce6-b033-f8cc05315098 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:04.457667 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e1a544-d362-4ce6-b033-f8cc05315098 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:04.479507 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 404/830] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:33:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:04.485267 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e1a544-d362-4ce6-b033-f8cc05315098 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:04.518534 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:04.543827 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 427/831] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:33:04 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:33:04.623028 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e1a544-d362-4ce6-b033-f8cc05315098 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:04.664588 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e2d69-9cea-402d-bc4c-c4718ce59a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:04.665228 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e2d69-9cea-402d-bc4c-c4718ce59a7e None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:04.665533 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e2d69-9cea-402d-bc4c-c4718ce59a7e None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:04.665869 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e2d69-9cea-402d-bc4c-c4718ce59a7e None admin] PATH_INFO: `/v3/projects/service` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:04.673080 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815e2d69-9cea-402d-bc4c-c4718ce59a7e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:04.674566 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815e2d69-9cea-402d-bc4c-c4718ce59a7e None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:04.691043 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-815e2d69-9cea-402d-bc4c-c4718ce59a7e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:33:04.691043 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:04.691043 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:04.691043 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:04.691043 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:04.691043 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:04.691043 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:04.691043 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:04.691043 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:04.691043 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:04.691043 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:04.691043 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:04.691043 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:33:04.691043 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:33:04.691043 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:33:04.692032 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:33:04.692032 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:04.692032 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:04.692032 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:04.692032 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:04.692032 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:04.692032 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:04.692032 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:04.692032 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:04.692032 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:04.692032 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:04.692032 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:04.692032 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:04.692032 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:04.692032 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:04.692032 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:04.692032 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:04.692946 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:33:04.692946 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:33:04.692946 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:33:04.692946 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:33:04.692946 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:33:04.692946 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:33:04.692946 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:33:04.692946 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:33:04.693638 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 405/832] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Aug 29 22:33:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:33:04.701468 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c2f812-924f-4c94-ab16-14e408649846 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:04.812572 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c2f812-924f-4c94-ab16-14e408649846 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:04.847055 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e2d69-9cea-402d-bc4c-c4718ce59a7e None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:04.851304 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a35bf1-714d-4e25-b23a-9b1daf8a53e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:04.852342 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a35bf1-714d-4e25-b23a-9b1daf8a53e9 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:04.852820 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a35bf1-714d-4e25-b23a-9b1daf8a53e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:04.853305 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a35bf1-714d-4e25-b23a-9b1daf8a53e9 None admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:04.854282 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a35bf1-714d-4e25-b23a-9b1daf8a53e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:04.854800 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a35bf1-714d-4e25-b23a-9b1daf8a53e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:04.856476 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a35bf1-714d-4e25-b23a-9b1daf8a53e9 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:04.859862 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:04.872378 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 428/833] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Aug 29 22:33:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:04.878516 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a35bf1-714d-4e25-b23a-9b1daf8a53e9 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:04.939563 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:04.965785 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e2d69-9cea-402d-bc4c-c4718ce59a7e None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:05.000230 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a35bf1-714d-4e25-b23a-9b1daf8a53e9 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:05.003734 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33737ccb-5606-47e6-ab70-e710d1914cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:05.003866 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33737ccb-5606-47e6-ab70-e710d1914cb3 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:05.004146 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33737ccb-5606-47e6-ab70-e710d1914cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:05.004418 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33737ccb-5606-47e6-ab70-e710d1914cb3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:05.004998 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33737ccb-5606-47e6-ab70-e710d1914cb3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:05.006929 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33737ccb-5606-47e6-ab70-e710d1914cb3 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:05.018447 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-33737ccb-5606-47e6-ab70-e710d1914cb3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 22:33:05.018447 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:05.018447 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:33:05.018447 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:33:05.018447 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:33:05.018447 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:33:05.018447 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:33:05.018447 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:33:05.018447 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 22:33:05.018447 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:33:05.018447 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:33:05.018447 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:33:05.018447 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:05.018447 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:05.018447 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:05.018447 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:05.018447 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:05.019453 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:05.019453 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:05.019453 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:05.019453 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:05.019453 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:05.019453 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:05.019453 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:33:05.019453 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:33:05.019453 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:33:05.019453 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:33:05.019453 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:05.019453 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:05.019453 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:05.019453 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:05.019453 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:05.019453 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:05.020282 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:05.020282 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:05.020282 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:05.020282 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:05.020282 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:05.020282 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:05.020282 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:05.020282 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:05.020282 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:05.020282 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:05.020282 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:33:05.020282 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:33:05.020282 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 22:33:05.020282 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:33:05.025602 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 406/834] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Aug 29 22:33:04 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:33:05.026987 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33737ccb-5606-47e6-ab70-e710d1914cb3 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:05.043683 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4033ec-6b07-4fcd-99cc-506f23c3acf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:05.044836 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4033ec-6b07-4fcd-99cc-506f23c3acf7 None admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:05.045385 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4033ec-6b07-4fcd-99cc-506f23c3acf7 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:05.046122 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4033ec-6b07-4fcd-99cc-506f23c3acf7 None admin] PATH_INFO: `/v3/projects/ce09f0beb1a342febbb4a8b3c7cf60c2/users/388d8dea2edf4fb888d42ca878c1434d/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:05.049012 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4033ec-6b07-4fcd-99cc-506f23c3acf7 None admin] RBAC: Authorizing `identity:create_grant(project_id=ce09f0beb1a342febbb4a8b3c7cf60c2, user_id=388d8dea2edf4fb888d42ca878c1434d, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:05.050814 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4033ec-6b07-4fcd-99cc-506f23c3acf7 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:05.068164 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 429/835] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Aug 29 22:33:04 2022] PUT /identity/v3/projects/ce09f0beb1a342febbb4a8b3c7cf60c2/users/388d8dea2edf4fb888d42ca878c1434d/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:33:05.151503 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33737ccb-5606-47e6-ab70-e710d1914cb3 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:05.193287 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338ac4b0-b438-4e12-9a37-7e4919ec95e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:05.194997 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ac4b0-b438-4e12-9a37-7e4919ec95e6 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:05.195510 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ac4b0-b438-4e12-9a37-7e4919ec95e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:05.195979 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ac4b0-b438-4e12-9a37-7e4919ec95e6 None admin] PATH_INFO: `/v3/services` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:05.196823 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338ac4b0-b438-4e12-9a37-7e4919ec95e6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:05.197355 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338ac4b0-b438-4e12-9a37-7e4919ec95e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:05.198951 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338ac4b0-b438-4e12-9a37-7e4919ec95e6 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:05.205018 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 407/836] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Aug 29 22:33:05 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:33:05.211249 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4033ec-6b07-4fcd-99cc-506f23c3acf7 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:05.218510 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7e75d-ed88-437c-b304-dbadf51eccfa None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:05.219046 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7e75d-ed88-437c-b304-dbadf51eccfa None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:05.219629 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7e75d-ed88-437c-b304-dbadf51eccfa None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:05.221420 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 408/837] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:33:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:33:05.227445 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02841f03-3bf3-4244-8a98-a73352ea41a7 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:05.227725 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02841f03-3bf3-4244-8a98-a73352ea41a7 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:05.227994 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02841f03-3bf3-4244-8a98-a73352ea41a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:05.236042 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:05.248890 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-02841f03-3bf3-4244-8a98-a73352ea41a7 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:05.250220 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-02841f03-3bf3-4244-8a98-a73352ea41a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:05.288985 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:05.339865 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4033ec-6b07-4fcd-99cc-506f23c3acf7 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:05.351328 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 409/838] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:33:05 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:33:05.380806 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8fb5f1-768c-4ea4-88a4-86a83f0808fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:05.382257 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8fb5f1-768c-4ea4-88a4-86a83f0808fe None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:05.382611 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8fb5f1-768c-4ea4-88a4-86a83f0808fe None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:05.382986 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8fb5f1-768c-4ea4-88a4-86a83f0808fe None admin] PATH_INFO: `/v3/services` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:05.383725 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8fb5f1-768c-4ea4-88a4-86a83f0808fe None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:05.384178 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8fb5f1-768c-4ea4-88a4-86a83f0808fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:05.385685 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8fb5f1-768c-4ea4-88a4-86a83f0808fe None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:05.391137 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 430/839] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Aug 29 22:33:05 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:05.619591 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02841f03-3bf3-4244-8a98-a73352ea41a7 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:05.728665 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02841f03-3bf3-4244-8a98-a73352ea41a7 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:05.757708 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af7049e-60c5-48ba-b95f-a9d1fb8f8868 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:05.758066 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af7049e-60c5-48ba-b95f-a9d1fb8f8868 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:05.758279 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af7049e-60c5-48ba-b95f-a9d1fb8f8868 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:05.759887 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 431/840] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:33:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:33:05.766439 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe286d3-0d9f-4d61-bb50-45ccd0d032e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:05.766677 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eeffdf-9586-4308-82fa-58f31e991100 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:05.766968 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eeffdf-9586-4308-82fa-58f31e991100 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:05.767238 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eeffdf-9586-4308-82fa-58f31e991100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:05.767738 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe286d3-0d9f-4d61-bb50-45ccd0d032e6 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:05.768172 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe286d3-0d9f-4d61-bb50-45ccd0d032e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:05.768599 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe286d3-0d9f-4d61-bb50-45ccd0d032e6 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:05.769386 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe286d3-0d9f-4d61-bb50-45ccd0d032e6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:05.771045 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe286d3-0d9f-4d61-bb50-45ccd0d032e6 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:05.781711 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-6fe286d3-0d9f-4d61-bb50-45ccd0d032e6 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 22:33:05.781711 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:05.781711 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:33:05.781711 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:33:05.781711 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:33:05.781711 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:33:05.781711 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:33:05.781711 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:33:05.781711 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 22:33:05.781711 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:33:05.781711 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:33:05.781711 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:33:05.781711 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:05.781711 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:05.781711 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:05.781711 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:05.782667 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:05.782667 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:05.782667 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:05.782667 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:05.782667 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:05.782667 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:05.782667 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:05.782667 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:33:05.782667 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:33:05.782667 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:33:05.782667 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:33:05.782667 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:05.782667 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:05.782667 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:05.782667 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:05.782667 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:05.782667 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:05.783526 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:05.783526 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:05.783526 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:05.783526 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:05.783526 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:05.783526 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:05.783526 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:05.783526 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:05.783526 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:05.783526 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:05.783526 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:33:05.783526 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:33:05.783526 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 22:33:05.783526 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:33:05.783526 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:05.783526 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 410/841] 10.222.0.47 () {56 vars in 1132 bytes} [Mon Aug 29 22:33:05 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:33:05.790373 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe286d3-0d9f-4d61-bb50-45ccd0d032e6 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:05.790760 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-66eeffdf-9586-4308-82fa-58f31e991100 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:05.792058 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-66eeffdf-9586-4308-82fa-58f31e991100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:05.885854 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 432/842] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:33:05 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:33:05.907850 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe286d3-0d9f-4d61-bb50-45ccd0d032e6 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:05.945959 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf1c846-a9c9-4143-a286-5417a4d2201f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:05.946813 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf1c846-a9c9-4143-a286-5417a4d2201f None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:05.947336 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf1c846-a9c9-4143-a286-5417a4d2201f None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:05.947753 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf1c846-a9c9-4143-a286-5417a4d2201f None admin] PATH_INFO: `/v3/services` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:05.948583 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf1c846-a9c9-4143-a286-5417a4d2201f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:05.949026 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf1c846-a9c9-4143-a286-5417a4d2201f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:05.950665 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf1c846-a9c9-4143-a286-5417a4d2201f None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:05.960666 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 411/843] 10.222.0.47 () {56 vars in 1126 bytes} [Mon Aug 29 22:33:05 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:05.962370 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eeffdf-9586-4308-82fa-58f31e991100 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:06.014732 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:06.071544 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eeffdf-9586-4308-82fa-58f31e991100 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:06.110299 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bcb9f4-f140-4929-ba95-61114332b5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:06.110908 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bcb9f4-f140-4929-ba95-61114332b5cc None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:06.111182 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bcb9f4-f140-4929-ba95-61114332b5cc None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:06.111450 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bcb9f4-f140-4929-ba95-61114332b5cc None admin] PATH_INFO: `/v3/services` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:06.112140 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bcb9f4-f140-4929-ba95-61114332b5cc None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:06.112442 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bcb9f4-f140-4929-ba95-61114332b5cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:06.113826 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bcb9f4-f140-4929-ba95-61114332b5cc None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:06.119480 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 433/844] 10.222.0.47 () {56 vars in 1126 bytes} [Mon Aug 29 22:33:05 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:06.195891 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf1c846-a9c9-4143-a286-5417a4d2201f None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:06.268504 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:06.315843 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf1c846-a9c9-4143-a286-5417a4d2201f None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:06.352136 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59197f02-f72d-42aa-8c60-19cf4e1ada64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:06.352783 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59197f02-f72d-42aa-8c60-19cf4e1ada64 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:06.353033 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59197f02-f72d-42aa-8c60-19cf4e1ada64 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:06.353308 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59197f02-f72d-42aa-8c60-19cf4e1ada64 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:06.364124 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59197f02-f72d-42aa-8c60-19cf4e1ada64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:33:06.369924 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-59197f02-f72d-42aa-8c60-19cf4e1ada64 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:33:06.369924 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:06.369924 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:06.369924 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:06.369924 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:06.369924 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:06.369924 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:06.369924 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:06.369924 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:06.369924 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:06.369924 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:06.369924 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:06.369924 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:33:06.369924 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:33:06.369924 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:33:06.369924 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:33:06.370924 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:33:06.370924 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:33:06.370924 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:33:06.370924 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:33:06.370924 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:06.370924 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:06.370924 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:06.370924 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:06.370924 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:06.370924 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:06.370924 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:06.370924 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:06.370924 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:06.370924 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:06.370924 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:06.370924 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:06.371755 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:06.371755 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:06.371755 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:06.371755 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:06.371755 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:33:06.371755 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:33:06.371755 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:33:06.371755 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:33:06.371755 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:33:06.371755 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:33:06.371755 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:33:06.371755 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:33:06.371755 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 412/845] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Aug 29 22:33:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:33:06.377095 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bcb9f4-f140-4929-ba95-61114332b5cc None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:06.486834 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bcb9f4-f140-4929-ba95-61114332b5cc None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:06.502410 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:06.524388 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d56b5e-e6dd-43df-815b-b991007e8f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:06.525019 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d56b5e-e6dd-43df-815b-b991007e8f34 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:06.525298 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d56b5e-e6dd-43df-815b-b991007e8f34 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:06.525605 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d56b5e-e6dd-43df-815b-b991007e8f34 None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:06.526292 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d56b5e-e6dd-43df-815b-b991007e8f34 None admin] RBAC: Adding query filter params (name=service) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:06.526592 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d56b5e-e6dd-43df-815b-b991007e8f34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:06.528011 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d56b5e-e6dd-43df-815b-b991007e8f34 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:06.538840 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 434/846] 10.222.0.47 () {56 vars in 1103 bytes} [Mon Aug 29 22:33:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:06.545213 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59197f02-f72d-42aa-8c60-19cf4e1ada64 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:06.653791 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59197f02-f72d-42aa-8c60-19cf4e1ada64 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:06.677281 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:06.689727 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca261a52-3c76-4bfc-998d-6524bc53c39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:06.690809 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca261a52-3c76-4bfc-998d-6524bc53c39c None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:06.691508 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca261a52-3c76-4bfc-998d-6524bc53c39c None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:06.691780 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca261a52-3c76-4bfc-998d-6524bc53c39c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:06.703853 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca261a52-3c76-4bfc-998d-6524bc53c39c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:06.705288 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca261a52-3c76-4bfc-998d-6524bc53c39c None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:06.719808 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-ca261a52-3c76-4bfc-998d-6524bc53c39c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:33:06.719808 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:06.719808 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:06.719808 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:06.719808 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:06.719808 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:06.719808 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:06.719808 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:06.719808 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:06.719808 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:06.719808 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:06.719808 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:06.719808 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:33:06.719808 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:33:06.719808 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:33:06.719808 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:33:06.720770 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:06.720770 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:06.720770 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:06.720770 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:06.720770 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:06.720770 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:06.720770 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:06.720770 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:06.720770 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:06.720770 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:06.720770 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:06.720770 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:06.720770 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:06.720770 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:06.720770 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:06.720770 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:06.720770 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:33:06.722006 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:33:06.722006 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:33:06.722006 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:33:06.725722 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 413/847] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:33:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:33:06.727311 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d56b5e-e6dd-43df-815b-b991007e8f34 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:06.834609 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d56b5e-e6dd-43df-815b-b991007e8f34 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:06.874092 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2ea24a-3e40-48b9-bb32-622fafcbd111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:06.874703 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2ea24a-3e40-48b9-bb32-622fafcbd111 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:06.874983 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2ea24a-3e40-48b9-bb32-622fafcbd111 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:06.875255 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2ea24a-3e40-48b9-bb32-622fafcbd111 None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:06.875900 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2ea24a-3e40-48b9-bb32-622fafcbd111 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:06.876199 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2ea24a-3e40-48b9-bb32-622fafcbd111 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:06.877590 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2ea24a-3e40-48b9-bb32-622fafcbd111 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:06.891321 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 435/848] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:33:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:06.897577 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca261a52-3c76-4bfc-998d-6524bc53c39c None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:07.007528 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca261a52-3c76-4bfc-998d-6524bc53c39c None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:07.044778 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd860580-5383-49a4-b60c-672ed3aa9995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:07.045497 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd860580-5383-49a4-b60c-672ed3aa9995 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:07.045784 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd860580-5383-49a4-b60c-672ed3aa9995 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:07.046058 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd860580-5383-49a4-b60c-672ed3aa9995 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:07.054295 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd860580-5383-49a4-b60c-672ed3aa9995 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:07.055742 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd860580-5383-49a4-b60c-672ed3aa9995 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:07.067771 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-bd860580-5383-49a4-b60c-672ed3aa9995 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 22:33:07.067771 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:07.067771 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:07.067771 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:07.067771 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:07.067771 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:07.067771 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:07.067771 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:07.067771 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:07.067771 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:07.067771 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:07.067771 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:07.067771 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:33:07.067771 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:33:07.067771 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:33:07.067771 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:33:07.068769 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:07.068769 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:07.068769 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:33:07.068769 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:33:07.068769 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:33:07.068769 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:33:07.068769 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:07.068769 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:07.068769 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:07.068769 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:07.068769 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:07.068769 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:07.068769 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:07.068769 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:07.068769 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:07.068769 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:07.068769 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:07.068769 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:07.069735 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:07.069735 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:07.069735 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:33:07.069735 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:33:07.069735 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:33:07.069735 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:33:07.069735 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:33:07.069735 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:33:07.069735 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 22:33:07.069735 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:33:07.069735 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 414/849] 10.222.0.47 () {56 vars in 1117 bytes} [Mon Aug 29 22:33:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:33:07.076594 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2ea24a-3e40-48b9-bb32-622fafcbd111 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:07.108353 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044e055-bf9e-4a2d-a446-da33c21f2e24 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:07.108636 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044e055-bf9e-4a2d-a446-da33c21f2e24 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:07.108823 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044e055-bf9e-4a2d-a446-da33c21f2e24 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:07.110322 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 415/850] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:33:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:33:07.115350 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d6e42-8930-467b-a1fa-99433bd65015 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:07.115749 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d6e42-8930-467b-a1fa-99433bd65015 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:07.116234 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d6e42-8930-467b-a1fa-99433bd65015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:07.122883 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:07.141175 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-fe5d6e42-8930-467b-a1fa-99433bd65015 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:07.142812 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-fe5d6e42-8930-467b-a1fa-99433bd65015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:07.175071 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:07.210176 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2ea24a-3e40-48b9-bb32-622fafcbd111 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:07.233429 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 416/851] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:33:07 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:33:07.252220 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210ef3f-ea98-4ce1-aef2-95d1766673d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:07.252854 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210ef3f-ea98-4ce1-aef2-95d1766673d8 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:07.253132 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210ef3f-ea98-4ce1-aef2-95d1766673d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:07.253432 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210ef3f-ea98-4ce1-aef2-95d1766673d8 None admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:07.254171 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d210ef3f-ea98-4ce1-aef2-95d1766673d8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:07.254473 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d210ef3f-ea98-4ce1-aef2-95d1766673d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:07.256450 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d210ef3f-ea98-4ce1-aef2-95d1766673d8 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:07.275322 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 436/852] 10.222.0.47 () {56 vars in 1149 bytes} [Mon Aug 29 22:33:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:07.282638 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5d6e42-8930-467b-a1fa-99433bd65015 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:07.391885 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5d6e42-8930-467b-a1fa-99433bd65015 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:07.427428 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca91cd7-27fe-484d-b340-2a52e13f49ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:07.428638 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca91cd7-27fe-484d-b340-2a52e13f49ef None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:07.428924 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca91cd7-27fe-484d-b340-2a52e13f49ef None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:07.429197 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca91cd7-27fe-484d-b340-2a52e13f49ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:07.465884 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:07.483613 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1793f-72d4-4db2-9073-63582561ae98 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:07.484110 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1793f-72d4-4db2-9073-63582561ae98 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:07.484184 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1793f-72d4-4db2-9073-63582561ae98 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:07.485730 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 437/853] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:33:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:33:07.490931 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78072e9e-2e7f-4fe1-ab5a-a753978aed94 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:07.491250 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78072e9e-2e7f-4fe1-ab5a-a753978aed94 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:07.491481 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78072e9e-2e7f-4fe1-ab5a-a753978aed94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:07.510523 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-78072e9e-2e7f-4fe1-ab5a-a753978aed94 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:07.511712 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-78072e9e-2e7f-4fe1-ab5a-a753978aed94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:07.511891 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca91cd7-27fe-484d-b340-2a52e13f49ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:07.513233 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca91cd7-27fe-484d-b340-2a52e13f49ef None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:07.587682 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 438/854] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:33:07 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:33:07.588533 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78072e9e-2e7f-4fe1-ab5a-a753978aed94 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:07.614252 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:07.644720 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 417/855] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Aug 29 22:33:07 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 22:33:07.645870 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca91cd7-27fe-484d-b340-2a52e13f49ef None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:07.712922 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78072e9e-2e7f-4fe1-ab5a-a753978aed94 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:07.720601 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:07.757798 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aef6c57-0c25-4f6d-aefe-e72f9ca0cd8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:07.758434 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef6c57-0c25-4f6d-aefe-e72f9ca0cd8b None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:07.758699 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef6c57-0c25-4f6d-aefe-e72f9ca0cd8b None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:07.759280 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef6c57-0c25-4f6d-aefe-e72f9ca0cd8b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:07.768166 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca91cd7-27fe-484d-b340-2a52e13f49ef None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:07.772420 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aef6c57-0c25-4f6d-aefe-e72f9ca0cd8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:33:07.778125 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-6aef6c57-0c25-4f6d-aefe-e72f9ca0cd8b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:33:07.778125 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:07.778125 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:07.778125 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:07.778125 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:07.778125 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:07.778125 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:07.778125 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:07.778125 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:07.778125 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:07.778125 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:07.778125 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:07.778125 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:33:07.778125 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:33:07.778125 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:33:07.778125 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:33:07.779157 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:33:07.779157 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:33:07.779157 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:33:07.779157 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:33:07.779157 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:07.779157 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:07.779157 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:07.779157 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:07.779157 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:07.779157 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:07.779157 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:07.779157 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:07.779157 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:07.779157 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:07.779157 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:07.779157 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:07.780328 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:07.780328 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:07.780328 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:07.780328 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:07.780328 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:33:07.780328 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:33:07.780328 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:33:07.780328 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:33:07.780328 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:33:07.780328 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:33:07.780328 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:33:07.780328 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:33:07.784843 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 439/856] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Aug 29 22:33:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:33:07.785713 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aef6c57-0c25-4f6d-aefe-e72f9ca0cd8b None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:07.812953 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1f126e-d4f7-4a5f-9967-2fed762f07dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:07.814048 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f126e-d4f7-4a5f-9967-2fed762f07dc None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:07.814550 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f126e-d4f7-4a5f-9967-2fed762f07dc None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:07.815078 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f126e-d4f7-4a5f-9967-2fed762f07dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:07.827114 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1f126e-d4f7-4a5f-9967-2fed762f07dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:07.828911 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1f126e-d4f7-4a5f-9967-2fed762f07dc None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:07.846483 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-5c1f126e-d4f7-4a5f-9967-2fed762f07dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:33:07.846483 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:07.846483 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:07.846483 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:07.846483 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:07.846483 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:07.846483 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:07.846483 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:07.846483 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:07.846483 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:07.846483 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:07.846483 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:07.846483 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:33:07.846483 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:33:07.846483 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:33:07.846483 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:33:07.847532 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:07.847532 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:07.847532 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:07.847532 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:07.847532 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:07.847532 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:07.847532 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:07.847532 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:07.847532 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:07.847532 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:07.847532 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:07.847532 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:07.847532 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:07.847532 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:07.847532 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:07.847532 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:07.847532 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:33:07.848429 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:33:07.848429 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:33:07.848429 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:33:07.855699 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 418/857] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:33:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:33:07.856884 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1f126e-d4f7-4a5f-9967-2fed762f07dc None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:07.888218 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:07.908039 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aef6c57-0c25-4f6d-aefe-e72f9ca0cd8b None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:07.947688 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db52d473-d3d5-4921-bb3b-6ef4593faebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:07.948307 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52d473-d3d5-4921-bb3b-6ef4593faebe None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:07.948635 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52d473-d3d5-4921-bb3b-6ef4593faebe None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:07.948856 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52d473-d3d5-4921-bb3b-6ef4593faebe None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:07.949690 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db52d473-d3d5-4921-bb3b-6ef4593faebe None admin] RBAC: Adding query filter params (name=admin) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:07.949885 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db52d473-d3d5-4921-bb3b-6ef4593faebe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:07.951230 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db52d473-d3d5-4921-bb3b-6ef4593faebe None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:07.961380 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 440/858] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Aug 29 22:33:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:07.961785 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db52d473-d3d5-4921-bb3b-6ef4593faebe None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:07.974962 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1f126e-d4f7-4a5f-9967-2fed762f07dc None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:07.992072 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:08.012880 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5302c499-4f81-4668-8196-d22474bfcca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:08.013524 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302c499-4f81-4668-8196-d22474bfcca3 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:08.013806 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302c499-4f81-4668-8196-d22474bfcca3 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:08.014079 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302c499-4f81-4668-8196-d22474bfcca3 None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:08.014724 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5302c499-4f81-4668-8196-d22474bfcca3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:08.015026 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5302c499-4f81-4668-8196-d22474bfcca3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:08.016408 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5302c499-4f81-4668-8196-d22474bfcca3 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:08.034678 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 419/859] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:33:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:08.034678 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5302c499-4f81-4668-8196-d22474bfcca3 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:08.080606 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db52d473-d3d5-4921-bb3b-6ef4593faebe None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:08.124597 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468c7837-ef1c-488d-aafe-49c6b4f33dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:08.125201 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c7837-ef1c-488d-aafe-49c6b4f33dc1 None admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:08.125508 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c7837-ef1c-488d-aafe-49c6b4f33dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:08.125778 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c7837-ef1c-488d-aafe-49c6b4f33dc1 None admin] PATH_INFO: `/v3/services` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:08.126976 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468c7837-ef1c-488d-aafe-49c6b4f33dc1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:08.128664 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468c7837-ef1c-488d-aafe-49c6b4f33dc1 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:08.141160 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5302c499-4f81-4668-8196-d22474bfcca3 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:08.147660 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 441/860] 10.222.0.47 () {60 vars in 1141 bytes} [Mon Aug 29 22:33:07 2022] POST /identity/v3/services => generated 251 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:33:08.148876 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468c7837-ef1c-488d-aafe-49c6b4f33dc1 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:08.167519 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:08.199304 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510cc19b-0757-40c8-aed6-754d6554b19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:08.200001 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510cc19b-0757-40c8-aed6-754d6554b19a None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:08.200290 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510cc19b-0757-40c8-aed6-754d6554b19a None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:08.200573 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510cc19b-0757-40c8-aed6-754d6554b19a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:08.214382 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510cc19b-0757-40c8-aed6-754d6554b19a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:08.216402 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510cc19b-0757-40c8-aed6-754d6554b19a None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:08.233909 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-510cc19b-0757-40c8-aed6-754d6554b19a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:33:08.233909 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:08.233909 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:08.233909 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:08.233909 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:08.233909 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:08.233909 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:08.233909 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:08.233909 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:08.233909 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:08.233909 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:08.233909 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:08.233909 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:33:08.233909 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:33:08.233909 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:33:08.233909 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:33:08.234934 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:08.234934 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:08.234934 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:08.234934 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:08.234934 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:08.234934 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:08.234934 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:08.234934 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:08.234934 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:08.234934 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:08.234934 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:08.234934 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:08.234934 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:08.234934 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:08.234934 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:08.234934 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:08.234934 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:33:08.235820 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:33:08.235820 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:33:08.235820 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:33:08.235820 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 420/861] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:33:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:33:08.236941 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ad8eb-24b5-478e-842f-6f3c3ff8dd59 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:08.236941 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ad8eb-24b5-478e-842f-6f3c3ff8dd59 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:08.236941 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ad8eb-24b5-478e-842f-6f3c3ff8dd59 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:08.243202 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 421/862] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:33:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:33:08.243202 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ad8eb-24b5-478e-842f-6f3c3ff8dd59 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:08.274796 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:08.298411 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468c7837-ef1c-488d-aafe-49c6b4f33dc1 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:08.346295 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b75240-abb1-4bfd-8ac8-72ceb7744e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:08.346959 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b75240-abb1-4bfd-8ac8-72ceb7744e67 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:08.347237 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b75240-abb1-4bfd-8ac8-72ceb7744e67 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:08.347509 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b75240-abb1-4bfd-8ac8-72ceb7744e67 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:08.355138 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b75240-abb1-4bfd-8ac8-72ceb7744e67 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:08.356593 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b75240-abb1-4bfd-8ac8-72ceb7744e67 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:08.368100 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-99b75240-abb1-4bfd-8ac8-72ceb7744e67 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:33:08.368100 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:08.368100 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:08.368100 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:08.368100 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:08.368100 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:08.368100 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:08.368100 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:08.368100 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:08.368100 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:08.368100 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:08.368100 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:08.368100 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:33:08.368100 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:33:08.368100 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:33:08.369043 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:33:08.369043 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:08.369043 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:08.369043 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:08.369043 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:08.369043 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:08.369043 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:08.369043 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:08.369043 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:08.369043 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:08.369043 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:08.369043 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:08.369043 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:08.369043 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:08.369043 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:08.369043 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:08.369043 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:08.369971 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:33:08.369971 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:33:08.369971 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:33:08.369971 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:33:08.369971 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:33:08.369971 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:33:08.369971 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:33:08.369971 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:33:08.369971 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 442/863] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Aug 29 22:33:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:33:08.370835 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c1885-fe40-4e35-873d-e5775e701917 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:08.370835 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c1885-fe40-4e35-873d-e5775e701917 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:08.371050 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c1885-fe40-4e35-873d-e5775e701917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:08.382020 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ad8eb-24b5-478e-842f-6f3c3ff8dd59 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:08.389655 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-1c0c1885-fe40-4e35-873d-e5775e701917 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:08.390861 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-1c0c1885-fe40-4e35-873d-e5775e701917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:08.421123 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05847b82-6502-4c6b-9f17-29d61f2e77f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:08.422339 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05847b82-6502-4c6b-9f17-29d61f2e77f3 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:08.422625 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05847b82-6502-4c6b-9f17-29d61f2e77f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:08.422894 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05847b82-6502-4c6b-9f17-29d61f2e77f3 None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:08.423529 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05847b82-6502-4c6b-9f17-29d61f2e77f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:08.424118 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05847b82-6502-4c6b-9f17-29d61f2e77f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:08.425214 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05847b82-6502-4c6b-9f17-29d61f2e77f3 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:08.437721 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 422/864] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:33:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:08.438537 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05847b82-6502-4c6b-9f17-29d61f2e77f3 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:08.461227 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:08.469671 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 443/865] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:33:08 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:33:08.470402 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0c1885-fe40-4e35-873d-e5775e701917 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:08.553832 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:08.580637 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05847b82-6502-4c6b-9f17-29d61f2e77f3 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:08.601316 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0c1885-fe40-4e35-873d-e5775e701917 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:08.640407 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f48bee-7b7f-4013-860a-cdcc31185cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:08.640407 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f48bee-7b7f-4013-860a-cdcc31185cb1 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:08.640407 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f48bee-7b7f-4013-860a-cdcc31185cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:08.640407 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f48bee-7b7f-4013-860a-cdcc31185cb1 None admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:08.640889 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f48bee-7b7f-4013-860a-cdcc31185cb1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:08.640889 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f48bee-7b7f-4013-860a-cdcc31185cb1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:08.640889 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f48bee-7b7f-4013-860a-cdcc31185cb1 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:08.644442 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a60f1c-b072-405b-861c-0b3ee30fe866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:08.645171 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a60f1c-b072-405b-861c-0b3ee30fe866 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:08.645581 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a60f1c-b072-405b-861c-0b3ee30fe866 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:08.645945 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a60f1c-b072-405b-861c-0b3ee30fe866 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:08.653473 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 423/866] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Aug 29 22:33:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:08.655300 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a60f1c-b072-405b-861c-0b3ee30fe866 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:08.656846 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a60f1c-b072-405b-861c-0b3ee30fe866 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:08.659929 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f48bee-7b7f-4013-860a-cdcc31185cb1 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:08.671702 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-49a60f1c-b072-405b-861c-0b3ee30fe866 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 22:33:08.671702 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:08.671702 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:08.671702 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:08.671702 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:08.671702 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:08.671702 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:08.671702 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:08.671702 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:08.671702 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:08.671702 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:08.671702 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:08.671702 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:33:08.671702 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:33:08.671702 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:33:08.671702 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:33:08.672684 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:08.672684 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:08.672684 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:33:08.672684 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:33:08.672684 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:33:08.672684 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:33:08.672684 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:08.672684 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:08.672684 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:08.672684 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:08.672684 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:08.672684 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:08.672684 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:08.672684 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:08.672684 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:08.672684 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:08.672684 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:08.672684 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:08.673658 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:08.673658 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:08.673658 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:33:08.673658 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:33:08.673658 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:33:08.673658 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:33:08.673658 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:33:08.673658 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:33:08.673658 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 22:33:08.673658 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:33:08.680896 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 444/867] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Aug 29 22:33:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:33:08.682065 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a60f1c-b072-405b-861c-0b3ee30fe866 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:08.742248 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:08.771314 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f48bee-7b7f-4013-860a-cdcc31185cb1 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:08.795997 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a60f1c-b072-405b-861c-0b3ee30fe866 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:08.807354 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae621d-d504-456e-8137-9d67cf178b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:08.807951 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae621d-d504-456e-8137-9d67cf178b56 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:08.808228 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae621d-d504-456e-8137-9d67cf178b56 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:08.808504 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae621d-d504-456e-8137-9d67cf178b56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:08.809216 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ae621d-d504-456e-8137-9d67cf178b56 None admin] RBAC: Adding query filter params (role.id=938d531e06764249874d708978e7a0e9, scope.project.id=ce09f0beb1a342febbb4a8b3c7cf60c2, user.id=e49a4666712746d098ace9e1cb0bf07c) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:08.809556 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ae621d-d504-456e-8137-9d67cf178b56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:08.810983 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ae621d-d504-456e-8137-9d67cf178b56 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:08.825364 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 424/868] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Aug 29 22:33:08 2022] GET /identity/v3/role_assignments?user.id=e49a4666712746d098ace9e1cb0bf07c&scope.project.id=ce09f0beb1a342febbb4a8b3c7cf60c2&role.id=938d531e06764249874d708978e7a0e9 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:33:08.825364 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae621d-d504-456e-8137-9d67cf178b56 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:08.839177 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:08.847585 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8182a981-24cc-4c01-91f7-3b2b46902d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:08.848256 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8182a981-24cc-4c01-91f7-3b2b46902d5a None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:08.848543 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8182a981-24cc-4c01-91f7-3b2b46902d5a None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:08.848829 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8182a981-24cc-4c01-91f7-3b2b46902d5a None admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:08.849872 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8182a981-24cc-4c01-91f7-3b2b46902d5a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:08.850250 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8182a981-24cc-4c01-91f7-3b2b46902d5a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:08.851858 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8182a981-24cc-4c01-91f7-3b2b46902d5a None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:08.873389 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 445/869] 10.222.0.47 () {56 vars in 1135 bytes} [Mon Aug 29 22:33:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:08.879714 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8182a981-24cc-4c01-91f7-3b2b46902d5a None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:08.963508 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae621d-d504-456e-8137-9d67cf178b56 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:09.004573 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c49f7e-3536-4c70-a273-ec8d4298b330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:09.005183 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c49f7e-3536-4c70-a273-ec8d4298b330 None admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:09.005493 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c49f7e-3536-4c70-a273-ec8d4298b330 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:09.005766 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c49f7e-3536-4c70-a273-ec8d4298b330 None admin] PATH_INFO: `/v3/services` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:09.007465 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c49f7e-3536-4c70-a273-ec8d4298b330 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:09.009091 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c49f7e-3536-4c70-a273-ec8d4298b330 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:09.017898 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8182a981-24cc-4c01-91f7-3b2b46902d5a None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:09.034145 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:09.034323 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 425/870] 10.222.0.47 () {60 vars in 1141 bytes} [Mon Aug 29 22:33:08 2022] POST /identity/v3/services => generated 269 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:33:09.081973 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5552ec-3e0b-405b-8461-d3393dad6b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:09.082933 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5552ec-3e0b-405b-8461-d3393dad6b61 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:09.083213 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5552ec-3e0b-405b-8461-d3393dad6b61 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:09.083488 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5552ec-3e0b-405b-8461-d3393dad6b61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:09.166473 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5552ec-3e0b-405b-8461-d3393dad6b61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:09.168047 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5552ec-3e0b-405b-8461-d3393dad6b61 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:09.291749 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 446/871] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Aug 29 22:33:08 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 22:33:09.297108 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c49f7e-3536-4c70-a273-ec8d4298b330 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:09.371818 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:09.410121 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c49f7e-3536-4c70-a273-ec8d4298b330 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:09.445879 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930d426a-07d9-4cf8-91df-ffaf32fd4553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:09.447347 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d426a-07d9-4cf8-91df-ffaf32fd4553 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:09.447826 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d426a-07d9-4cf8-91df-ffaf32fd4553 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:09.448295 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d426a-07d9-4cf8-91df-ffaf32fd4553 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:09.460162 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930d426a-07d9-4cf8-91df-ffaf32fd4553 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:09.462081 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930d426a-07d9-4cf8-91df-ffaf32fd4553 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:09.477169 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-930d426a-07d9-4cf8-91df-ffaf32fd4553 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:33:09.477169 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:09.477169 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:09.477169 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:09.477169 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:09.477169 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:09.477169 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:09.477169 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:09.477169 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:09.477169 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:09.477169 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:09.477169 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:09.477169 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:33:09.477169 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:33:09.477169 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:33:09.477169 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:33:09.478161 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:09.478161 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:09.478161 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:09.478161 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:09.478161 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:09.478161 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:09.478161 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:09.478161 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:09.478161 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:09.478161 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:09.478161 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:09.478161 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:09.478161 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:09.478161 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:09.478161 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:09.478161 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:09.478161 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:33:09.479033 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:33:09.479033 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:33:09.479033 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:33:09.481103 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 426/872] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:33:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:33:09.486920 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5552ec-3e0b-405b-8461-d3393dad6b61 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:09.499838 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:09.597916 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5552ec-3e0b-405b-8461-d3393dad6b61 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:09.637583 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf1725-8759-4ee0-929d-8a6424fba89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:09.638990 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf1725-8759-4ee0-929d-8a6424fba89d None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:09.639481 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf1725-8759-4ee0-929d-8a6424fba89d None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:09.639965 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf1725-8759-4ee0-929d-8a6424fba89d None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:09.640813 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edf1725-8759-4ee0-929d-8a6424fba89d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:09.641315 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edf1725-8759-4ee0-929d-8a6424fba89d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:09.642884 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edf1725-8759-4ee0-929d-8a6424fba89d None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:09.656568 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 447/873] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:33:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:09.663159 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930d426a-07d9-4cf8-91df-ffaf32fd4553 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:09.767169 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930d426a-07d9-4cf8-91df-ffaf32fd4553 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:09.791804 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:09.806409 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2835fb8b-e016-4b40-9d22-9febcca0677f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:09.807046 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2835fb8b-e016-4b40-9d22-9febcca0677f None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:09.807324 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2835fb8b-e016-4b40-9d22-9febcca0677f None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:09.807596 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2835fb8b-e016-4b40-9d22-9febcca0677f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:09.814575 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2835fb8b-e016-4b40-9d22-9febcca0677f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:09.816005 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2835fb8b-e016-4b40-9d22-9febcca0677f None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:09.828500 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-2835fb8b-e016-4b40-9d22-9febcca0677f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:33:09.828500 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:09.828500 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:09.828500 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:09.828500 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:09.828500 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:09.828500 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:09.828500 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:09.828500 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:09.828500 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:09.828500 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:09.828500 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:09.828500 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:33:09.828500 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:33:09.828500 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:33:09.829465 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:33:09.829465 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:09.829465 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:09.829465 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:09.829465 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:09.829465 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:09.829465 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:09.829465 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:09.829465 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:09.829465 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:09.829465 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:09.829465 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:09.829465 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:09.829465 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:09.829465 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:09.829465 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:09.829465 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:09.830897 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:33:09.830897 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:33:09.830897 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:33:09.830897 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:33:09.830897 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:33:09.830897 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:33:09.830897 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:33:09.830897 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:33:09.830897 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 427/874] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Aug 29 22:33:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:33:09.836081 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf1725-8759-4ee0-929d-8a6424fba89d None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:09.908616 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:09.942786 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf1725-8759-4ee0-929d-8a6424fba89d None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:09.978860 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47098f72-81e4-4052-8620-13311f417252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:09.979881 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47098f72-81e4-4052-8620-13311f417252 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:09.980362 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47098f72-81e4-4052-8620-13311f417252 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:09.980851 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47098f72-81e4-4052-8620-13311f417252 None admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:09.981783 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47098f72-81e4-4052-8620-13311f417252 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:09.982302 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47098f72-81e4-4052-8620-13311f417252 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:09.983936 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47098f72-81e4-4052-8620-13311f417252 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:09.997265 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 448/875] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Aug 29 22:33:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:10.002983 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2835fb8b-e016-4b40-9d22-9febcca0677f None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:10.111921 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2835fb8b-e016-4b40-9d22-9febcca0677f None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:10.147988 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed49e10f-5c66-4fa0-b7a0-6cb42b951cb9 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:10.148326 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed49e10f-5c66-4fa0-b7a0-6cb42b951cb9 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:10.148428 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c13ae7-3d8e-4e4b-860b-bd1a37c51d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:10.148545 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed49e10f-5c66-4fa0-b7a0-6cb42b951cb9 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:10.148986 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c13ae7-3d8e-4e4b-860b-bd1a37c51d11 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:10.149264 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c13ae7-3d8e-4e4b-860b-bd1a37c51d11 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:10.149567 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c13ae7-3d8e-4e4b-860b-bd1a37c51d11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:10.150194 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 449/876] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:33:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:33:10.150313 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c13ae7-3d8e-4e4b-860b-bd1a37c51d11 None admin] RBAC: Adding query filter params (role.id=d00eabaec96a4956aaec2c37a5819c25, scope.project.id=ce09f0beb1a342febbb4a8b3c7cf60c2, user.id=388d8dea2edf4fb888d42ca878c1434d) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:10.150601 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c13ae7-3d8e-4e4b-860b-bd1a37c51d11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:10.152273 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c13ae7-3d8e-4e4b-860b-bd1a37c51d11 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:10.155699 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420009f5-e8a6-4672-9df3-5b47657094dc None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:10.155983 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420009f5-e8a6-4672-9df3-5b47657094dc None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:10.156255 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420009f5-e8a6-4672-9df3-5b47657094dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:10.159789 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 428/877] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Aug 29 22:33:10 2022] GET /identity/v3/role_assignments?user.id=388d8dea2edf4fb888d42ca878c1434d&scope.project.id=ce09f0beb1a342febbb4a8b3c7cf60c2&role.id=d00eabaec96a4956aaec2c37a5819c25 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:10.177633 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-420009f5-e8a6-4672-9df3-5b47657094dc None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:10.179319 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-420009f5-e8a6-4672-9df3-5b47657094dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:10.260378 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 450/878] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:33:10 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:33:10.535327 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c13ae7-3d8e-4e4b-860b-bd1a37c51d11 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:10.585592 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:10.645041 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c13ae7-3d8e-4e4b-860b-bd1a37c51d11 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:10.682299 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce28f17-3747-41f1-b3d6-9fb35e4e9f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:10.683007 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce28f17-3747-41f1-b3d6-9fb35e4e9f14 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:10.683294 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce28f17-3747-41f1-b3d6-9fb35e4e9f14 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:10.683572 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce28f17-3747-41f1-b3d6-9fb35e4e9f14 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:10.684169 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce28f17-3747-41f1-b3d6-9fb35e4e9f14 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:10.685597 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce28f17-3747-41f1-b3d6-9fb35e4e9f14 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:10.695793 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-8ce28f17-3747-41f1-b3d6-9fb35e4e9f14 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 22:33:10.695793 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:10.695793 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:33:10.695793 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:33:10.695793 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:33:10.695793 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:33:10.695793 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:33:10.695793 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:33:10.695793 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 22:33:10.695793 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:33:10.695793 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:33:10.695793 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:33:10.695793 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:10.695793 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:10.695793 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:10.695793 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:10.695793 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:10.696863 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:10.696863 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:10.696863 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:10.696863 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:10.696863 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:10.696863 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:10.696863 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:33:10.696863 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:33:10.696863 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:33:10.696863 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:33:10.696863 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:10.696863 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:10.696863 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:10.696863 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:10.696863 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:10.696863 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:10.698376 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:10.698376 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:10.698376 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:10.698376 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:10.698376 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:10.698376 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:10.698376 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:10.698376 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:10.698376 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:10.698376 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:10.698376 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:33:10.698376 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:33:10.698376 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 22:33:10.698376 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:33:10.698376 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 429/879] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Aug 29 22:33:10 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:33:10.703140 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420009f5-e8a6-4672-9df3-5b47657094dc None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:10.768346 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:10.813240 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420009f5-e8a6-4672-9df3-5b47657094dc None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:10.851186 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4da4b0-0f2e-4c76-9651-db257bd6cdb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:10.852177 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4da4b0-0f2e-4c76-9651-db257bd6cdb4 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:10.852657 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4da4b0-0f2e-4c76-9651-db257bd6cdb4 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:10.853135 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4da4b0-0f2e-4c76-9651-db257bd6cdb4 None admin] PATH_INFO: `/v3/services` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:10.854032 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4da4b0-0f2e-4c76-9651-db257bd6cdb4 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:10.854539 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4da4b0-0f2e-4c76-9651-db257bd6cdb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:10.856115 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4da4b0-0f2e-4c76-9651-db257bd6cdb4 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:10.861929 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 451/880] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Aug 29 22:33:10 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:10.867588 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce28f17-3747-41f1-b3d6-9fb35e4e9f14 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:10.978342 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce28f17-3747-41f1-b3d6-9fb35e4e9f14 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:10.988301 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:11.018785 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64618b59-e3ba-4593-b459-f855b65727bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:11.018982 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f28ec5-f9f0-44b3-937c-5ab2eb360266 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:11.019235 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f28ec5-f9f0-44b3-937c-5ab2eb360266 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:11.019430 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64618b59-e3ba-4593-b459-f855b65727bc None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:11.019534 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f28ec5-f9f0-44b3-937c-5ab2eb360266 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:11.019685 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64618b59-e3ba-4593-b459-f855b65727bc None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:11.019921 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64618b59-e3ba-4593-b459-f855b65727bc None admin] PATH_INFO: `/v3/services` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:11.020550 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64618b59-e3ba-4593-b459-f855b65727bc None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:11.020918 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 452/881] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:33:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:33:11.021027 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64618b59-e3ba-4593-b459-f855b65727bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:11.022998 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64618b59-e3ba-4593-b459-f855b65727bc None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:11.027584 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ca1b0-5a16-4e0e-a251-9f6163e851e8 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:11.028133 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ca1b0-5a16-4e0e-a251-9f6163e851e8 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:11.028591 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 430/882] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Aug 29 22:33:10 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:11.028839 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ca1b0-5a16-4e0e-a251-9f6163e851e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:11.035070 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64618b59-e3ba-4593-b459-f855b65727bc None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:11.057371 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-a61ca1b0-5a16-4e0e-a251-9f6163e851e8 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:11.059332 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-a61ca1b0-5a16-4e0e-a251-9f6163e851e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:11.152273 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64618b59-e3ba-4593-b459-f855b65727bc None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:11.157510 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 453/883] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:33:11 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:33:11.195628 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd4e83e-f54f-46ad-a808-e8f7d246c93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:11.196303 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4e83e-f54f-46ad-a808-e8f7d246c93c None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:11.196584 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4e83e-f54f-46ad-a808-e8f7d246c93c None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:11.196862 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4e83e-f54f-46ad-a808-e8f7d246c93c None admin] PATH_INFO: `/v3/endpoints` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:11.197600 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd4e83e-f54f-46ad-a808-e8f7d246c93c None admin] RBAC: Adding query filter params (interface=public, service_id=a84478dc6af748b181fe49ca5aeb590f, region_id=RegionOne) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:11.197908 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd4e83e-f54f-46ad-a808-e8f7d246c93c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:11.199270 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd4e83e-f54f-46ad-a808-e8f7d246c93c None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:11.205248 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 431/884] 10.222.0.47 () {56 vars in 1251 bytes} [Mon Aug 29 22:33:11 2022] GET /identity/v3/endpoints?service_id=a84478dc6af748b181fe49ca5aeb590f&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:33:11.211572 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ca1b0-5a16-4e0e-a251-9f6163e851e8 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:11.233789 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31194d-d9d0-4bc6-b5fa-65fbadf3a785 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:11.234077 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31194d-d9d0-4bc6-b5fa-65fbadf3a785 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:11.234347 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31194d-d9d0-4bc6-b5fa-65fbadf3a785 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:11.235816 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 432/885] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:33:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:33:11.242210 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e5f5f-8fe4-40c0-a13f-6d026b853b32 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:11.242495 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e5f5f-8fe4-40c0-a13f-6d026b853b32 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:11.242806 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e5f5f-8fe4-40c0-a13f-6d026b853b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:11.262688 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-c09e5f5f-8fe4-40c0-a13f-6d026b853b32 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:11.263907 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-c09e5f5f-8fe4-40c0-a13f-6d026b853b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:11.277930 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:11.300459 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:11.337501 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ca1b0-5a16-4e0e-a251-9f6163e851e8 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:11.354632 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 433/886] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:33:11 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:33:11.381601 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c0e7c-5312-4e20-8058-4ff11ea88ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:11.382359 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c0e7c-5312-4e20-8058-4ff11ea88ef7 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:11.382644 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c0e7c-5312-4e20-8058-4ff11ea88ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:11.382919 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c0e7c-5312-4e20-8058-4ff11ea88ef7 None admin] PATH_INFO: `/v3/services` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:11.383534 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79c0e7c-5312-4e20-8058-4ff11ea88ef7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:11.384989 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79c0e7c-5312-4e20-8058-4ff11ea88ef7 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:11.391280 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 454/887] 10.222.0.47 () {56 vars in 1087 bytes} [Mon Aug 29 22:33:11 2022] GET /identity/v3/services => generated 1268 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:33:11.455533 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09e5f5f-8fe4-40c0-a13f-6d026b853b32 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:11.566885 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09e5f5f-8fe4-40c0-a13f-6d026b853b32 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:11.605392 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3762764-8f42-411d-b2db-4696040f1bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:11.606012 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3762764-8f42-411d-b2db-4696040f1bc4 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:11.606289 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3762764-8f42-411d-b2db-4696040f1bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:11.606561 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3762764-8f42-411d-b2db-4696040f1bc4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:11.618385 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3762764-8f42-411d-b2db-4696040f1bc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:33:11.623191 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-d3762764-8f42-411d-b2db-4696040f1bc4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 22:33:11.623191 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:11.623191 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:11.623191 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:11.623191 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:11.623191 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:11.623191 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:11.623191 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:11.623191 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:11.623191 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:11.623191 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:11.623191 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:11.623191 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:33:11.623191 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:33:11.623191 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:33:11.623191 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:33:11.624132 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:33:11.624132 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:33:11.624132 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:33:11.624132 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:33:11.624132 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:11.624132 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:11.624132 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:11.624132 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:11.624132 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:11.624132 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:11.624132 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:11.624132 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:11.624132 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:11.624132 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:11.624132 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:11.624132 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:11.624965 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:11.624965 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:11.624965 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:11.624965 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:11.624965 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:33:11.624965 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:33:11.624965 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:33:11.624965 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:33:11.624965 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:33:11.624965 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:33:11.624965 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 22:33:11.624965 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:33:11.624965 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 434/888] 10.222.0.47 () {56 vars in 1120 bytes} [Mon Aug 29 22:33:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:33:11.630444 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c0e7c-5312-4e20-8058-4ff11ea88ef7 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:11.665251 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3762764-8f42-411d-b2db-4696040f1bc4 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:11.698769 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:11.762084 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c0e7c-5312-4e20-8058-4ff11ea88ef7 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:11.784344 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3762764-8f42-411d-b2db-4696040f1bc4 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:11.786860 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:11.807485 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdacef2-3c85-4510-b2b3-eb96a2af7e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:11.808227 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdacef2-3c85-4510-b2b3-eb96a2af7e86 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:11.808607 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdacef2-3c85-4510-b2b3-eb96a2af7e86 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:11.809126 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdacef2-3c85-4510-b2b3-eb96a2af7e86 None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:11.809870 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdacef2-3c85-4510-b2b3-eb96a2af7e86 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:11.810269 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdacef2-3c85-4510-b2b3-eb96a2af7e86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:11.811787 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdacef2-3c85-4510-b2b3-eb96a2af7e86 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:11.822300 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 455/889] 10.222.0.47 () {56 vars in 1115 bytes} [Mon Aug 29 22:33:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:11.827295 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdacef2-3c85-4510-b2b3-eb96a2af7e86 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:11.833307 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac18954-0294-4ad3-ac9c-45fd7f7b2b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:11.834614 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac18954-0294-4ad3-ac9c-45fd7f7b2b8d None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:11.834950 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac18954-0294-4ad3-ac9c-45fd7f7b2b8d None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:11.835298 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac18954-0294-4ad3-ac9c-45fd7f7b2b8d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:11.835954 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac18954-0294-4ad3-ac9c-45fd7f7b2b8d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:11.837547 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac18954-0294-4ad3-ac9c-45fd7f7b2b8d None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:11.852644 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-4ac18954-0294-4ad3-ac9c-45fd7f7b2b8d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 22:33:11.852644 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:11.852644 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:33:11.852644 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:33:11.852644 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:33:11.852644 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:33:11.852644 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:33:11.852644 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:33:11.852644 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 22:33:11.852644 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:33:11.852644 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:33:11.852644 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:33:11.852644 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:11.852644 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:11.852644 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:11.852644 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:11.853930 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:11.853930 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:11.853930 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:11.853930 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:11.853930 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:11.853930 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:11.853930 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:11.853930 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:33:11.853930 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:33:11.853930 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:33:11.853930 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:33:11.853930 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:11.853930 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:11.853930 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:11.853930 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:11.853930 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:11.853930 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:11.854839 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:11.854839 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:11.854839 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:11.854839 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:11.854839 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:11.854839 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:11.854839 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:11.854839 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:11.854839 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:11.854839 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:11.854839 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:33:11.854839 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:33:11.854839 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 22:33:11.854839 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:33:11.855575 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 435/890] 10.222.0.47 () {56 vars in 1132 bytes} [Mon Aug 29 22:33:11 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:33:11.869354 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac18954-0294-4ad3-ac9c-45fd7f7b2b8d None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:11.971705 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:11.976163 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdacef2-3c85-4510-b2b3-eb96a2af7e86 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:11.987009 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac18954-0294-4ad3-ac9c-45fd7f7b2b8d None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:12.020858 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce617b-26fe-4f89-985a-eacfadafd9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:12.021570 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce617b-26fe-4f89-985a-eacfadafd9d7 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:12.021954 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce617b-26fe-4f89-985a-eacfadafd9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:12.022291 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce617b-26fe-4f89-985a-eacfadafd9d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:12.028815 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57536ac0-838f-42a9-ba5d-25fdb82baf8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:12.029530 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57536ac0-838f-42a9-ba5d-25fdb82baf8d None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:12.029883 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57536ac0-838f-42a9-ba5d-25fdb82baf8d None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:12.030473 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57536ac0-838f-42a9-ba5d-25fdb82baf8d None admin] PATH_INFO: `/v3/services` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:12.031181 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57536ac0-838f-42a9-ba5d-25fdb82baf8d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:12.031629 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57536ac0-838f-42a9-ba5d-25fdb82baf8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:12.033276 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57536ac0-838f-42a9-ba5d-25fdb82baf8d None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:12.035867 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce617b-26fe-4f89-985a-eacfadafd9d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:12.037805 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce617b-26fe-4f89-985a-eacfadafd9d7 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:12.044121 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 436/891] 10.222.0.47 () {56 vars in 1126 bytes} [Mon Aug 29 22:33:11 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:33:12.045628 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57536ac0-838f-42a9-ba5d-25fdb82baf8d None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:12.056861 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-d3ce617b-26fe-4f89-985a-eacfadafd9d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:33:12.056861 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:12.056861 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:12.056861 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:12.056861 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:12.056861 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:12.056861 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:12.056861 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:12.056861 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:12.056861 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:12.056861 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:12.056861 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:12.056861 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:33:12.056861 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:33:12.056861 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:33:12.056861 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:33:12.058909 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:12.058909 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:12.058909 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:12.058909 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:12.058909 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:12.058909 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:12.058909 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:12.058909 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:12.058909 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:12.058909 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:12.058909 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:12.058909 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:12.058909 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:12.058909 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:12.058909 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:12.058909 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:12.058909 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:33:12.060037 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:33:12.060037 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:33:12.060037 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:33:12.065350 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 456/892] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:33:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:33:12.065350 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce617b-26fe-4f89-985a-eacfadafd9d7 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:12.106080 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:12.171206 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57536ac0-838f-42a9-ba5d-25fdb82baf8d None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:12.198458 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce617b-26fe-4f89-985a-eacfadafd9d7 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:12.208052 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76922769-2f44-43f7-8e94-ef763c4b4f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:12.208659 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76922769-2f44-43f7-8e94-ef763c4b4f44 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:12.208973 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76922769-2f44-43f7-8e94-ef763c4b4f44 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:12.209248 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76922769-2f44-43f7-8e94-ef763c4b4f44 None admin] PATH_INFO: `/v3/services` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:12.210015 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76922769-2f44-43f7-8e94-ef763c4b4f44 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:12.210322 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76922769-2f44-43f7-8e94-ef763c4b4f44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:12.211732 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76922769-2f44-43f7-8e94-ef763c4b4f44 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:12.216830 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 437/893] 10.222.0.47 () {56 vars in 1126 bytes} [Mon Aug 29 22:33:12 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:33:12.218003 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58510cb-2812-444a-a4db-59c72ce3baea None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:12.218286 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58510cb-2812-444a-a4db-59c72ce3baea None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:12.218558 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58510cb-2812-444a-a4db-59c72ce3baea None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:12.223731 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 438/894] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:33:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:33:12.224530 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58510cb-2812-444a-a4db-59c72ce3baea None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:12.246156 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd985fd-8e4e-4086-ad95-c1f52e3c3cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:12.246400 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:12.246758 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd985fd-8e4e-4086-ad95-c1f52e3c3cd3 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:12.247034 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd985fd-8e4e-4086-ad95-c1f52e3c3cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:12.247302 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd985fd-8e4e-4086-ad95-c1f52e3c3cd3 None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:12.247944 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd985fd-8e4e-4086-ad95-c1f52e3c3cd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:12.248240 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd985fd-8e4e-4086-ad95-c1f52e3c3cd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:12.249724 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd985fd-8e4e-4086-ad95-c1f52e3c3cd3 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:12.262941 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 457/895] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:33:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:12.263932 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca0f33-e794-4116-b960-97e21653936b None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:12.264214 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca0f33-e794-4116-b960-97e21653936b None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:12.264483 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca0f33-e794-4116-b960-97e21653936b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:12.285661 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-9cca0f33-e794-4116-b960-97e21653936b None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:12.286828 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-9cca0f33-e794-4116-b960-97e21653936b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:12.351240 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58510cb-2812-444a-a4db-59c72ce3baea None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:12.364829 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 458/896] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:33:12 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:33:12.366596 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca0f33-e794-4116-b960-97e21653936b None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:12.392126 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:12.398070 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea93452c-9ce7-491b-8cb5-14f6aabd2127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:12.398912 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93452c-9ce7-491b-8cb5-14f6aabd2127 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:12.399521 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93452c-9ce7-491b-8cb5-14f6aabd2127 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:12.400101 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93452c-9ce7-491b-8cb5-14f6aabd2127 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:12.400986 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea93452c-9ce7-491b-8cb5-14f6aabd2127 None admin] RBAC: Adding query filter params (interface=public, service_id=ba7f83f6bdbe41ef98192ced7d11f8e6, region_id=RegionOne) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:12.401497 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea93452c-9ce7-491b-8cb5-14f6aabd2127 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:12.403244 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea93452c-9ce7-491b-8cb5-14f6aabd2127 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:12.409811 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 439/897] 10.222.0.47 () {56 vars in 1251 bytes} [Mon Aug 29 22:33:12 2022] GET /identity/v3/endpoints?service_id=ba7f83f6bdbe41ef98192ced7d11f8e6&interface=public®ion_id=RegionOne => generated 194 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:12.417472 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea93452c-9ce7-491b-8cb5-14f6aabd2127 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:12.472721 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca0f33-e794-4116-b960-97e21653936b None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:12.509519 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f67af-107a-4b35-a75d-ef681ccab723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:12.510154 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f67af-107a-4b35-a75d-ef681ccab723 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:12.510430 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f67af-107a-4b35-a75d-ef681ccab723 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:12.510700 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f67af-107a-4b35-a75d-ef681ccab723 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:12.518320 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798f67af-107a-4b35-a75d-ef681ccab723 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:12.519957 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798f67af-107a-4b35-a75d-ef681ccab723 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:12.532242 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-798f67af-107a-4b35-a75d-ef681ccab723 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 22:33:12.532242 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:12.532242 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:12.532242 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:12.532242 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:12.532242 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:12.532242 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:12.532242 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:12.532242 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:12.532242 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:12.532242 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:12.532242 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:12.532242 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:33:12.532242 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:33:12.532242 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:33:12.532242 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:33:12.533215 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:12.533215 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:12.533215 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:33:12.533215 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:33:12.533215 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:33:12.533215 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:33:12.533215 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:12.533215 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:12.533215 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:12.533215 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:12.533215 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:12.533215 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:12.533215 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:12.533215 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:12.533215 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:12.533215 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:12.533215 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:12.533215 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:12.534173 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:12.534173 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:12.534173 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:33:12.534173 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:33:12.534173 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:33:12.534173 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:33:12.534173 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:33:12.534173 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:33:12.534173 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 22:33:12.534173 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:33:12.536616 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea93452c-9ce7-491b-8cb5-14f6aabd2127 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:12.538723 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 459/898] 10.222.0.47 () {56 vars in 1117 bytes} [Mon Aug 29 22:33:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:33:12.540003 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f67af-107a-4b35-a75d-ef681ccab723 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:12.542105 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:12.586055 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac19ad0e-cf18-4f57-8fc5-4ad5285c04fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:12.586827 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac19ad0e-cf18-4f57-8fc5-4ad5285c04fa None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:12.587079 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac19ad0e-cf18-4f57-8fc5-4ad5285c04fa None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:12.587307 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac19ad0e-cf18-4f57-8fc5-4ad5285c04fa None admin] PATH_INFO: `/v3/services` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:12.588258 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac19ad0e-cf18-4f57-8fc5-4ad5285c04fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:12.591002 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac19ad0e-cf18-4f57-8fc5-4ad5285c04fa None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:12.600215 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 440/899] 10.222.0.47 () {56 vars in 1087 bytes} [Mon Aug 29 22:33:12 2022] GET /identity/v3/services => generated 1268 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:33:12.647205 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:12.669528 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f67af-107a-4b35-a75d-ef681ccab723 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:12.670710 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac19ad0e-cf18-4f57-8fc5-4ad5285c04fa None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:12.714989 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0309cc5-bb19-47cb-9cc6-c1ee734931e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:12.715728 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0309cc5-bb19-47cb-9cc6-c1ee734931e8 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:12.715997 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0309cc5-bb19-47cb-9cc6-c1ee734931e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:12.716267 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0309cc5-bb19-47cb-9cc6-c1ee734931e8 None admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:12.717027 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0309cc5-bb19-47cb-9cc6-c1ee734931e8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:12.717356 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0309cc5-bb19-47cb-9cc6-c1ee734931e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:12.718938 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0309cc5-bb19-47cb-9cc6-c1ee734931e8 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:12.741267 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 460/900] 10.222.0.47 () {56 vars in 1149 bytes} [Mon Aug 29 22:33:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:12.746804 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0309cc5-bb19-47cb-9cc6-c1ee734931e8 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:12.810276 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac19ad0e-cf18-4f57-8fc5-4ad5285c04fa None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:12.850753 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3bbc61-0ec7-43be-b2e4-958c50c9dc74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:12.851819 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3bbc61-0ec7-43be-b2e4-958c50c9dc74 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:12.851819 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3bbc61-0ec7-43be-b2e4-958c50c9dc74 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:12.852258 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3bbc61-0ec7-43be-b2e4-958c50c9dc74 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:12.852943 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3bbc61-0ec7-43be-b2e4-958c50c9dc74 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:12.854429 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3bbc61-0ec7-43be-b2e4-958c50c9dc74 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:12.858493 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0309cc5-bb19-47cb-9cc6-c1ee734931e8 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:12.863945 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-1b3bbc61-0ec7-43be-b2e4-958c50c9dc74 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 22:33:12.863945 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:12.863945 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:33:12.863945 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:33:12.863945 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:33:12.863945 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:33:12.863945 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:33:12.863945 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:33:12.863945 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 22:33:12.863945 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:33:12.863945 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:33:12.863945 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:33:12.863945 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:12.863945 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:12.863945 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:12.863945 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:12.863945 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:12.865223 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:12.865223 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:12.865223 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:12.865223 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:12.865223 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:12.865223 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:12.865223 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:33:12.865223 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:33:12.865223 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:33:12.865223 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:33:12.865223 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:12.865223 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:12.865223 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:12.865223 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:12.865223 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:12.865223 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:12.866503 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:12.866503 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:12.866503 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:12.866503 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:12.866503 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:12.866503 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:12.866503 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:12.866503 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:12.866503 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:12.866503 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:12.866503 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:33:12.866503 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:33:12.866503 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 22:33:12.866503 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:33:12.868421 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 441/901] 10.222.0.47 () {56 vars in 1126 bytes} [Mon Aug 29 22:33:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:33:12.874481 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3bbc61-0ec7-43be-b2e4-958c50c9dc74 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:12.889177 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:12.903512 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd2b9ba-8676-4ebd-8a2d-dafa6a1ede8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:12.904298 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2b9ba-8676-4ebd-8a2d-dafa6a1ede8f None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:12.904671 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2b9ba-8676-4ebd-8a2d-dafa6a1ede8f None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:12.905287 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2b9ba-8676-4ebd-8a2d-dafa6a1ede8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:12.919626 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:12.986712 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd2b9ba-8676-4ebd-8a2d-dafa6a1ede8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:12.988365 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd2b9ba-8676-4ebd-8a2d-dafa6a1ede8f None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:13.021045 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3bbc61-0ec7-43be-b2e4-958c50c9dc74 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:13.065213 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d9ca0-89e3-4e4e-b5a8-37acf73e0189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:13.065861 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d9ca0-89e3-4e4e-b5a8-37acf73e0189 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:13.066143 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d9ca0-89e3-4e4e-b5a8-37acf73e0189 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:13.066416 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d9ca0-89e3-4e4e-b5a8-37acf73e0189 None admin] PATH_INFO: `/v3/services` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:13.067214 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6d9ca0-89e3-4e4e-b5a8-37acf73e0189 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:13.067514 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6d9ca0-89e3-4e4e-b5a8-37acf73e0189 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:13.069812 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6d9ca0-89e3-4e4e-b5a8-37acf73e0189 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:13.077406 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 442/902] 10.222.0.47 () {56 vars in 1122 bytes} [Mon Aug 29 22:33:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:13.081856 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d9ca0-89e3-4e4e-b5a8-37acf73e0189 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:13.118837 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 461/903] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Aug 29 22:33:12 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 22:33:13.126324 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd2b9ba-8676-4ebd-8a2d-dafa6a1ede8f None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:13.173644 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:13.183143 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:13.207858 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d9ca0-89e3-4e4e-b5a8-37acf73e0189 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:13.258616 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ffbad-7098-41ab-839b-fc275b6436f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:13.259277 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ffbad-7098-41ab-839b-fc275b6436f8 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:13.259564 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ffbad-7098-41ab-839b-fc275b6436f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:13.259934 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ffbad-7098-41ab-839b-fc275b6436f8 None admin] PATH_INFO: `/v3/services` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:13.260670 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53ffbad-7098-41ab-839b-fc275b6436f8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:13.260977 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53ffbad-7098-41ab-839b-fc275b6436f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:13.262369 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53ffbad-7098-41ab-839b-fc275b6436f8 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:13.266454 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd2b9ba-8676-4ebd-8a2d-dafa6a1ede8f None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:13.276736 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 443/904] 10.222.0.47 () {56 vars in 1122 bytes} [Mon Aug 29 22:33:13 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:33:13.311197 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e1a892-0704-47ff-9bce-47effca7d27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:13.311844 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e1a892-0704-47ff-9bce-47effca7d27a None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:13.312118 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e1a892-0704-47ff-9bce-47effca7d27a None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:13.312390 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e1a892-0704-47ff-9bce-47effca7d27a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:13.325703 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e1a892-0704-47ff-9bce-47effca7d27a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:13.327104 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e1a892-0704-47ff-9bce-47effca7d27a None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:13.343948 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-66e1a892-0704-47ff-9bce-47effca7d27a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:33:13.343948 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:13.343948 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:13.343948 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:13.343948 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:13.343948 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:13.343948 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:13.343948 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:13.343948 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:13.343948 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:13.343948 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:13.343948 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:13.343948 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:33:13.343948 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:33:13.343948 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:33:13.343948 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:33:13.344956 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:13.344956 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:13.344956 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:13.344956 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:13.344956 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:13.344956 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:13.344956 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:13.344956 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:13.344956 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:13.344956 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:13.344956 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:13.344956 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:13.344956 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:13.344956 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:13.344956 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:13.344956 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:13.344956 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:33:13.346349 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:33:13.346349 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:33:13.346349 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:33:13.346349 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 462/905] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:33:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:33:13.353504 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ffbad-7098-41ab-839b-fc275b6436f8 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:13.466851 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ffbad-7098-41ab-839b-fc275b6436f8 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:13.476531 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9742351-7d09-4019-b947-3e373ebcbadf None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:13.476824 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9742351-7d09-4019-b947-3e373ebcbadf None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:13.477186 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9742351-7d09-4019-b947-3e373ebcbadf None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:13.479193 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 463/906] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:33:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:33:13.484145 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cca6c4-aba6-4ea7-a732-92681c506733 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:13.484528 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cca6c4-aba6-4ea7-a732-92681c506733 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:13.484806 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cca6c4-aba6-4ea7-a732-92681c506733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:13.503300 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79ef676-2545-4294-95bd-c66e7a0ceaeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:13.504057 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ef676-2545-4294-95bd-c66e7a0ceaeb None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:13.504340 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ef676-2545-4294-95bd-c66e7a0ceaeb None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:13.504613 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ef676-2545-4294-95bd-c66e7a0ceaeb None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:13.504849 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-37cca6c4-aba6-4ea7-a732-92681c506733 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:13.505259 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79ef676-2545-4294-95bd-c66e7a0ceaeb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:13.505586 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79ef676-2545-4294-95bd-c66e7a0ceaeb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:13.506811 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-37cca6c4-aba6-4ea7-a732-92681c506733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:13.507150 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79ef676-2545-4294-95bd-c66e7a0ceaeb None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:13.514659 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:13.525201 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 444/907] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:33:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:13.530872 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79ef676-2545-4294-95bd-c66e7a0ceaeb None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:13.596506 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 464/908] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:33:13 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:33:13.657143 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79ef676-2545-4294-95bd-c66e7a0ceaeb None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:13.694926 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e56e1e7-b71e-4aa8-aea6-4b47368a57e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:13.695566 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56e1e7-b71e-4aa8-aea6-4b47368a57e6 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:13.695848 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56e1e7-b71e-4aa8-aea6-4b47368a57e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:13.696120 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56e1e7-b71e-4aa8-aea6-4b47368a57e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:13.703405 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e56e1e7-b71e-4aa8-aea6-4b47368a57e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:13.704913 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e56e1e7-b71e-4aa8-aea6-4b47368a57e6 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:13.718087 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-8e56e1e7-b71e-4aa8-aea6-4b47368a57e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:33:13.718087 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:13.718087 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:13.718087 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:13.718087 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:13.718087 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:13.718087 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:13.718087 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:13.718087 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:13.718087 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:13.718087 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:13.718087 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:13.718087 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:33:13.718087 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:33:13.718087 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:33:13.719012 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:33:13.719012 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:13.719012 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:13.719012 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:13.719012 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:13.719012 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:13.719012 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:13.719012 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:13.719012 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:13.719012 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:13.719012 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:13.719012 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:13.719012 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:13.719012 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:13.719012 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:13.719012 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:13.719012 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:13.720294 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:33:13.720294 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:33:13.720294 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:33:13.720294 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:33:13.720294 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:33:13.720294 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:33:13.720294 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:33:13.720294 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:33:13.720294 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 445/909] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Aug 29 22:33:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:33:13.727609 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cca6c4-aba6-4ea7-a732-92681c506733 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:13.754349 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:13.841753 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cca6c4-aba6-4ea7-a732-92681c506733 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:13.875174 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e56e1e7-b71e-4aa8-aea6-4b47368a57e6 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:13.879448 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed18bd21-a9ff-4cd5-b94b-60d9f4521db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:13.881206 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed18bd21-a9ff-4cd5-b94b-60d9f4521db0 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:13.882027 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed18bd21-a9ff-4cd5-b94b-60d9f4521db0 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:13.882508 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed18bd21-a9ff-4cd5-b94b-60d9f4521db0 None admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:13.883403 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed18bd21-a9ff-4cd5-b94b-60d9f4521db0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:13.883952 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed18bd21-a9ff-4cd5-b94b-60d9f4521db0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:13.885629 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed18bd21-a9ff-4cd5-b94b-60d9f4521db0 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:13.905273 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 465/910] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Aug 29 22:33:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:13.907520 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed18bd21-a9ff-4cd5-b94b-60d9f4521db0 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:13.955043 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:14.005320 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:14.013300 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e56e1e7-b71e-4aa8-aea6-4b47368a57e6 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:14.030885 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed18bd21-a9ff-4cd5-b94b-60d9f4521db0 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:14.060311 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7665991e-fada-4d33-a316-9e3148b920a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:14.061192 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665991e-fada-4d33-a316-9e3148b920a5 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:14.061576 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665991e-fada-4d33-a316-9e3148b920a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:14.061851 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665991e-fada-4d33-a316-9e3148b920a5 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:14.062851 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7665991e-fada-4d33-a316-9e3148b920a5 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:14.064500 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7665991e-fada-4d33-a316-9e3148b920a5 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:14.071856 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d4489-7ad9-41b3-885d-653926eb61aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:14.072756 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d4489-7ad9-41b3-885d-653926eb61aa None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:14.073269 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d4489-7ad9-41b3-885d-653926eb61aa None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:14.073782 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d4489-7ad9-41b3-885d-653926eb61aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:14.074775 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929d4489-7ad9-41b3-885d-653926eb61aa None admin] RBAC: Adding query filter params (role.id=ad49d96eb9164c789bc74d8748e637b5, scope.project.id=ce09f0beb1a342febbb4a8b3c7cf60c2, user.id=e49a4666712746d098ace9e1cb0bf07c) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:14.075278 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929d4489-7ad9-41b3-885d-653926eb61aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:14.075517 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-7665991e-fada-4d33-a316-9e3148b920a5 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 22:33:14.075517 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:14.075517 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:33:14.075517 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:33:14.075517 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:33:14.075517 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:33:14.075517 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:33:14.075517 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:33:14.075517 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 22:33:14.075517 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:33:14.075517 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:33:14.075517 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:33:14.075517 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:14.075517 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:14.075517 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:14.075517 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:14.075517 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:14.076445 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:14.076445 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:14.076445 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:14.076445 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:14.076445 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:14.076445 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:14.076445 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:33:14.076445 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:33:14.076445 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:33:14.076445 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:33:14.076445 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:14.076445 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:14.076445 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:14.076445 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:14.076445 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:14.076445 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:14.077750 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:14.077750 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:14.077750 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:14.077750 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:14.077750 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:14.077750 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:14.077750 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:14.077750 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:14.077750 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:14.077750 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:14.077750 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:33:14.077750 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:33:14.077750 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 22:33:14.077750 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:33:14.077750 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 446/911] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Aug 29 22:33:13 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:33:14.080194 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929d4489-7ad9-41b3-885d-653926eb61aa None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:14.082412 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7665991e-fada-4d33-a316-9e3148b920a5 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:14.095098 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 466/912] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Aug 29 22:33:13 2022] GET /identity/v3/role_assignments?user.id=e49a4666712746d098ace9e1cb0bf07c&scope.project.id=ce09f0beb1a342febbb4a8b3c7cf60c2&role.id=ad49d96eb9164c789bc74d8748e637b5 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:33:14.196537 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7665991e-fada-4d33-a316-9e3148b920a5 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:14.222676 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:14.237974 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17696b01-9a12-4c33-b041-dbe94c31ecd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:14.238599 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17696b01-9a12-4c33-b041-dbe94c31ecd0 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:14.238871 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17696b01-9a12-4c33-b041-dbe94c31ecd0 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:14.239157 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17696b01-9a12-4c33-b041-dbe94c31ecd0 None admin] PATH_INFO: `/v3/services` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:14.239784 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17696b01-9a12-4c33-b041-dbe94c31ecd0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:14.240217 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17696b01-9a12-4c33-b041-dbe94c31ecd0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:14.242960 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17696b01-9a12-4c33-b041-dbe94c31ecd0 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:14.247506 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 447/913] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Aug 29 22:33:14 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:14.253514 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d4489-7ad9-41b3-885d-653926eb61aa None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:14.362006 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d4489-7ad9-41b3-885d-653926eb61aa None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:14.405868 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548a238f-b050-4e0b-8c20-996226f10463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:14.406566 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548a238f-b050-4e0b-8c20-996226f10463 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:14.406844 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548a238f-b050-4e0b-8c20-996226f10463 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:14.407168 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548a238f-b050-4e0b-8c20-996226f10463 None admin] PATH_INFO: `/v3/services` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:14.407808 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548a238f-b050-4e0b-8c20-996226f10463 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:14.408107 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548a238f-b050-4e0b-8c20-996226f10463 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:14.409580 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548a238f-b050-4e0b-8c20-996226f10463 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:14.416139 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 467/914] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Aug 29 22:33:14 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:33:14.421458 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17696b01-9a12-4c33-b041-dbe94c31ecd0 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:14.532400 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17696b01-9a12-4c33-b041-dbe94c31ecd0 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:14.571277 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c396969-d2b6-4dda-884d-2794c2b67f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:14.572288 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c396969-d2b6-4dda-884d-2794c2b67f81 None admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:14.572771 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c396969-d2b6-4dda-884d-2794c2b67f81 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:14.573255 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c396969-d2b6-4dda-884d-2794c2b67f81 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:14.574153 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c396969-d2b6-4dda-884d-2794c2b67f81 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:14.575876 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c396969-d2b6-4dda-884d-2794c2b67f81 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:14.602495 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 448/915] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:33:14 2022] POST /identity/v3/endpoints => generated 346 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:33:14.610173 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f753b3-68a3-4df6-97e3-da5085ece558 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:14.610486 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f753b3-68a3-4df6-97e3-da5085ece558 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:14.610739 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f753b3-68a3-4df6-97e3-da5085ece558 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:14.612234 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 468/916] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:33:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:33:14.618777 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f6297-22b4-4ba2-87de-6f95cd6cb937 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:14.619517 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f6297-22b4-4ba2-87de-6f95cd6cb937 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:14.619988 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f6297-22b4-4ba2-87de-6f95cd6cb937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:14.642141 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-477f6297-22b4-4ba2-87de-6f95cd6cb937 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:14.643746 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-477f6297-22b4-4ba2-87de-6f95cd6cb937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:14.691176 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:14.745697 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 449/917] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:33:14 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:33:15.017205 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f753b3-68a3-4df6-97e3-da5085ece558 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:15.031934 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:15.132230 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f753b3-68a3-4df6-97e3-da5085ece558 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:15.168626 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d786d902-0da0-4809-bbe5-343137568b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:15.169263 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786d902-0da0-4809-bbe5-343137568b93 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:15.169570 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786d902-0da0-4809-bbe5-343137568b93 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:15.169848 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786d902-0da0-4809-bbe5-343137568b93 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:15.170436 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d786d902-0da0-4809-bbe5-343137568b93 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:15.171799 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d786d902-0da0-4809-bbe5-343137568b93 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:15.181582 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-d786d902-0da0-4809-bbe5-343137568b93 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 22:33:15.181582 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:15.181582 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:33:15.181582 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:33:15.181582 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:33:15.181582 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:33:15.181582 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:33:15.181582 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:33:15.181582 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 22:33:15.181582 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:33:15.181582 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:33:15.181582 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:33:15.181582 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:15.181582 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:15.181582 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:15.181582 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:15.182522 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:15.182522 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:15.182522 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:15.182522 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:15.182522 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:15.182522 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:15.182522 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:15.182522 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:33:15.182522 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:33:15.182522 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:33:15.182522 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:33:15.182522 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:15.182522 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:15.182522 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:15.182522 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:15.182522 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:15.182522 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:15.183378 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:15.183378 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:15.183378 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:15.183378 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:15.183378 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:15.183378 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:15.183378 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:15.183378 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:15.183378 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:15.183378 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:15.183378 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:33:15.183378 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:33:15.183378 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 22:33:15.183378 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:33:15.183378 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 469/918] 10.222.0.47 () {56 vars in 1132 bytes} [Mon Aug 29 22:33:15 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:33:15.190638 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477f6297-22b4-4ba2-87de-6f95cd6cb937 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:15.314872 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477f6297-22b4-4ba2-87de-6f95cd6cb937 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:15.356141 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe73ab12-29d8-4e72-96a5-15fd4a15e2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:15.356751 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73ab12-29d8-4e72-96a5-15fd4a15e2e8 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:15.357026 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73ab12-29d8-4e72-96a5-15fd4a15e2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:15.357295 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73ab12-29d8-4e72-96a5-15fd4a15e2e8 None admin] PATH_INFO: `/v3/services` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:15.357958 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe73ab12-29d8-4e72-96a5-15fd4a15e2e8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:15.358254 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe73ab12-29d8-4e72-96a5-15fd4a15e2e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:15.359613 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe73ab12-29d8-4e72-96a5-15fd4a15e2e8 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:15.368864 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 450/919] 10.222.0.47 () {56 vars in 1126 bytes} [Mon Aug 29 22:33:15 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:15.374280 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d786d902-0da0-4809-bbe5-343137568b93 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:15.447555 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e08e2-c97e-40d2-b8eb-754826e0a41d None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:15.447954 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e08e2-c97e-40d2-b8eb-754826e0a41d None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:15.448154 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e08e2-c97e-40d2-b8eb-754826e0a41d None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:15.449747 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 451/920] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:33:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:33:15.454382 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1775cf2-5680-4e13-ada0-93ddff165c8c None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:15.454671 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1775cf2-5680-4e13-ada0-93ddff165c8c None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:15.454949 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1775cf2-5680-4e13-ada0-93ddff165c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:15.455486 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:15.473828 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-d1775cf2-5680-4e13-ada0-93ddff165c8c None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:15.475673 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-d1775cf2-5680-4e13-ada0-93ddff165c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:15.487832 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d786d902-0da0-4809-bbe5-343137568b93 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:15.506329 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:15.535417 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6f16b0-dbf0-4322-bda9-f726754186fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:15.536508 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f16b0-dbf0-4322-bda9-f726754186fd None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:15.537010 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f16b0-dbf0-4322-bda9-f726754186fd None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:15.537609 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f16b0-dbf0-4322-bda9-f726754186fd None admin] PATH_INFO: `/v3/services` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:15.538652 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6f16b0-dbf0-4322-bda9-f726754186fd None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:15.539413 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6f16b0-dbf0-4322-bda9-f726754186fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:15.541005 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6f16b0-dbf0-4322-bda9-f726754186fd None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:15.553037 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 470/921] 10.222.0.47 () {56 vars in 1126 bytes} [Mon Aug 29 22:33:15 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:15.553932 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6f16b0-dbf0-4322-bda9-f726754186fd None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:15.569239 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 452/922] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:33:15 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:33:15.675180 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6f16b0-dbf0-4322-bda9-f726754186fd None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:15.725466 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1546caf-02a5-476f-9874-604109d9ba84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:15.726935 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1546caf-02a5-476f-9874-604109d9ba84 None admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:15.727653 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1546caf-02a5-476f-9874-604109d9ba84 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:15.728301 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1546caf-02a5-476f-9874-604109d9ba84 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:15.729178 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1546caf-02a5-476f-9874-604109d9ba84 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:15.730828 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1546caf-02a5-476f-9874-604109d9ba84 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:15.743332 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:15.762431 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 471/923] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:33:15 2022] POST /identity/v3/endpoints => generated 347 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:33:15.844321 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1775cf2-5680-4e13-ada0-93ddff165c8c None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:15.960606 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1775cf2-5680-4e13-ada0-93ddff165c8c None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:16.005912 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4335500b-bb5e-4a7f-b5be-f6fb254e3bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:16.006692 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335500b-bb5e-4a7f-b5be-f6fb254e3bb4 None admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:16.006980 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335500b-bb5e-4a7f-b5be-f6fb254e3bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:16.007248 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335500b-bb5e-4a7f-b5be-f6fb254e3bb4 None admin] PATH_INFO: `/v3/services` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:16.007909 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4335500b-bb5e-4a7f-b5be-f6fb254e3bb4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:16.009517 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4335500b-bb5e-4a7f-b5be-f6fb254e3bb4 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:16.026524 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 453/924] 10.222.0.47 () {60 vars in 1141 bytes} [Mon Aug 29 22:33:15 2022] POST /identity/v3/services => generated 241 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:33:16.152135 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f002a7-da34-402e-ad2d-73907d522ac0 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:16.152822 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f002a7-da34-402e-ad2d-73907d522ac0 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:16.152822 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f002a7-da34-402e-ad2d-73907d522ac0 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:16.154354 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 472/925] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:33:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:33:16.160302 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6502a604-f6ac-49d2-80c3-3020ccb8070e None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:16.160570 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6502a604-f6ac-49d2-80c3-3020ccb8070e None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:16.160847 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6502a604-f6ac-49d2-80c3-3020ccb8070e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:16.181945 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-6502a604-f6ac-49d2-80c3-3020ccb8070e None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:16.183226 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-6502a604-f6ac-49d2-80c3-3020ccb8070e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:16.198970 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:16.268774 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 454/926] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:33:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:33:16.540862 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f002a7-da34-402e-ad2d-73907d522ac0 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:16.658591 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f002a7-da34-402e-ad2d-73907d522ac0 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:16.658787 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95fa46b-5b6e-42f6-ac03-a6cb2a29e532 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:16.658987 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95fa46b-5b6e-42f6-ac03-a6cb2a29e532 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:16.659265 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95fa46b-5b6e-42f6-ac03-a6cb2a29e532 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:16.662357 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 455/927] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:33:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:33:16.665894 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab959544-8320-48e2-a826-508c8b9139fe None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:16.666179 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab959544-8320-48e2-a826-508c8b9139fe None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:16.666454 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab959544-8320-48e2-a826-508c8b9139fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:16.685585 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-ab959544-8320-48e2-a826-508c8b9139fe None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:16.686795 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-ab959544-8320-48e2-a826-508c8b9139fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:16.696174 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3a04ca-db5f-4f5a-9abb-d1bc9a1299bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:16.697186 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a04ca-db5f-4f5a-9abb-d1bc9a1299bb None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:16.697639 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a04ca-db5f-4f5a-9abb-d1bc9a1299bb None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:16.698069 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a04ca-db5f-4f5a-9abb-d1bc9a1299bb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:16.709506 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3a04ca-db5f-4f5a-9abb-d1bc9a1299bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:33:16.714601 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-5b3a04ca-db5f-4f5a-9abb-d1bc9a1299bb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 22:33:16.714601 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:16.714601 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:16.714601 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:16.714601 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:16.714601 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:16.714601 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:16.714601 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:16.714601 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:16.714601 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:16.714601 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:16.714601 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:16.714601 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:33:16.714601 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:33:16.714601 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:33:16.714601 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:33:16.715690 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:33:16.715690 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:33:16.715690 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:33:16.715690 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:33:16.715690 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:16.715690 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:16.715690 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:16.715690 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:16.715690 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:16.715690 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:16.715690 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:16.715690 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:16.715690 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:16.715690 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:16.715690 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:16.715690 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:16.716670 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:16.716670 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:16.716670 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:16.716670 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:16.716670 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:33:16.716670 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:33:16.716670 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:33:16.716670 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:33:16.716670 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:33:16.716670 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:33:16.716670 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 22:33:16.716670 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:33:16.718921 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 473/928] 10.222.0.47 () {56 vars in 1120 bytes} [Mon Aug 29 22:33:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:33:16.729356 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3a04ca-db5f-4f5a-9abb-d1bc9a1299bb None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:16.769583 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 456/929] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:33:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:33:16.790334 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:16.837718 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3a04ca-db5f-4f5a-9abb-d1bc9a1299bb None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:16.874228 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f274c07-7f37-4d1c-8164-d87da2aaaf57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:16.874838 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f274c07-7f37-4d1c-8164-d87da2aaaf57 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:16.875118 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f274c07-7f37-4d1c-8164-d87da2aaaf57 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:16.875447 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f274c07-7f37-4d1c-8164-d87da2aaaf57 None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:16.876112 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f274c07-7f37-4d1c-8164-d87da2aaaf57 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:16.876464 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f274c07-7f37-4d1c-8164-d87da2aaaf57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:16.877864 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f274c07-7f37-4d1c-8164-d87da2aaaf57 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:16.887119 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 474/930] 10.222.0.47 () {56 vars in 1115 bytes} [Mon Aug 29 22:33:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:16.892845 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab959544-8320-48e2-a826-508c8b9139fe None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:16.979620 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:17.008670 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab959544-8320-48e2-a826-508c8b9139fe None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:17.047008 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca1351-9097-4c47-90a0-f029b4444443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:17.047739 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca1351-9097-4c47-90a0-f029b4444443 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:17.048030 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca1351-9097-4c47-90a0-f029b4444443 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:17.048311 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca1351-9097-4c47-90a0-f029b4444443 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:17.050939 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f274c07-7f37-4d1c-8164-d87da2aaaf57 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:17.064021 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dca1351-9097-4c47-90a0-f029b4444443 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:17.065624 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dca1351-9097-4c47-90a0-f029b4444443 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:17.082703 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-7dca1351-9097-4c47-90a0-f029b4444443 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:33:17.082703 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:17.082703 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:17.082703 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:17.082703 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:17.082703 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:17.082703 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:17.082703 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:17.082703 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:17.082703 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:17.082703 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:17.082703 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:17.082703 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:33:17.082703 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:33:17.082703 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:33:17.082703 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:33:17.083757 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:17.083757 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:17.083757 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:17.083757 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:17.083757 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:17.083757 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:17.083757 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:17.083757 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:17.083757 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:17.083757 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:17.083757 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:17.083757 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:17.083757 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:17.083757 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:17.083757 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:17.083757 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:17.083757 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:33:17.085137 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:33:17.085137 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:33:17.085137 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:33:17.085137 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 457/931] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:33:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:33:17.091396 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca1351-9097-4c47-90a0-f029b4444443 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:17.170275 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f274c07-7f37-4d1c-8164-d87da2aaaf57 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:17.187398 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:17.206801 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca1351-9097-4c47-90a0-f029b4444443 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:17.210840 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2bb517-b1fc-41a7-bc63-0de786dff6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:17.212132 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2bb517-b1fc-41a7-bc63-0de786dff6da None admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:17.212132 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2bb517-b1fc-41a7-bc63-0de786dff6da None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:17.212132 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2bb517-b1fc-41a7-bc63-0de786dff6da None admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:17.212801 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2bb517-b1fc-41a7-bc63-0de786dff6da None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:17.214276 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2bb517-b1fc-41a7-bc63-0de786dff6da None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:17.216897 dv-cinder-854270-4-smb devstack@keystone.service[88339]: WARNING keystone.server.flask.common [None req-6e2bb517-b1fc-41a7-bc63-0de786dff6da None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 29 22:33:17.236696 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.sql.core [None req-6e2bb517-b1fc-41a7-bc63-0de786dff6da None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 29 22:33:17.236696 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 29 22:33:17.236696 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [parameters: {'id': 'a01d2252535d4ce1a1d2c4baf7f0864c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 29 22:33:17.236696 dv-cinder-854270-4-smb devstack@keystone.service[88339]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88339) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 29 22:33:17.238067 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:17.248257 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170a4cac-1744-45b4-a315-bb0f87c6bdb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:17.249182 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a4cac-1744-45b4-a315-bb0f87c6bdb4 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:17.249711 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a4cac-1744-45b4-a315-bb0f87c6bdb4 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:17.250188 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a4cac-1744-45b4-a315-bb0f87c6bdb4 None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:17.251053 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170a4cac-1744-45b4-a315-bb0f87c6bdb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:17.251560 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170a4cac-1744-45b4-a315-bb0f87c6bdb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:17.253130 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170a4cac-1744-45b4-a315-bb0f87c6bdb4 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:17.257259 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-6e2bb517-b1fc-41a7-bc63-0de786dff6da None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a01d2252535d4ce1a1d2c4baf7f0864c.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a01d2252535d4ce1a1d2c4baf7f0864c. Aug 29 22:33:17.257259 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:17.257259 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 22:33:17.257259 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 22:33:17.257259 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 22:33:17.257259 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 22:33:17.257259 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 22:33:17.257259 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 22:33:17.257259 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 22:33:17.257259 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application conn.query(q) Aug 29 22:33:17.257259 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 22:33:17.257259 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 22:33:17.257259 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 22:33:17.258073 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application result.read() Aug 29 22:33:17.258073 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 22:33:17.258073 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 22:33:17.258073 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 22:33:17.258073 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 22:33:17.258073 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 22:33:17.258073 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 22:33:17.258073 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 22:33:17.258073 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 22:33:17.258073 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 29 22:33:17.258073 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:33:17.258073 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 29 22:33:17.258073 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:33:17.258073 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:17.258073 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 29 22:33:17.258073 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 29 22:33:17.258073 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 29 22:33:17.258073 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 29 22:33:17.259031 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 22:33:17.259031 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application next(self.gen) Aug 29 22:33:17.259031 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 29 22:33:17.259031 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application yield resource Aug 29 22:33:17.259031 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 22:33:17.259031 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application next(self.gen) Aug 29 22:33:17.259031 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 29 22:33:17.259031 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self.session.rollback() Aug 29 22:33:17.259031 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 22:33:17.259031 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self.force_reraise() Aug 29 22:33:17.259031 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 22:33:17.259031 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise self.value Aug 29 22:33:17.259031 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 29 22:33:17.259031 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 29 22:33:17.259031 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 29 22:33:17.259031 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application session.commit() Aug 29 22:33:17.259031 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 29 22:33:17.259928 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 29 22:33:17.259928 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 29 22:33:17.259928 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self._prepare_impl() Aug 29 22:33:17.259928 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 29 22:33:17.259928 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self.session.flush() Aug 29 22:33:17.259928 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 29 22:33:17.259928 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self._flush(objects) Aug 29 22:33:17.259928 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 29 22:33:17.259928 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 29 22:33:17.259928 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 29 22:33:17.259928 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application compat.raise_( Aug 29 22:33:17.259928 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 22:33:17.259928 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception Aug 29 22:33:17.259928 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 29 22:33:17.259928 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application flush_context.execute() Aug 29 22:33:17.259928 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 29 22:33:17.259928 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rec.execute(self) Aug 29 22:33:17.260907 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 29 22:33:17.260907 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 29 22:33:17.260907 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 29 22:33:17.260907 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 29 22:33:17.260907 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 29 22:33:17.260907 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 29 22:33:17.260907 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 29 22:33:17.260907 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 29 22:33:17.260907 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 29 22:33:17.260907 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 29 22:33:17.260907 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 29 22:33:17.260907 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 29 22:33:17.260907 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 29 22:33:17.260907 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 29 22:33:17.260907 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 29 22:33:17.261763 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 29 22:33:17.261763 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 22:33:17.261763 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception Aug 29 22:33:17.261763 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 22:33:17.261763 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 22:33:17.261763 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 22:33:17.261763 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 22:33:17.261763 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 22:33:17.261763 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 22:33:17.261763 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 22:33:17.261763 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application conn.query(q) Aug 29 22:33:17.261763 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 22:33:17.261763 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 22:33:17.261763 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 22:33:17.261763 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application result.read() Aug 29 22:33:17.261763 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 22:33:17.261763 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 22:33:17.262614 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 22:33:17.262614 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 22:33:17.262614 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 22:33:17.262614 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 22:33:17.262614 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 22:33:17.262614 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 22:33:17.262614 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 29 22:33:17.262614 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 29 22:33:17.262614 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [parameters: {'id': 'a01d2252535d4ce1a1d2c4baf7f0864c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 29 22:33:17.262614 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 29 22:33:17.262614 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:33:17.262614 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:33:17.262614 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:33:17.262614 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:17.262614 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 29 22:33:17.265124 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 29 22:33:17.265124 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 29 22:33:17.265124 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 29 22:33:17.265124 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 29 22:33:17.265124 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:33:17.265124 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:33:17.265124 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:33:17.265124 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:17.265124 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:17.265124 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:17.265124 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:17.265124 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:17.265124 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:17.265124 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:17.265124 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:17.265124 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:17.265124 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:17.267418 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:17.267418 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 29 22:33:17.267418 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 29 22:33:17.267418 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:17.267418 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:17.267418 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 29 22:33:17.267418 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 29 22:33:17.267418 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a01d2252535d4ce1a1d2c4baf7f0864c. Aug 29 22:33:17.267418 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:33:17.267418 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 475/932] 10.222.0.47 () {60 vars in 1140 bytes} [Mon Aug 29 22:33:17 2022] POST /identity/v3/projects => generated 262 bytes in 208 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:33:17.267418 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2bb517-b1fc-41a7-bc63-0de786dff6da None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:17.281112 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 458/933] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:33:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:17.283307 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170a4cac-1744-45b4-a315-bb0f87c6bdb4 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:17.384055 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2bb517-b1fc-41a7-bc63-0de786dff6da None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:17.391227 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170a4cac-1744-45b4-a315-bb0f87c6bdb4 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:17.420065 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef371e-f1e4-477c-aff7-bcadf6843761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:17.420784 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef371e-f1e4-477c-aff7-bcadf6843761 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:17.421072 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef371e-f1e4-477c-aff7-bcadf6843761 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:17.421354 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef371e-f1e4-477c-aff7-bcadf6843761 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:17.429228 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcef371e-f1e4-477c-aff7-bcadf6843761 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:17.430925 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcef371e-f1e4-477c-aff7-bcadf6843761 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:17.431249 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80c6dea-0186-44a6-a6b0-3bb61c1fcf80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:17.432210 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80c6dea-0186-44a6-a6b0-3bb61c1fcf80 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:17.432638 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80c6dea-0186-44a6-a6b0-3bb61c1fcf80 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:17.433060 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80c6dea-0186-44a6-a6b0-3bb61c1fcf80 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:17.440959 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80c6dea-0186-44a6-a6b0-3bb61c1fcf80 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:17.442665 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80c6dea-0186-44a6-a6b0-3bb61c1fcf80 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:17.444469 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-fcef371e-f1e4-477c-aff7-bcadf6843761 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:33:17.444469 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:17.444469 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:17.444469 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:17.444469 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:17.444469 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:17.444469 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:17.444469 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:17.444469 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:17.444469 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:17.444469 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:17.444469 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:17.444469 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:33:17.444469 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:33:17.444469 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:33:17.445570 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:33:17.445570 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:17.445570 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:17.445570 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:17.445570 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:17.445570 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:17.445570 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:17.445570 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:17.445570 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:17.445570 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:17.445570 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:17.445570 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:17.445570 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:17.445570 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:17.445570 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:17.445570 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:17.445570 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:17.446548 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:33:17.446548 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:33:17.446548 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:33:17.446548 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:33:17.446548 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:33:17.446548 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:33:17.446548 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:33:17.446548 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:33:17.447282 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 476/934] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Aug 29 22:33:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:33:17.458325 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef371e-f1e4-477c-aff7-bcadf6843761 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:17.459319 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-d80c6dea-0186-44a6-a6b0-3bb61c1fcf80 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 22:33:17.459319 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:17.459319 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:17.459319 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:17.459319 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:17.459319 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:17.459319 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:17.459319 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:17.459319 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:17.459319 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:17.459319 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:17.459319 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:17.459319 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:33:17.459319 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:33:17.459319 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:33:17.459319 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:33:17.460610 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:17.460610 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:17.460610 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:33:17.460610 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:33:17.460610 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:33:17.460610 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:33:17.460610 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:17.460610 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:17.460610 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:17.460610 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:17.460610 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:17.460610 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:17.460610 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:17.460610 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:17.460610 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:17.460610 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:17.460610 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:17.460610 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:17.461704 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:17.461704 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:17.461704 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:33:17.461704 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:33:17.461704 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:33:17.461704 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:33:17.461704 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:33:17.461704 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:33:17.461704 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 22:33:17.461704 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:33:17.469312 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 459/935] 10.222.0.47 () {56 vars in 1117 bytes} [Mon Aug 29 22:33:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:33:17.470559 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80c6dea-0186-44a6-a6b0-3bb61c1fcf80 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:17.501926 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:17.530443 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:17.587773 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef371e-f1e4-477c-aff7-bcadf6843761 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:17.595124 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80c6dea-0186-44a6-a6b0-3bb61c1fcf80 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:17.627533 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ae80a-1418-4c1b-bead-cccbb79be9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:17.627880 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ae80a-1418-4c1b-bead-cccbb79be9e6 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:17.628149 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ae80a-1418-4c1b-bead-cccbb79be9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:17.628417 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ae80a-1418-4c1b-bead-cccbb79be9e6 None admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:17.629083 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665ae80a-1418-4c1b-bead-cccbb79be9e6 None admin] RBAC: Adding query filter params (name=service) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:17.629484 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665ae80a-1418-4c1b-bead-cccbb79be9e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:17.631123 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665ae80a-1418-4c1b-bead-cccbb79be9e6 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:17.637370 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe8d718-4f5c-44c8-b5ae-eed94ccd50d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:17.638255 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe8d718-4f5c-44c8-b5ae-eed94ccd50d4 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:17.638768 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe8d718-4f5c-44c8-b5ae-eed94ccd50d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:17.639245 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe8d718-4f5c-44c8-b5ae-eed94ccd50d4 None admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:17.640193 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe8d718-4f5c-44c8-b5ae-eed94ccd50d4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:17.640700 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe8d718-4f5c-44c8-b5ae-eed94ccd50d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:17.642447 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe8d718-4f5c-44c8-b5ae-eed94ccd50d4 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:17.661028 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 477/936] 10.222.0.47 () {56 vars in 1112 bytes} [Mon Aug 29 22:33:17 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:17.663653 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 460/937] 10.222.0.47 () {56 vars in 1149 bytes} [Mon Aug 29 22:33:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:17.672228 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ae80a-1418-4c1b-bead-cccbb79be9e6 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:17.779392 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:17.790241 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ae80a-1418-4c1b-bead-cccbb79be9e6 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:17.832513 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e397d022-e873-4715-b59a-6bd0878c2aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:17.833568 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397d022-e873-4715-b59a-6bd0878c2aff None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:17.834776 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397d022-e873-4715-b59a-6bd0878c2aff None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:17.835261 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397d022-e873-4715-b59a-6bd0878c2aff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:17.846804 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e397d022-e873-4715-b59a-6bd0878c2aff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:17.848562 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e397d022-e873-4715-b59a-6bd0878c2aff None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:17.864571 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-e397d022-e873-4715-b59a-6bd0878c2aff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:33:17.864571 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:17.864571 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:17.864571 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:17.864571 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:17.864571 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:17.864571 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:17.864571 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:17.864571 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:17.864571 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:17.864571 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:17.864571 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:17.864571 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:33:17.864571 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:33:17.864571 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:33:17.864571 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:33:17.865735 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:17.865735 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:17.865735 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:17.865735 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:17.865735 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:17.865735 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:17.865735 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:17.865735 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:17.865735 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:17.865735 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:17.865735 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:17.865735 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:17.865735 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:17.865735 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:17.865735 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:17.865735 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:17.865735 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:33:17.866772 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:33:17.866772 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:33:17.866772 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:33:17.868545 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 478/938] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:33:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:33:17.874540 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe8d718-4f5c-44c8-b5ae-eed94ccd50d4 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:17.929065 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a051646-b8f3-4b1a-a936-e805865ce9e2 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:17.929253 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a051646-b8f3-4b1a-a936-e805865ce9e2 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:17.929553 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a051646-b8f3-4b1a-a936-e805865ce9e2 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:17.931152 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 479/939] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:33:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:33:17.936162 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d81122f-d02e-40b8-9fd2-db7140a22366 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:17.936445 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d81122f-d02e-40b8-9fd2-db7140a22366 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:17.936717 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d81122f-d02e-40b8-9fd2-db7140a22366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:17.956793 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-8d81122f-d02e-40b8-9fd2-db7140a22366 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:17.958519 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-8d81122f-d02e-40b8-9fd2-db7140a22366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:17.992686 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe8d718-4f5c-44c8-b5ae-eed94ccd50d4 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:17.996887 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:18.047344 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d5d61-e543-48b1-b8e3-82ada6185eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:18.048541 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d5d61-e543-48b1-b8e3-82ada6185eea None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:18.049071 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d5d61-e543-48b1-b8e3-82ada6185eea None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:18.049633 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d5d61-e543-48b1-b8e3-82ada6185eea None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:18.049761 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 480/940] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:33:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:33:18.055382 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211d5d61-e543-48b1-b8e3-82ada6185eea None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:18.055382 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211d5d61-e543-48b1-b8e3-82ada6185eea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:18.055915 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211d5d61-e543-48b1-b8e3-82ada6185eea None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:18.068453 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 461/941] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:33:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:18.074147 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d81122f-d02e-40b8-9fd2-db7140a22366 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:18.080402 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ba90e-650f-4ee3-a1e0-917ac528ebca None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:18.080691 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ba90e-650f-4ee3-a1e0-917ac528ebca None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:18.080972 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ba90e-650f-4ee3-a1e0-917ac528ebca None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:18.082587 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 462/942] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:33:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:33:18.088197 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434c647-e9ce-4319-a2d5-e3da36fe4738 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:18.088490 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434c647-e9ce-4319-a2d5-e3da36fe4738 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:18.088817 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434c647-e9ce-4319-a2d5-e3da36fe4738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:18.111163 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-6434c647-e9ce-4319-a2d5-e3da36fe4738 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:18.112374 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-6434c647-e9ce-4319-a2d5-e3da36fe4738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:18.164350 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:18.190806 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d81122f-d02e-40b8-9fd2-db7140a22366 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:18.197564 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 463/943] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:33:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:33:18.235241 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac6553-67da-446c-8691-131adb67fa67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:18.235868 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac6553-67da-446c-8691-131adb67fa67 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:18.236148 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac6553-67da-446c-8691-131adb67fa67 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:18.236419 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac6553-67da-446c-8691-131adb67fa67 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:18.244243 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ac6553-67da-446c-8691-131adb67fa67 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:18.245725 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ac6553-67da-446c-8691-131adb67fa67 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:18.258292 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-29ac6553-67da-446c-8691-131adb67fa67 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:33:18.258292 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:18.258292 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:18.258292 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:18.258292 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:18.258292 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:18.258292 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:18.258292 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:18.258292 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:18.258292 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:18.258292 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:18.258292 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:18.258292 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:33:18.258292 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:33:18.258292 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:33:18.259159 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:33:18.259159 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:18.259159 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:18.259159 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:18.259159 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:18.259159 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:18.259159 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:18.259159 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:18.259159 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:18.259159 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:18.259159 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:18.259159 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:18.259159 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:18.259159 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:18.259159 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:18.259159 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:18.259159 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:18.260022 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:33:18.260022 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:33:18.260022 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:33:18.260022 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:33:18.260022 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:33:18.260022 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:33:18.260022 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:33:18.260022 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:33:18.260022 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 481/944] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Aug 29 22:33:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:33:18.265634 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6434c647-e9ce-4319-a2d5-e3da36fe4738 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:18.354191 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac6553-67da-446c-8691-131adb67fa67 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:18.379222 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:18.387481 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6434c647-e9ce-4319-a2d5-e3da36fe4738 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:18.427128 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4111cc15-b2e6-4e72-acee-d6605344fb37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:18.428403 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111cc15-b2e6-4e72-acee-d6605344fb37 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:18.428683 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111cc15-b2e6-4e72-acee-d6605344fb37 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:18.428957 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111cc15-b2e6-4e72-acee-d6605344fb37 None admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:18.429846 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4111cc15-b2e6-4e72-acee-d6605344fb37 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:18.430160 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4111cc15-b2e6-4e72-acee-d6605344fb37 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:18.431615 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4111cc15-b2e6-4e72-acee-d6605344fb37 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:18.449758 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 464/945] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Aug 29 22:33:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:18.451356 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4111cc15-b2e6-4e72-acee-d6605344fb37 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:18.492012 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac6553-67da-446c-8691-131adb67fa67 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:18.530578 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190bf06b-852d-48f3-9458-e04cc9ea4a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:18.531250 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190bf06b-852d-48f3-9458-e04cc9ea4a8b None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:18.531528 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190bf06b-852d-48f3-9458-e04cc9ea4a8b None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:18.531798 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190bf06b-852d-48f3-9458-e04cc9ea4a8b None admin] PATH_INFO: `/v3/services/compute` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:18.532367 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190bf06b-852d-48f3-9458-e04cc9ea4a8b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:18.533750 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190bf06b-852d-48f3-9458-e04cc9ea4a8b None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:18.535611 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:18.543782 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-190bf06b-852d-48f3-9458-e04cc9ea4a8b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 22:33:18.543782 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:18.543782 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:33:18.543782 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:33:18.543782 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:33:18.543782 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:33:18.543782 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:33:18.543782 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:33:18.543782 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 22:33:18.543782 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:33:18.543782 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:33:18.543782 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:33:18.543782 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:18.543782 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:18.543782 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:18.543782 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:18.543782 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:18.544788 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:18.544788 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:18.544788 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:18.544788 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:18.544788 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:18.544788 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:18.544788 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:33:18.544788 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:33:18.544788 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:33:18.544788 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:33:18.544788 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:18.544788 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:18.544788 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:18.544788 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:18.544788 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:18.544788 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:18.545640 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:18.545640 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:18.545640 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:18.545640 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:18.545640 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:18.545640 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:18.545640 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:18.545640 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:18.545640 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:18.545640 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:18.545640 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:33:18.545640 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:33:18.545640 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 22:33:18.545640 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:33:18.553664 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 482/946] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Aug 29 22:33:18 2022] GET /identity/v3/services/compute => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:33:18.554202 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190bf06b-852d-48f3-9458-e04cc9ea4a8b None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:18.569740 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4111cc15-b2e6-4e72-acee-d6605344fb37 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:18.606649 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef59e4-97e3-4362-8814-8a12d0c49cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:18.607310 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef59e4-97e3-4362-8814-8a12d0c49cce None admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:18.607592 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef59e4-97e3-4362-8814-8a12d0c49cce None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:18.607876 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef59e4-97e3-4362-8814-8a12d0c49cce None admin] PATH_INFO: `/v3/projects/ce09f0beb1a342febbb4a8b3c7cf60c2/users/e49a4666712746d098ace9e1cb0bf07c/roles/ad49d96eb9164c789bc74d8748e637b5` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:18.610092 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ef59e4-97e3-4362-8814-8a12d0c49cce None admin] RBAC: Authorizing `identity:create_grant(project_id=ce09f0beb1a342febbb4a8b3c7cf60c2, user_id=e49a4666712746d098ace9e1cb0bf07c, role_id=ad49d96eb9164c789bc74d8748e637b5)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:18.611525 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ef59e4-97e3-4362-8814-8a12d0c49cce None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:18.626955 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 465/947] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Aug 29 22:33:18 2022] PUT /identity/v3/projects/ce09f0beb1a342febbb4a8b3c7cf60c2/users/e49a4666712746d098ace9e1cb0bf07c/roles/ad49d96eb9164c789bc74d8748e637b5 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:33:18.630672 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef59e4-97e3-4362-8814-8a12d0c49cce None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:18.660663 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:18.682361 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190bf06b-852d-48f3-9458-e04cc9ea4a8b None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:18.735510 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec0a9b-4c80-4d9a-b1d7-9e31aa5a6e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:18.736989 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec0a9b-4c80-4d9a-b1d7-9e31aa5a6e48 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:18.737610 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec0a9b-4c80-4d9a-b1d7-9e31aa5a6e48 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:18.738105 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec0a9b-4c80-4d9a-b1d7-9e31aa5a6e48 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:18.738957 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fec0a9b-4c80-4d9a-b1d7-9e31aa5a6e48 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:18.740965 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fec0a9b-4c80-4d9a-b1d7-9e31aa5a6e48 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:18.754113 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-8fec0a9b-4c80-4d9a-b1d7-9e31aa5a6e48 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 22:33:18.754113 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:18.754113 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:33:18.754113 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:33:18.754113 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:33:18.754113 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:33:18.754113 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:33:18.754113 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:33:18.754113 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 22:33:18.754113 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:33:18.754113 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:33:18.754113 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:33:18.754113 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:18.754113 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:18.754113 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:18.754113 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:18.754113 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:18.755159 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:18.755159 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:18.755159 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:18.755159 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:18.755159 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:18.755159 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:18.755159 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:33:18.755159 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:33:18.755159 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:33:18.755159 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:33:18.755159 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:18.755159 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:18.755159 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:18.755159 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:18.755159 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:18.755159 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:18.756236 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:18.756236 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:18.756236 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:18.756236 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:18.756236 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:18.756236 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:18.756236 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:18.756236 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:18.756236 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:18.756236 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:18.756236 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:33:18.756236 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:33:18.756236 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 22:33:18.756236 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:33:18.756236 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 483/948] 10.222.0.47 () {56 vars in 1126 bytes} [Mon Aug 29 22:33:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:33:18.762152 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec0a9b-4c80-4d9a-b1d7-9e31aa5a6e48 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:18.769089 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef59e4-97e3-4362-8814-8a12d0c49cce None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:18.822578 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cddf30-5717-4c2e-9171-ef171fd8ec53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:18.823209 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cddf30-5717-4c2e-9171-ef171fd8ec53 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:18.823488 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cddf30-5717-4c2e-9171-ef171fd8ec53 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:18.823762 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cddf30-5717-4c2e-9171-ef171fd8ec53 None admin] PATH_INFO: `/v3/services` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:18.824414 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cddf30-5717-4c2e-9171-ef171fd8ec53 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:18.824719 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cddf30-5717-4c2e-9171-ef171fd8ec53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:18.826122 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cddf30-5717-4c2e-9171-ef171fd8ec53 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:18.831944 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 466/949] 10.222.0.47 () {56 vars in 1112 bytes} [Mon Aug 29 22:33:18 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:18.838421 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cddf30-5717-4c2e-9171-ef171fd8ec53 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:18.843867 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:18.896589 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec0a9b-4c80-4d9a-b1d7-9e31aa5a6e48 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:18.933441 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af08f75-e00a-49e3-be2f-bd2033d3a56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:18.934051 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af08f75-e00a-49e3-be2f-bd2033d3a56b None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:18.934332 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af08f75-e00a-49e3-be2f-bd2033d3a56b None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:18.934604 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af08f75-e00a-49e3-be2f-bd2033d3a56b None admin] PATH_INFO: `/v3/services` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:18.935237 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af08f75-e00a-49e3-be2f-bd2033d3a56b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:18.935540 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af08f75-e00a-49e3-be2f-bd2033d3a56b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:18.936937 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af08f75-e00a-49e3-be2f-bd2033d3a56b None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:18.942182 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 484/950] 10.222.0.47 () {56 vars in 1122 bytes} [Mon Aug 29 22:33:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:18.948169 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af08f75-e00a-49e3-be2f-bd2033d3a56b None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:18.952530 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:18.971869 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cddf30-5717-4c2e-9171-ef171fd8ec53 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:19.010929 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b32487-a69f-466d-b0f4-264daa967fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:19.011567 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b32487-a69f-466d-b0f4-264daa967fa0 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:19.011779 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b32487-a69f-466d-b0f4-264daa967fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:19.011985 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b32487-a69f-466d-b0f4-264daa967fa0 None admin] PATH_INFO: `/v3/services` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:19.012625 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b32487-a69f-466d-b0f4-264daa967fa0 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:19.012926 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b32487-a69f-466d-b0f4-264daa967fa0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:19.014325 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b32487-a69f-466d-b0f4-264daa967fa0 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:19.025374 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 467/951] 10.222.0.47 () {56 vars in 1112 bytes} [Mon Aug 29 22:33:18 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:19.080658 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af08f75-e00a-49e3-be2f-bd2033d3a56b None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:19.111021 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:19.121209 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ad6c8-c523-4810-b34d-56112c2f518f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:19.121871 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ad6c8-c523-4810-b34d-56112c2f518f None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:19.122150 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ad6c8-c523-4810-b34d-56112c2f518f None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:19.122420 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ad6c8-c523-4810-b34d-56112c2f518f None admin] PATH_INFO: `/v3/services` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:19.123070 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6ad6c8-c523-4810-b34d-56112c2f518f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:19.123369 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6ad6c8-c523-4810-b34d-56112c2f518f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:19.124770 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6ad6c8-c523-4810-b34d-56112c2f518f None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:19.131257 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 485/952] 10.222.0.47 () {56 vars in 1122 bytes} [Mon Aug 29 22:33:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:19.142482 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b32487-a69f-466d-b0f4-264daa967fa0 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:19.255159 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b32487-a69f-466d-b0f4-264daa967fa0 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:19.292312 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e497e-5969-4868-a421-047dee0d0b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:19.292845 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e497e-5969-4868-a421-047dee0d0b45 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:19.293125 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e497e-5969-4868-a421-047dee0d0b45 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:19.293425 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e497e-5969-4868-a421-047dee0d0b45 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:19.294212 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400e497e-5969-4868-a421-047dee0d0b45 None admin] RBAC: Adding query filter params (interface=public, service_id=6384dd6451874dd8818978677dfbbb26, region_id=RegionOne) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:19.294523 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400e497e-5969-4868-a421-047dee0d0b45 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:19.295952 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400e497e-5969-4868-a421-047dee0d0b45 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:19.301798 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 468/953] 10.222.0.47 () {56 vars in 1251 bytes} [Mon Aug 29 22:33:19 2022] GET /identity/v3/endpoints?service_id=6384dd6451874dd8818978677dfbbb26&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:19.307757 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ad6c8-c523-4810-b34d-56112c2f518f None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:19.413898 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ad6c8-c523-4810-b34d-56112c2f518f None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:19.449505 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10caf5f7-e95d-4274-941b-a8832c48e5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:19.450402 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10caf5f7-e95d-4274-941b-a8832c48e5bb None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:19.450836 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10caf5f7-e95d-4274-941b-a8832c48e5bb None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:19.451248 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10caf5f7-e95d-4274-941b-a8832c48e5bb None admin] PATH_INFO: `/v3/services` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:19.452000 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10caf5f7-e95d-4274-941b-a8832c48e5bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:19.453524 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10caf5f7-e95d-4274-941b-a8832c48e5bb None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:19.460726 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 486/954] 10.222.0.47 () {56 vars in 1087 bytes} [Mon Aug 29 22:33:19 2022] GET /identity/v3/services => generated 1497 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:33:19.739695 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c5178b-c171-4610-aaa8-e44bcd23278a None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:19.739999 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c5178b-c171-4610-aaa8-e44bcd23278a None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:19.740378 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c5178b-c171-4610-aaa8-e44bcd23278a None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:19.742019 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 469/955] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:33:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:33:19.747616 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193c37b-c96c-42ff-a04c-6e81730444dc None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:19.747913 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193c37b-c96c-42ff-a04c-6e81730444dc None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:19.748184 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193c37b-c96c-42ff-a04c-6e81730444dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:19.767030 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-3193c37b-c96c-42ff-a04c-6e81730444dc None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:19.768247 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-3193c37b-c96c-42ff-a04c-6e81730444dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:19.822272 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:19.845464 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 487/956] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:33:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:33:20.118770 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c5178b-c171-4610-aaa8-e44bcd23278a None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:20.128566 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:20.232324 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c5178b-c171-4610-aaa8-e44bcd23278a None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:20.268602 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11255e-3702-436a-827a-886a7cfd8343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:20.269216 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11255e-3702-436a-827a-886a7cfd8343 None admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:20.269533 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11255e-3702-436a-827a-886a7cfd8343 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:20.269810 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11255e-3702-436a-827a-886a7cfd8343 None admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:20.270468 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed11255e-3702-436a-827a-886a7cfd8343 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:20.272525 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed11255e-3702-436a-827a-886a7cfd8343 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:20.276028 dv-cinder-854270-4-smb devstack@keystone.service[88338]: WARNING keystone.server.flask.common [None req-ed11255e-3702-436a-827a-886a7cfd8343 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 29 22:33:20.289658 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.sql.core [None req-ed11255e-3702-436a-827a-886a7cfd8343 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 29 22:33:20.289658 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 29 22:33:20.289658 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [parameters: {'user_id': 'a2f3a3f89d834a488473a74b3eeeabf7', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 29 22:33:20.289658 dv-cinder-854270-4-smb devstack@keystone.service[88338]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88338) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 29 22:33:20.297218 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-ed11255e-3702-436a-827a-886a7cfd8343 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 29 22:33:20.297218 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:20.297218 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 22:33:20.297218 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 22:33:20.297218 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 22:33:20.297218 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 22:33:20.297218 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 22:33:20.297218 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 22:33:20.297218 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 22:33:20.297218 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application conn.query(q) Aug 29 22:33:20.297218 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 22:33:20.297218 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 22:33:20.297218 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 22:33:20.297218 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application result.read() Aug 29 22:33:20.297218 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 22:33:20.298148 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 22:33:20.298148 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 22:33:20.298148 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 22:33:20.298148 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 22:33:20.298148 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 22:33:20.298148 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 22:33:20.298148 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 22:33:20.298148 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 29 22:33:20.298148 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:33:20.298148 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 29 22:33:20.298148 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:33:20.298148 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:20.298148 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 29 22:33:20.298148 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 29 22:33:20.298148 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 29 22:33:20.298148 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 29 22:33:20.298148 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 22:33:20.298148 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application next(self.gen) Aug 29 22:33:20.299128 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 29 22:33:20.299128 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application yield resource Aug 29 22:33:20.299128 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 22:33:20.299128 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application next(self.gen) Aug 29 22:33:20.299128 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 29 22:33:20.299128 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application self.session.rollback() Aug 29 22:33:20.299128 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 22:33:20.299128 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application self.force_reraise() Aug 29 22:33:20.299128 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 22:33:20.299128 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise self.value Aug 29 22:33:20.299128 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 29 22:33:20.299128 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 29 22:33:20.299128 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 29 22:33:20.299128 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application session.commit() Aug 29 22:33:20.299128 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 29 22:33:20.299128 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 29 22:33:20.299128 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 29 22:33:20.300114 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application self._prepare_impl() Aug 29 22:33:20.300114 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 29 22:33:20.300114 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application self.session.flush() Aug 29 22:33:20.300114 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 29 22:33:20.300114 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application self._flush(objects) Aug 29 22:33:20.300114 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 29 22:33:20.300114 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 29 22:33:20.300114 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 29 22:33:20.300114 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application compat.raise_( Aug 29 22:33:20.300114 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 22:33:20.300114 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception Aug 29 22:33:20.300114 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 29 22:33:20.300114 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application flush_context.execute() Aug 29 22:33:20.300114 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 29 22:33:20.300114 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rec.execute(self) Aug 29 22:33:20.300114 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 29 22:33:20.300114 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 29 22:33:20.301054 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 29 22:33:20.301054 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 29 22:33:20.301054 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 29 22:33:20.301054 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 29 22:33:20.301054 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 29 22:33:20.301054 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 29 22:33:20.301054 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 29 22:33:20.301054 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 29 22:33:20.301054 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 29 22:33:20.301054 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 29 22:33:20.301054 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 29 22:33:20.301054 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 29 22:33:20.301054 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 29 22:33:20.301054 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 29 22:33:20.301054 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 22:33:20.301054 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception Aug 29 22:33:20.305858 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 22:33:20.305858 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 22:33:20.305858 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 22:33:20.305858 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 22:33:20.305858 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 22:33:20.305858 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 22:33:20.305858 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 22:33:20.305858 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application conn.query(q) Aug 29 22:33:20.305858 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 22:33:20.305858 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 22:33:20.305858 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 22:33:20.305858 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application result.read() Aug 29 22:33:20.305858 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 22:33:20.305858 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 22:33:20.305858 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 22:33:20.305858 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 22:33:20.307860 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 22:33:20.307860 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 22:33:20.307860 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 22:33:20.307860 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 22:33:20.307860 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 29 22:33:20.307860 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 29 22:33:20.307860 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [parameters: {'user_id': 'a2f3a3f89d834a488473a74b3eeeabf7', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 29 22:33:20.307860 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 29 22:33:20.307860 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:33:20.307860 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:33:20.307860 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:33:20.307860 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:20.307860 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:20.307860 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:20.307860 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:20.310472 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:20.310472 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:20.310472 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:20.310472 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:20.310472 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:20.310472 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:20.310472 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:20.310472 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 29 22:33:20.310472 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 29 22:33:20.310472 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:20.310472 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:20.310472 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:33:20.310472 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:33:20.310472 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:33:20.310472 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:33:20.310472 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 29 22:33:20.310472 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 29 22:33:20.311437 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 29 22:33:20.311437 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 29 22:33:20.311437 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 29 22:33:20.311437 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 29 22:33:20.311437 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 29 22:33:20.311437 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:33:20.311437 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 470/957] 10.222.0.47 () {60 vars in 1131 bytes} [Mon Aug 29 22:33:20 2022] POST /identity/v3/users => generated 160 bytes in 180 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:33:20.311833 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3193c37b-c96c-42ff-a04c-6e81730444dc None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:20.421403 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3193c37b-c96c-42ff-a04c-6e81730444dc None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:20.456504 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa23370-da54-41e1-a979-87b367b97c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:20.457118 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa23370-da54-41e1-a979-87b367b97c4a None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:20.457421 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa23370-da54-41e1-a979-87b367b97c4a None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:20.457689 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa23370-da54-41e1-a979-87b367b97c4a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:20.465754 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa23370-da54-41e1-a979-87b367b97c4a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:20.467202 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa23370-da54-41e1-a979-87b367b97c4a None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:20.480034 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-1fa23370-da54-41e1-a979-87b367b97c4a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 22:33:20.480034 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:20.480034 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:20.480034 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:20.480034 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:20.480034 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:20.480034 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:20.480034 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:20.480034 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:20.480034 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:20.480034 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:20.480034 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:20.480034 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:33:20.480034 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:33:20.480034 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:33:20.480034 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:33:20.481407 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:20.481407 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:20.481407 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:33:20.481407 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:33:20.481407 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:33:20.481407 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:33:20.481407 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:20.481407 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:20.481407 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:20.481407 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:20.481407 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:20.481407 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:20.481407 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:20.481407 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:20.481407 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:20.481407 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:20.481407 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:20.481407 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:20.483612 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:20.483612 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:20.483612 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:33:20.483612 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:33:20.483612 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:33:20.483612 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:33:20.483612 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:33:20.483612 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:33:20.483612 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 22:33:20.483612 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:33:20.483612 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 488/958] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Aug 29 22:33:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:33:20.487383 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11255e-3702-436a-827a-886a7cfd8343 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:20.560043 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:20.603649 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11255e-3702-436a-827a-886a7cfd8343 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:20.641044 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b579603-3bed-4c22-98b8-0de7010d4215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:20.641963 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b579603-3bed-4c22-98b8-0de7010d4215 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:20.642388 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b579603-3bed-4c22-98b8-0de7010d4215 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:20.642822 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b579603-3bed-4c22-98b8-0de7010d4215 None admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:20.643680 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b579603-3bed-4c22-98b8-0de7010d4215 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:20.644140 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b579603-3bed-4c22-98b8-0de7010d4215 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:20.645967 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b579603-3bed-4c22-98b8-0de7010d4215 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:20.689789 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 471/959] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Aug 29 22:33:20 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:20.738355 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f0d268-c3c6-4306-8cbb-5d92f6262a55 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:20.738638 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f0d268-c3c6-4306-8cbb-5d92f6262a55 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:20.738911 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f0d268-c3c6-4306-8cbb-5d92f6262a55 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:20.741698 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 489/960] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:33:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:33:20.747608 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70fdadc-98b8-47c5-8b67-4dfb4c7f9567 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:20.747867 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70fdadc-98b8-47c5-8b67-4dfb4c7f9567 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:20.748142 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70fdadc-98b8-47c5-8b67-4dfb4c7f9567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:20.767917 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-e70fdadc-98b8-47c5-8b67-4dfb4c7f9567 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:20.769570 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-e70fdadc-98b8-47c5-8b67-4dfb4c7f9567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:20.847876 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 472/961] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:33:20 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:33:21.128852 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f0d268-c3c6-4306-8cbb-5d92f6262a55 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:21.152231 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc21ae8-ba4b-4043-bb21-58f5023fcb3c None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:21.152777 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc21ae8-ba4b-4043-bb21-58f5023fcb3c None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:21.152777 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc21ae8-ba4b-4043-bb21-58f5023fcb3c None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:21.154673 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 473/962] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:33:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:33:21.159640 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94732204-8bad-4ad1-a5e5-f388eea28187 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:21.159922 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94732204-8bad-4ad1-a5e5-f388eea28187 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:21.160197 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94732204-8bad-4ad1-a5e5-f388eea28187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:21.178370 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-94732204-8bad-4ad1-a5e5-f388eea28187 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:21.179788 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-94732204-8bad-4ad1-a5e5-f388eea28187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:21.184011 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:21.238408 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:21.247409 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f0d268-c3c6-4306-8cbb-5d92f6262a55 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:21.258789 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 474/963] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:33:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:33:21.285811 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9252c06-3167-4990-9000-9c01b66e952f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:21.286434 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9252c06-3167-4990-9000-9c01b66e952f None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:21.286734 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9252c06-3167-4990-9000-9c01b66e952f None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:21.287006 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9252c06-3167-4990-9000-9c01b66e952f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:21.297563 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9252c06-3167-4990-9000-9c01b66e952f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:33:21.305378 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-c9252c06-3167-4990-9000-9c01b66e952f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 22:33:21.305378 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:21.305378 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:21.305378 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:21.305378 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:21.305378 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:21.305378 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:21.305378 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:21.305378 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:21.305378 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:21.305378 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:21.305378 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:21.305378 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:33:21.305378 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:33:21.305378 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:33:21.305378 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:33:21.306345 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:33:21.306345 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:33:21.306345 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:33:21.306345 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:33:21.306345 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:21.306345 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:21.306345 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:21.306345 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:21.306345 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:21.306345 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:21.306345 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:21.306345 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:21.306345 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:21.306345 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:21.306345 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:21.306345 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:21.307171 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:21.307171 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:21.307171 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:21.307171 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:21.307171 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:33:21.307171 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:33:21.307171 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:33:21.307171 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:33:21.307171 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:33:21.307171 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:33:21.307171 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 22:33:21.307171 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:33:21.307171 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 490/964] 10.222.0.47 () {56 vars in 1120 bytes} [Mon Aug 29 22:33:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:33:21.312435 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94732204-8bad-4ad1-a5e5-f388eea28187 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:21.417173 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94732204-8bad-4ad1-a5e5-f388eea28187 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:21.452208 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85034bcb-d6d4-41a7-981d-2eec557c3f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:21.452817 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85034bcb-d6d4-41a7-981d-2eec557c3f5f None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:21.453099 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85034bcb-d6d4-41a7-981d-2eec557c3f5f None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:21.453395 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85034bcb-d6d4-41a7-981d-2eec557c3f5f None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:21.454062 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85034bcb-d6d4-41a7-981d-2eec557c3f5f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:21.454364 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85034bcb-d6d4-41a7-981d-2eec557c3f5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:21.455725 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85034bcb-d6d4-41a7-981d-2eec557c3f5f None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:21.462746 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f482321-0d4b-426f-b294-5546a187a03e None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:21.463236 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f482321-0d4b-426f-b294-5546a187a03e None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:21.463314 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f482321-0d4b-426f-b294-5546a187a03e None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:21.464595 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 475/965] 10.222.0.47 () {56 vars in 1115 bytes} [Mon Aug 29 22:33:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:21.464716 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 491/966] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:33:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:33:21.469689 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1791fe-4754-4a3f-878a-c505396ee674 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:21.469977 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1791fe-4754-4a3f-878a-c505396ee674 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:21.470079 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f482321-0d4b-426f-b294-5546a187a03e None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:21.470247 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1791fe-4754-4a3f-878a-c505396ee674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:21.492442 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-2b1791fe-4754-4a3f-878a-c505396ee674 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:21.493705 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-2b1791fe-4754-4a3f-878a-c505396ee674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:21.545718 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:21.570028 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 476/967] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:33:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:33:21.570655 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1791fe-4754-4a3f-878a-c505396ee674 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:21.583330 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f482321-0d4b-426f-b294-5546a187a03e None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:21.586598 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:21.622891 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42c0a1e-5f35-4824-a568-9073a3629258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:21.623521 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c0a1e-5f35-4824-a568-9073a3629258 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:21.623801 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c0a1e-5f35-4824-a568-9073a3629258 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:21.624375 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c0a1e-5f35-4824-a568-9073a3629258 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:21.635238 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42c0a1e-5f35-4824-a568-9073a3629258 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:21.636692 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42c0a1e-5f35-4824-a568-9073a3629258 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:21.652937 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-a42c0a1e-5f35-4824-a568-9073a3629258 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:33:21.652937 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:21.652937 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:21.652937 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:21.652937 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:21.652937 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:21.652937 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:21.652937 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:21.652937 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:21.652937 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:21.652937 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:21.652937 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:21.652937 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:33:21.652937 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:33:21.652937 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:33:21.652937 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:33:21.654030 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:21.654030 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:21.654030 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:21.654030 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:21.654030 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:21.654030 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:21.654030 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:21.654030 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:21.654030 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:21.654030 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:21.654030 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:21.654030 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:21.654030 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:21.654030 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:21.654030 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:21.654030 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:21.654030 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:33:21.654904 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:33:21.654904 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:33:21.654904 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:33:21.654904 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 492/968] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:33:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:33:21.659960 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42c0a1e-5f35-4824-a568-9073a3629258 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:21.680705 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1791fe-4754-4a3f-878a-c505396ee674 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:21.720461 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd207c-5a47-458b-bd3e-2e12b88a26de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:21.721070 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd207c-5a47-458b-bd3e-2e12b88a26de None admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:21.721374 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd207c-5a47-458b-bd3e-2e12b88a26de None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:21.721657 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd207c-5a47-458b-bd3e-2e12b88a26de None admin] PATH_INFO: `/v3/services` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:21.722340 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dd207c-5a47-458b-bd3e-2e12b88a26de None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:21.723707 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dd207c-5a47-458b-bd3e-2e12b88a26de None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:21.745399 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 477/969] 10.222.0.47 () {60 vars in 1141 bytes} [Mon Aug 29 22:33:21 2022] POST /identity/v3/services => generated 242 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:33:21.776257 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42c0a1e-5f35-4824-a568-9073a3629258 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:21.824983 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90fef07-0cb1-4cba-a56e-e271a0c556c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:21.825882 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90fef07-0cb1-4cba-a56e-e271a0c556c7 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:21.826353 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90fef07-0cb1-4cba-a56e-e271a0c556c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:21.826809 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90fef07-0cb1-4cba-a56e-e271a0c556c7 None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:21.827656 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90fef07-0cb1-4cba-a56e-e271a0c556c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:21.828104 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90fef07-0cb1-4cba-a56e-e271a0c556c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:21.829669 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90fef07-0cb1-4cba-a56e-e271a0c556c7 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:21.842087 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd207c-5a47-458b-bd3e-2e12b88a26de None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:21.843378 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 493/970] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:33:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:33:21.850103 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90fef07-0cb1-4cba-a56e-e271a0c556c7 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:21.866534 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:21.903046 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:21.969349 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90fef07-0cb1-4cba-a56e-e271a0c556c7 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:21.980273 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd207c-5a47-458b-bd3e-2e12b88a26de None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:22.004289 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef5187-509f-424f-bbd6-ca3871328ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:22.004918 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef5187-509f-424f-bbd6-ca3871328ef4 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:22.005194 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef5187-509f-424f-bbd6-ca3871328ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:22.005648 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef5187-509f-424f-bbd6-ca3871328ef4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:22.013473 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ef5187-509f-424f-bbd6-ca3871328ef4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:22.014943 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ef5187-509f-424f-bbd6-ca3871328ef4 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:22.018362 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6c73b3-3bee-4334-8806-b918a0188a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:22.019158 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c73b3-3bee-4334-8806-b918a0188a19 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:22.019576 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c73b3-3bee-4334-8806-b918a0188a19 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:22.019995 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c73b3-3bee-4334-8806-b918a0188a19 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:22.020745 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6c73b3-3bee-4334-8806-b918a0188a19 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:22.022671 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6c73b3-3bee-4334-8806-b918a0188a19 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:22.026974 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-e4ef5187-509f-424f-bbd6-ca3871328ef4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 22:33:22.026974 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:22.026974 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:22.026974 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:22.026974 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:22.026974 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:22.026974 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:22.026974 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:22.026974 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:22.026974 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:22.026974 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:22.026974 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:22.026974 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:33:22.026974 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:33:22.026974 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:33:22.026974 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:33:22.027906 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:22.027906 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:22.027906 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:33:22.027906 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:33:22.027906 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:33:22.027906 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:33:22.027906 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:22.027906 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:22.027906 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:22.027906 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:22.027906 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:22.027906 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:22.027906 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:22.027906 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:22.027906 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:22.027906 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:22.027906 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:22.027906 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:22.028833 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:22.028833 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:22.028833 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:33:22.028833 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:33:22.028833 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:33:22.028833 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:33:22.028833 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:33:22.028833 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:33:22.028833 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 22:33:22.028833 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:33:22.028833 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 494/971] 10.222.0.47 () {56 vars in 1117 bytes} [Mon Aug 29 22:33:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:33:22.033237 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-1c6c73b3-3bee-4334-8806-b918a0188a19 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 22:33:22.033237 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:22.033237 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:33:22.033237 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:33:22.033237 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:33:22.033237 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:33:22.033237 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:33:22.033237 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:33:22.033237 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 22:33:22.033237 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:33:22.033237 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:33:22.033237 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:33:22.033237 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:22.033237 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:22.033237 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:22.033237 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:22.033237 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:22.034246 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:22.034246 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:22.034246 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:22.034246 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:22.034246 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:22.034246 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:22.034246 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:33:22.034246 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:33:22.034246 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:33:22.034246 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:33:22.034246 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:22.034246 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:22.034246 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:22.034246 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:22.034246 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:22.034246 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:22.035997 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:22.035997 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:22.035997 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:22.035997 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:22.035997 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:22.035997 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:22.035997 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:22.035997 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:22.035997 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:22.035997 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:22.035997 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:33:22.035997 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:33:22.035997 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 22:33:22.035997 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:33:22.037620 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef5187-509f-424f-bbd6-ca3871328ef4 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:22.037815 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 478/972] 10.222.0.47 () {56 vars in 1126 bytes} [Mon Aug 29 22:33:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:33:22.041186 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6c73b3-3bee-4334-8806-b918a0188a19 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:22.110097 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:22.143138 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef5187-509f-424f-bbd6-ca3871328ef4 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:22.154227 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6c73b3-3bee-4334-8806-b918a0188a19 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:22.156033 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:22.181451 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8191708c-24d0-46a4-8954-103987081bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:22.182065 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191708c-24d0-46a4-8954-103987081bed None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:22.182344 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191708c-24d0-46a4-8954-103987081bed None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:22.182617 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191708c-24d0-46a4-8954-103987081bed None admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:22.183351 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8191708c-24d0-46a4-8954-103987081bed None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:22.183657 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8191708c-24d0-46a4-8954-103987081bed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:22.185102 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8191708c-24d0-46a4-8954-103987081bed None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:22.193748 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5901f8c-13a1-40b1-ba80-6f5c013e4cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:22.194838 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5901f8c-13a1-40b1-ba80-6f5c013e4cc0 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:22.195444 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5901f8c-13a1-40b1-ba80-6f5c013e4cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:22.195732 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5901f8c-13a1-40b1-ba80-6f5c013e4cc0 None admin] PATH_INFO: `/v3/services` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:22.196372 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5901f8c-13a1-40b1-ba80-6f5c013e4cc0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:22.196670 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5901f8c-13a1-40b1-ba80-6f5c013e4cc0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:22.198050 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5901f8c-13a1-40b1-ba80-6f5c013e4cc0 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:22.209644 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 495/973] 10.222.0.47 () {56 vars in 1149 bytes} [Mon Aug 29 22:33:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:22.209897 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 479/974] 10.222.0.47 () {56 vars in 1122 bytes} [Mon Aug 29 22:33:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:33:22.210040 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8191708c-24d0-46a4-8954-103987081bed None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:22.215199 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5901f8c-13a1-40b1-ba80-6f5c013e4cc0 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:22.325901 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8191708c-24d0-46a4-8954-103987081bed None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:22.330779 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5901f8c-13a1-40b1-ba80-6f5c013e4cc0 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:22.357070 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:22.366596 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a610f0fc-03ed-4a5a-9330-b20241eef6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:22.367208 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a610f0fc-03ed-4a5a-9330-b20241eef6da None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:22.367489 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a610f0fc-03ed-4a5a-9330-b20241eef6da None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:22.367762 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a610f0fc-03ed-4a5a-9330-b20241eef6da None admin] PATH_INFO: `/v3/services` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:22.368397 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a610f0fc-03ed-4a5a-9330-b20241eef6da None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:22.368699 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a610f0fc-03ed-4a5a-9330-b20241eef6da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:22.369893 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c7f3de-d996-4054-93b8-958e1d03084d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:22.370101 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a610f0fc-03ed-4a5a-9330-b20241eef6da None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:22.370511 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7f3de-d996-4054-93b8-958e1d03084d None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:22.370794 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7f3de-d996-4054-93b8-958e1d03084d None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:22.371074 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7f3de-d996-4054-93b8-958e1d03084d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:22.375415 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 496/975] 10.222.0.47 () {56 vars in 1122 bytes} [Mon Aug 29 22:33:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:33:22.381091 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a610f0fc-03ed-4a5a-9330-b20241eef6da None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:22.413271 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:22.454622 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c7f3de-d996-4054-93b8-958e1d03084d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:22.456427 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c7f3de-d996-4054-93b8-958e1d03084d None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:22.491488 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a610f0fc-03ed-4a5a-9330-b20241eef6da None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:22.526014 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0537e8-4867-46d9-9583-ae33921ccaf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:22.526609 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0537e8-4867-46d9-9583-ae33921ccaf6 None admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:22.526891 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0537e8-4867-46d9-9583-ae33921ccaf6 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:22.527170 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0537e8-4867-46d9-9583-ae33921ccaf6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:22.527834 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0537e8-4867-46d9-9583-ae33921ccaf6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:22.529231 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0537e8-4867-46d9-9583-ae33921ccaf6 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:22.550271 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 497/976] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:33:22 2022] POST /identity/v3/endpoints => generated 349 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:33:22.572531 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 480/977] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Aug 29 22:33:22 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 22:33:22.578263 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0537e8-4867-46d9-9583-ae33921ccaf6 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:22.637894 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:22.704193 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0537e8-4867-46d9-9583-ae33921ccaf6 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:22.742222 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d242c8-1608-40ec-be39-e827d3741533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:22.742872 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d242c8-1608-40ec-be39-e827d3741533 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:22.743149 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d242c8-1608-40ec-be39-e827d3741533 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:22.743422 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d242c8-1608-40ec-be39-e827d3741533 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:22.756167 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d242c8-1608-40ec-be39-e827d3741533 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:22.757982 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d242c8-1608-40ec-be39-e827d3741533 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:22.773812 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-28d242c8-1608-40ec-be39-e827d3741533 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:33:22.773812 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:22.773812 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:22.773812 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:22.773812 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:22.773812 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:22.773812 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:22.773812 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:22.773812 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:22.773812 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:22.773812 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:22.773812 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:22.773812 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:33:22.773812 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:33:22.773812 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:33:22.773812 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:33:22.774786 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:22.774786 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:22.774786 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:22.774786 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:22.774786 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:22.774786 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:22.774786 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:22.774786 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:22.774786 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:22.774786 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:22.774786 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:22.774786 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:22.774786 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:22.774786 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:22.774786 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:22.774786 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:22.774786 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:33:22.775793 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:33:22.775793 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:33:22.775793 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:33:22.775793 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 498/978] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:33:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:33:22.780920 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c7f3de-d996-4054-93b8-958e1d03084d None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:22.849728 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:22.891280 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c7f3de-d996-4054-93b8-958e1d03084d None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:22.926483 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b67f9fa-1433-4978-aacf-bfd37bce4e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:22.927094 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67f9fa-1433-4978-aacf-bfd37bce4e36 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:22.927441 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67f9fa-1433-4978-aacf-bfd37bce4e36 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:22.927792 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67f9fa-1433-4978-aacf-bfd37bce4e36 None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:22.928647 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b67f9fa-1433-4978-aacf-bfd37bce4e36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:22.928871 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b67f9fa-1433-4978-aacf-bfd37bce4e36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:22.930276 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b67f9fa-1433-4978-aacf-bfd37bce4e36 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:22.942113 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 481/979] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:33:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:33:22.948082 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d242c8-1608-40ec-be39-e827d3741533 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:23.050721 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:23.057268 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d242c8-1608-40ec-be39-e827d3741533 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:23.092761 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a182fc-c764-4300-b9c4-2a5b66117e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:23.093410 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a182fc-c764-4300-b9c4-2a5b66117e1a None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:23.093692 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a182fc-c764-4300-b9c4-2a5b66117e1a None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:23.093962 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a182fc-c764-4300-b9c4-2a5b66117e1a None admin] PATH_INFO: `/v3/projects/service` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:23.101380 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a182fc-c764-4300-b9c4-2a5b66117e1a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:23.102750 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a182fc-c764-4300-b9c4-2a5b66117e1a None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:23.114100 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-16a182fc-c764-4300-b9c4-2a5b66117e1a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:33:23.114100 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:23.114100 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:23.114100 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:23.114100 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:23.114100 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:23.114100 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:23.114100 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:23.114100 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:23.114100 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:23.114100 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:23.114100 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:23.114100 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:33:23.114100 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:33:23.114100 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:33:23.115064 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:33:23.115064 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:23.115064 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:23.115064 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:23.115064 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:23.115064 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:23.115064 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:23.115064 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:23.115064 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:23.115064 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:23.115064 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:23.115064 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:23.115064 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:23.115064 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:23.115064 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:23.115064 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:23.115064 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:23.116760 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:33:23.116760 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:33:23.116760 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:33:23.116760 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:33:23.116760 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:33:23.116760 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:33:23.116760 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:33:23.116760 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:33:23.121364 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 499/980] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Aug 29 22:33:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:33:23.122240 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b67f9fa-1433-4978-aacf-bfd37bce4e36 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:23.228596 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b67f9fa-1433-4978-aacf-bfd37bce4e36 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:23.254258 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:23.264447 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2a0ef3-5398-4212-b8ef-f8b092c6b2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:23.265060 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2a0ef3-5398-4212-b8ef-f8b092c6b2fb None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:23.265350 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2a0ef3-5398-4212-b8ef-f8b092c6b2fb None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:23.265649 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2a0ef3-5398-4212-b8ef-f8b092c6b2fb None admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:23.266342 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2a0ef3-5398-4212-b8ef-f8b092c6b2fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:23.266643 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2a0ef3-5398-4212-b8ef-f8b092c6b2fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:23.268067 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2a0ef3-5398-4212-b8ef-f8b092c6b2fb None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:23.282873 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 482/981] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Aug 29 22:33:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:23.289268 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a182fc-c764-4300-b9c4-2a5b66117e1a None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:23.395724 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a182fc-c764-4300-b9c4-2a5b66117e1a None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:23.431442 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85661c44-4ec0-42fb-93b6-16815930ccc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:23.432050 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85661c44-4ec0-42fb-93b6-16815930ccc8 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:23.432327 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85661c44-4ec0-42fb-93b6-16815930ccc8 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:23.432596 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85661c44-4ec0-42fb-93b6-16815930ccc8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:23.433348 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85661c44-4ec0-42fb-93b6-16815930ccc8 None admin] RBAC: Adding query filter params (role.id=ad49d96eb9164c789bc74d8748e637b5, scope.project.id=ce09f0beb1a342febbb4a8b3c7cf60c2, user.id=e49a4666712746d098ace9e1cb0bf07c) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:23.433660 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85661c44-4ec0-42fb-93b6-16815930ccc8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:23.435094 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85661c44-4ec0-42fb-93b6-16815930ccc8 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:23.449617 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 500/982] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Aug 29 22:33:23 2022] GET /identity/v3/role_assignments?user.id=e49a4666712746d098ace9e1cb0bf07c&scope.project.id=ce09f0beb1a342febbb4a8b3c7cf60c2&role.id=ad49d96eb9164c789bc74d8748e637b5 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:23.768034 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d0cc0-63cd-4909-91ad-53133d025fe5 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:23.768322 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d0cc0-63cd-4909-91ad-53133d025fe5 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:23.768524 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d0cc0-63cd-4909-91ad-53133d025fe5 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:23.770008 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 483/983] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:33:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:33:23.774948 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661c328-1491-44b3-951d-91ec573c0dfa None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:23.775411 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661c328-1491-44b3-951d-91ec573c0dfa None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:23.775488 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661c328-1491-44b3-951d-91ec573c0dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:23.794633 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-1661c328-1491-44b3-951d-91ec573c0dfa None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:23.795818 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-1661c328-1491-44b3-951d-91ec573c0dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:23.814022 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:23.869693 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 501/984] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:33:23 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:33:24.140582 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d0cc0-63cd-4909-91ad-53133d025fe5 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:24.244367 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d0cc0-63cd-4909-91ad-53133d025fe5 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:24.284458 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4277376-ee69-40dd-935f-45b4110fdaeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:24.285080 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4277376-ee69-40dd-935f-45b4110fdaeb None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:24.285378 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4277376-ee69-40dd-935f-45b4110fdaeb None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:24.285651 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4277376-ee69-40dd-935f-45b4110fdaeb None admin] PATH_INFO: `/v3/services/compute` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:24.286223 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4277376-ee69-40dd-935f-45b4110fdaeb None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:24.287615 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4277376-ee69-40dd-935f-45b4110fdaeb None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:24.296534 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-c4277376-ee69-40dd-935f-45b4110fdaeb None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 22:33:24.296534 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:24.296534 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:33:24.296534 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:33:24.296534 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:33:24.296534 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:33:24.296534 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:33:24.296534 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:33:24.296534 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 22:33:24.296534 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:33:24.296534 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:33:24.296534 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:33:24.296534 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:24.296534 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:24.296534 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:24.296534 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:24.296534 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:24.297762 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:24.297762 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:24.297762 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:24.297762 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:24.297762 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:24.297762 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:24.297762 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:33:24.297762 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:33:24.297762 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:33:24.297762 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:33:24.297762 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:24.297762 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:24.297762 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:24.297762 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:24.297762 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:24.297762 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:24.298940 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:24.298940 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:24.298940 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:24.298940 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:24.298940 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:24.298940 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:24.298940 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:24.298940 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:24.298940 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:24.298940 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:24.298940 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:33:24.298940 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:33:24.298940 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 22:33:24.298940 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:33:24.301891 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 484/985] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Aug 29 22:33:24 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:33:24.309384 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1661c328-1491-44b3-951d-91ec573c0dfa None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:24.409149 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1661c328-1491-44b3-951d-91ec573c0dfa None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:24.449583 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0c2f2b-d1fb-4773-a541-7542d407e31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:24.450331 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c2f2b-d1fb-4773-a541-7542d407e31a None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:24.450827 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c2f2b-d1fb-4773-a541-7542d407e31a None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:24.451129 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c2f2b-d1fb-4773-a541-7542d407e31a None admin] PATH_INFO: `/v3/services` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:24.451802 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0c2f2b-d1fb-4773-a541-7542d407e31a None admin] RBAC: Adding query filter params (name=compute) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:24.452107 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0c2f2b-d1fb-4773-a541-7542d407e31a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:24.453516 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0c2f2b-d1fb-4773-a541-7542d407e31a None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:24.459097 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 502/986] 10.222.0.47 () {56 vars in 1112 bytes} [Mon Aug 29 22:33:24 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:24.464550 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4277376-ee69-40dd-935f-45b4110fdaeb None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:24.510162 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f95ee-a3e7-4583-899a-9c5b5ffd9c25 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:24.510449 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f95ee-a3e7-4583-899a-9c5b5ffd9c25 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:24.510724 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f95ee-a3e7-4583-899a-9c5b5ffd9c25 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:24.512072 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 503/987] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:33:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:33:24.517262 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e641c5-67d7-4c58-be86-313829222ce4 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:24.517815 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:24.517926 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e641c5-67d7-4c58-be86-313829222ce4 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:24.518135 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e641c5-67d7-4c58-be86-313829222ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:24.539994 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-a9e641c5-67d7-4c58-be86-313829222ce4 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:24.541351 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-a9e641c5-67d7-4c58-be86-313829222ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:24.555208 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:24.577270 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4277376-ee69-40dd-935f-45b4110fdaeb None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:24.616001 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9518f25c-5a1f-4a77-b868-1acd2d5b0531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:24.616647 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518f25c-5a1f-4a77-b868-1acd2d5b0531 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:24.616927 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518f25c-5a1f-4a77-b868-1acd2d5b0531 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:24.617200 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518f25c-5a1f-4a77-b868-1acd2d5b0531 None admin] PATH_INFO: `/v3/services` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:24.617876 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9518f25c-5a1f-4a77-b868-1acd2d5b0531 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:24.618181 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9518f25c-5a1f-4a77-b868-1acd2d5b0531 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:24.619550 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9518f25c-5a1f-4a77-b868-1acd2d5b0531 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:24.620496 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 504/988] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:33:24 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:33:24.629238 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 485/989] 10.222.0.47 () {56 vars in 1112 bytes} [Mon Aug 29 22:33:24 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:24.630371 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e641c5-67d7-4c58-be86-313829222ce4 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:24.735203 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e641c5-67d7-4c58-be86-313829222ce4 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:24.768779 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb179570-18a3-46db-acd8-d3f3ccfc2780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:24.769413 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb179570-18a3-46db-acd8-d3f3ccfc2780 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:24.769701 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb179570-18a3-46db-acd8-d3f3ccfc2780 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:24.769974 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb179570-18a3-46db-acd8-d3f3ccfc2780 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:24.770671 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb179570-18a3-46db-acd8-d3f3ccfc2780 None admin] RBAC: Adding query filter params (interface=public, service_id=cfed00943f9147a6aa63365c49327f6e, region_id=RegionOne) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:24.770977 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb179570-18a3-46db-acd8-d3f3ccfc2780 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:24.772879 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb179570-18a3-46db-acd8-d3f3ccfc2780 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:24.778140 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 505/990] 10.222.0.47 () {56 vars in 1251 bytes} [Mon Aug 29 22:33:24 2022] GET /identity/v3/endpoints?service_id=cfed00943f9147a6aa63365c49327f6e&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:24.783750 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9518f25c-5a1f-4a77-b868-1acd2d5b0531 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:24.885969 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9518f25c-5a1f-4a77-b868-1acd2d5b0531 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:24.887639 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb179570-18a3-46db-acd8-d3f3ccfc2780 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:24.900805 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:24.901639 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:24.925732 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8813dc49-15d2-4d4c-9522-edfb4986baf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:24.926352 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813dc49-15d2-4d4c-9522-edfb4986baf4 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:24.926633 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813dc49-15d2-4d4c-9522-edfb4986baf4 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:24.926906 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813dc49-15d2-4d4c-9522-edfb4986baf4 None admin] PATH_INFO: `/v3/services` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:24.927579 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8813dc49-15d2-4d4c-9522-edfb4986baf4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:24.928959 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8813dc49-15d2-4d4c-9522-edfb4986baf4 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:24.945368 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 486/991] 10.222.0.47 () {56 vars in 1087 bytes} [Mon Aug 29 22:33:24 2022] GET /identity/v3/services => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:33:25.011192 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb179570-18a3-46db-acd8-d3f3ccfc2780 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:25.048878 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc56fb15-1de9-4ee6-9a1b-022dd9b42205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:25.049555 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc56fb15-1de9-4ee6-9a1b-022dd9b42205 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:25.049834 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc56fb15-1de9-4ee6-9a1b-022dd9b42205 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:25.050098 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc56fb15-1de9-4ee6-9a1b-022dd9b42205 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:25.050685 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc56fb15-1de9-4ee6-9a1b-022dd9b42205 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:25.052076 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc56fb15-1de9-4ee6-9a1b-022dd9b42205 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:25.061900 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-fc56fb15-1de9-4ee6-9a1b-022dd9b42205 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 22:33:25.061900 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:25.061900 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:33:25.061900 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:33:25.061900 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:33:25.061900 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:33:25.061900 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:33:25.061900 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:33:25.061900 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 22:33:25.061900 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:33:25.061900 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:33:25.061900 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:33:25.061900 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:25.061900 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:25.061900 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:25.061900 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:25.061900 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:25.062974 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:25.062974 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:25.062974 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:25.062974 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:25.062974 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:25.062974 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:25.062974 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:33:25.062974 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:33:25.062974 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:33:25.062974 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:33:25.062974 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:25.062974 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:25.062974 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:25.062974 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:25.062974 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:25.062974 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:25.063804 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:25.063804 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:25.063804 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:25.063804 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:25.063804 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:25.063804 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:25.063804 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:25.063804 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:25.063804 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:25.063804 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:25.063804 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:33:25.063804 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:33:25.063804 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 22:33:25.063804 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:33:25.068107 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 506/992] 10.222.0.47 () {56 vars in 1126 bytes} [Mon Aug 29 22:33:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:33:25.069692 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8813dc49-15d2-4d4c-9522-edfb4986baf4 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:25.179887 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8813dc49-15d2-4d4c-9522-edfb4986baf4 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:25.214517 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f21644-498e-4060-b1a1-f4fb8173b091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:25.215127 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f21644-498e-4060-b1a1-f4fb8173b091 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:25.215408 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f21644-498e-4060-b1a1-f4fb8173b091 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:25.215683 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f21644-498e-4060-b1a1-f4fb8173b091 None admin] PATH_INFO: `/v3/services` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:25.216308 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f21644-498e-4060-b1a1-f4fb8173b091 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:25.216611 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f21644-498e-4060-b1a1-f4fb8173b091 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:25.217996 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f21644-498e-4060-b1a1-f4fb8173b091 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:25.222904 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 487/993] 10.222.0.47 () {56 vars in 1122 bytes} [Mon Aug 29 22:33:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:25.228697 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc56fb15-1de9-4ee6-9a1b-022dd9b42205 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:25.315804 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:25.343547 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc56fb15-1de9-4ee6-9a1b-022dd9b42205 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:25.378517 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3649d3dd-07ce-4104-afcc-1d8c81a7f690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:25.379121 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3649d3dd-07ce-4104-afcc-1d8c81a7f690 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:25.379399 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3649d3dd-07ce-4104-afcc-1d8c81a7f690 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:25.379670 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3649d3dd-07ce-4104-afcc-1d8c81a7f690 None admin] PATH_INFO: `/v3/services` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:25.380302 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3649d3dd-07ce-4104-afcc-1d8c81a7f690 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:25.381131 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3649d3dd-07ce-4104-afcc-1d8c81a7f690 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:25.382607 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3649d3dd-07ce-4104-afcc-1d8c81a7f690 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:25.391908 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 507/994] 10.222.0.47 () {56 vars in 1122 bytes} [Mon Aug 29 22:33:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:25.393973 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f21644-498e-4060-b1a1-f4fb8173b091 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:25.421134 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4303c2e-eb8f-44c8-a9eb-aeb7cb8afe57 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:25.421444 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4303c2e-eb8f-44c8-a9eb-aeb7cb8afe57 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:25.421712 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4303c2e-eb8f-44c8-a9eb-aeb7cb8afe57 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:25.423326 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 508/995] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:33:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:33:25.428514 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02466f53-b166-4928-9d2e-c7883204b24a None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:25.428806 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02466f53-b166-4928-9d2e-c7883204b24a None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:25.429085 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02466f53-b166-4928-9d2e-c7883204b24a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:25.443944 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:25.448552 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-02466f53-b166-4928-9d2e-c7883204b24a None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:25.449478 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-02466f53-b166-4928-9d2e-c7883204b24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:25.510618 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f21644-498e-4060-b1a1-f4fb8173b091 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:25.521396 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 509/996] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:33:25 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:33:25.549883 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c850fe95-5d7e-4fdb-aa0b-92cb4b9c3f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:25.550499 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850fe95-5d7e-4fdb-aa0b-92cb4b9c3f06 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:25.550783 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850fe95-5d7e-4fdb-aa0b-92cb4b9c3f06 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:25.551055 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850fe95-5d7e-4fdb-aa0b-92cb4b9c3f06 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:25.551773 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c850fe95-5d7e-4fdb-aa0b-92cb4b9c3f06 None admin] RBAC: Adding query filter params (interface=admin, service_id=6384dd6451874dd8818978677dfbbb26, region_id=RegionOne) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:25.552084 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c850fe95-5d7e-4fdb-aa0b-92cb4b9c3f06 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:25.554089 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c850fe95-5d7e-4fdb-aa0b-92cb4b9c3f06 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:25.564009 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 488/997] 10.222.0.47 () {56 vars in 1249 bytes} [Mon Aug 29 22:33:25 2022] GET /identity/v3/endpoints?service_id=6384dd6451874dd8818978677dfbbb26&interface=admin®ion_id=RegionOne => generated 193 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:25.565555 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02466f53-b166-4928-9d2e-c7883204b24a None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:25.635786 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:25.670244 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02466f53-b166-4928-9d2e-c7883204b24a None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:25.705669 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea97bcd-7669-4198-b26c-e497416d5f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:25.706273 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea97bcd-7669-4198-b26c-e497416d5f9b None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:25.706553 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea97bcd-7669-4198-b26c-e497416d5f9b None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:25.706825 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea97bcd-7669-4198-b26c-e497416d5f9b None admin] PATH_INFO: `/v3/services` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:25.707434 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea97bcd-7669-4198-b26c-e497416d5f9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:25.708890 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea97bcd-7669-4198-b26c-e497416d5f9b None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:25.721592 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 510/998] 10.222.0.47 () {56 vars in 1087 bytes} [Mon Aug 29 22:33:25 2022] GET /identity/v3/services => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:33:25.805539 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c850fe95-5d7e-4fdb-aa0b-92cb4b9c3f06 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:25.920026 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c850fe95-5d7e-4fdb-aa0b-92cb4b9c3f06 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:25.928181 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:25.956727 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43671090-6a7a-4537-9c84-71906f4b78c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:25.957370 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43671090-6a7a-4537-9c84-71906f4b78c4 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:25.957656 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43671090-6a7a-4537-9c84-71906f4b78c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:25.957927 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43671090-6a7a-4537-9c84-71906f4b78c4 None admin] PATH_INFO: `/v3/services/image` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:25.958537 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43671090-6a7a-4537-9c84-71906f4b78c4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:25.959909 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43671090-6a7a-4537-9c84-71906f4b78c4 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:25.969352 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-43671090-6a7a-4537-9c84-71906f4b78c4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 22:33:25.969352 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:25.969352 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:33:25.969352 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:33:25.969352 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:33:25.969352 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:33:25.969352 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:33:25.969352 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:33:25.969352 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 22:33:25.969352 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:33:25.969352 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:33:25.969352 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:33:25.969352 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:25.969352 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:25.969352 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:25.969352 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:25.969352 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:25.970404 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:25.970404 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:25.970404 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:25.970404 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:25.970404 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:25.970404 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:25.970404 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:33:25.970404 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:33:25.970404 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:33:25.970404 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:33:25.970404 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:25.970404 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:25.970404 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:25.970404 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:25.970404 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:25.970404 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:25.971240 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:25.971240 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:25.971240 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:25.971240 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:25.971240 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:25.971240 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:25.971240 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:25.971240 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:25.971240 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:25.971240 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:25.971240 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:33:25.971240 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:33:25.971240 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 22:33:25.971240 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:33:25.971240 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 489/999] 10.222.0.47 () {56 vars in 1105 bytes} [Mon Aug 29 22:33:25 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:33:25.979120 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea97bcd-7669-4198-b26c-e497416d5f9b None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:26.090456 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea97bcd-7669-4198-b26c-e497416d5f9b None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:26.120483 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:26.126479 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4571f939-65ee-4d01-aa74-681d3a1fc5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:26.127087 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4571f939-65ee-4d01-aa74-681d3a1fc5bb None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:26.127367 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4571f939-65ee-4d01-aa74-681d3a1fc5bb None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:26.127641 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4571f939-65ee-4d01-aa74-681d3a1fc5bb None admin] PATH_INFO: `/v3/services` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:26.128274 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4571f939-65ee-4d01-aa74-681d3a1fc5bb None admin] RBAC: Adding query filter params (name=image) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:26.128781 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4571f939-65ee-4d01-aa74-681d3a1fc5bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:26.130177 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4571f939-65ee-4d01-aa74-681d3a1fc5bb None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:26.135763 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 511/1000] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:33:25 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:26.141237 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43671090-6a7a-4537-9c84-71906f4b78c4 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:26.248347 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43671090-6a7a-4537-9c84-71906f4b78c4 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:26.287863 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda777c5-5d89-435a-ba71-29739e196e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:26.288556 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda777c5-5d89-435a-ba71-29739e196e09 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:26.288830 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda777c5-5d89-435a-ba71-29739e196e09 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:26.289098 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda777c5-5d89-435a-ba71-29739e196e09 None admin] PATH_INFO: `/v3/services` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:26.289764 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda777c5-5d89-435a-ba71-29739e196e09 None admin] RBAC: Adding query filter params (type=image) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:26.290063 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda777c5-5d89-435a-ba71-29739e196e09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:26.291422 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda777c5-5d89-435a-ba71-29739e196e09 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:26.296247 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 490/1001] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:33:26 2022] GET /identity/v3/services?type=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:26.887608 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ab493-8800-47de-80fd-f89dbc953af9 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:26.887985 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ab493-8800-47de-80fd-f89dbc953af9 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:26.888209 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ab493-8800-47de-80fd-f89dbc953af9 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:26.889687 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 512/1002] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:33:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:33:26.894846 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de66cc-61bc-4768-a4e1-678976ae6991 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:26.895305 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de66cc-61bc-4768-a4e1-678976ae6991 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:26.895468 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de66cc-61bc-4768-a4e1-678976ae6991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:26.915010 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-e3de66cc-61bc-4768-a4e1-678976ae6991 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:26.916206 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-e3de66cc-61bc-4768-a4e1-678976ae6991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:26.945107 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:26.989290 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 491/1003] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:33:26 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:33:27.259318 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ab493-8800-47de-80fd-f89dbc953af9 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:27.372892 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ab493-8800-47de-80fd-f89dbc953af9 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:27.409975 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3f5dcc-786a-4e25-89d5-a00ffb589ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:27.410605 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f5dcc-786a-4e25-89d5-a00ffb589ae9 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:27.410882 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f5dcc-786a-4e25-89d5-a00ffb589ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:27.411164 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f5dcc-786a-4e25-89d5-a00ffb589ae9 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:27.411885 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3f5dcc-786a-4e25-89d5-a00ffb589ae9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:27.413244 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3f5dcc-786a-4e25-89d5-a00ffb589ae9 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:27.422109 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-eb3f5dcc-786a-4e25-89d5-a00ffb589ae9 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 22:33:27.422109 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:27.422109 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:33:27.422109 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:33:27.422109 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:33:27.422109 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:33:27.422109 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:33:27.422109 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:33:27.422109 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 22:33:27.422109 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:33:27.422109 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:33:27.422109 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:33:27.422109 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:27.422109 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:27.422109 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:27.422109 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:27.422109 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:27.423213 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:27.423213 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:27.423213 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:27.423213 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:27.423213 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:27.423213 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:27.423213 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:33:27.423213 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:33:27.423213 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:33:27.423213 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:33:27.423213 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:27.423213 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:27.423213 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:27.423213 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:27.423213 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:27.423213 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:27.424047 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:27.424047 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:27.424047 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:27.424047 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:27.424047 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:27.424047 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:27.424047 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:27.424047 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:27.424047 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:27.424047 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:27.424047 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:33:27.424047 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:33:27.424047 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 22:33:27.424047 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:33:27.424047 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 513/1004] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Aug 29 22:33:27 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:33:27.430920 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de66cc-61bc-4768-a4e1-678976ae6991 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:27.533425 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de66cc-61bc-4768-a4e1-678976ae6991 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:27.568768 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a0e57c-47c6-4fc5-b623-2d855ba9e63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:27.569410 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0e57c-47c6-4fc5-b623-2d855ba9e63a None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:27.569694 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0e57c-47c6-4fc5-b623-2d855ba9e63a None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:27.569966 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0e57c-47c6-4fc5-b623-2d855ba9e63a None admin] PATH_INFO: `/v3/services` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:27.570592 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a0e57c-47c6-4fc5-b623-2d855ba9e63a None admin] RBAC: Adding query filter params (name=compute) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:27.570993 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a0e57c-47c6-4fc5-b623-2d855ba9e63a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:27.572458 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a0e57c-47c6-4fc5-b623-2d855ba9e63a None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:27.581937 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 492/1005] 10.222.0.47 () {56 vars in 1112 bytes} [Mon Aug 29 22:33:27 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:27.583074 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3f5dcc-786a-4e25-89d5-a00ffb589ae9 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:27.644818 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:27.669135 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a88c0f2-4d2e-48d2-80ba-c7aa16f4d0d1 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:27.669513 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a88c0f2-4d2e-48d2-80ba-c7aa16f4d0d1 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:27.669758 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a88c0f2-4d2e-48d2-80ba-c7aa16f4d0d1 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:27.671399 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 493/1006] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:33:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:33:27.676048 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430f7ed-ff86-46bf-8e87-327d20db054f None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:27.676336 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430f7ed-ff86-46bf-8e87-327d20db054f None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:27.676610 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430f7ed-ff86-46bf-8e87-327d20db054f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:27.692101 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3f5dcc-786a-4e25-89d5-a00ffb589ae9 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:27.695261 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-5430f7ed-ff86-46bf-8e87-327d20db054f None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:27.696463 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-5430f7ed-ff86-46bf-8e87-327d20db054f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:27.721804 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:27.730864 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc4a09-2680-47e0-9ac0-b9c8c5d1b2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:27.731716 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc4a09-2680-47e0-9ac0-b9c8c5d1b2d0 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:27.732164 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc4a09-2680-47e0-9ac0-b9c8c5d1b2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:27.732430 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc4a09-2680-47e0-9ac0-b9c8c5d1b2d0 None admin] PATH_INFO: `/v3/services` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:27.733057 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfc4a09-2680-47e0-9ac0-b9c8c5d1b2d0 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:27.733397 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfc4a09-2680-47e0-9ac0-b9c8c5d1b2d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:27.734762 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfc4a09-2680-47e0-9ac0-b9c8c5d1b2d0 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:27.740933 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 514/1007] 10.222.0.47 () {56 vars in 1112 bytes} [Mon Aug 29 22:33:27 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:33:27.746732 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc4a09-2680-47e0-9ac0-b9c8c5d1b2d0 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:27.773377 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 494/1008] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:33:27 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:33:27.857816 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc4a09-2680-47e0-9ac0-b9c8c5d1b2d0 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:27.882799 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:27.894628 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1c687f-a4ba-4553-a4cf-66ec14e05dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:27.895229 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c687f-a4ba-4553-a4cf-66ec14e05dbc None admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:27.895501 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c687f-a4ba-4553-a4cf-66ec14e05dbc None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:27.895764 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c687f-a4ba-4553-a4cf-66ec14e05dbc None admin] PATH_INFO: `/v3/endpoints` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:27.896454 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1c687f-a4ba-4553-a4cf-66ec14e05dbc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:27.897887 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1c687f-a4ba-4553-a4cf-66ec14e05dbc None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:27.921493 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 515/1009] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:33:27 2022] POST /identity/v3/endpoints => generated 334 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:33:28.043383 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5430f7ed-ff86-46bf-8e87-327d20db054f None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:28.152578 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5430f7ed-ff86-46bf-8e87-327d20db054f None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:28.213277 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba67169c-7574-49e5-bbd7-07cbef64c02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:28.214010 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67169c-7574-49e5-bbd7-07cbef64c02d None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:28.214290 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67169c-7574-49e5-bbd7-07cbef64c02d None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:28.214557 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67169c-7574-49e5-bbd7-07cbef64c02d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:28.215131 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba67169c-7574-49e5-bbd7-07cbef64c02d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:28.216482 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba67169c-7574-49e5-bbd7-07cbef64c02d None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:28.226092 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-ba67169c-7574-49e5-bbd7-07cbef64c02d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 22:33:28.226092 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:28.226092 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:33:28.226092 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:33:28.226092 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:33:28.226092 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:33:28.226092 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:33:28.226092 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:33:28.226092 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 22:33:28.226092 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:33:28.226092 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:33:28.226092 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:33:28.226092 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:28.226092 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:28.226092 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:28.226092 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:28.226092 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:28.227168 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:28.227168 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:28.227168 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:28.227168 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:28.227168 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:28.227168 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:28.227168 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:33:28.227168 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:33:28.227168 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:33:28.227168 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:33:28.227168 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:28.227168 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:28.227168 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:28.227168 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:28.227168 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:28.227168 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:28.228007 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:28.228007 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:28.228007 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:28.228007 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:28.228007 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:28.228007 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:28.228007 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:28.228007 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:28.228007 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:28.228007 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:28.228007 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:33:28.228007 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:33:28.228007 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 22:33:28.228007 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:33:28.228007 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 495/1010] 10.222.0.47 () {56 vars in 1126 bytes} [Mon Aug 29 22:33:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:33:28.233009 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1c687f-a4ba-4553-a4cf-66ec14e05dbc None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:28.247256 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923fea7-5d3e-46ba-bae1-9ee6ce188f1a None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:28.247546 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923fea7-5d3e-46ba-bae1-9ee6ce188f1a None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:28.247854 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923fea7-5d3e-46ba-bae1-9ee6ce188f1a None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:28.249200 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 496/1011] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:33:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:33:28.254182 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59fc415-d100-4fdc-9b02-5dafd754fbbd None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:28.254863 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59fc415-d100-4fdc-9b02-5dafd754fbbd None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:28.255204 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59fc415-d100-4fdc-9b02-5dafd754fbbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:28.276453 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-b59fc415-d100-4fdc-9b02-5dafd754fbbd None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:28.277787 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-b59fc415-d100-4fdc-9b02-5dafd754fbbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:28.296318 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:28.354074 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1c687f-a4ba-4553-a4cf-66ec14e05dbc None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:28.367897 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 497/1012] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:33:28 2022] POST /identity/v3/auth/tokens => generated 1726 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:33:28.392296 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d68c5-971b-41b0-9fea-1fc68ecad5df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:28.392907 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d68c5-971b-41b0-9fea-1fc68ecad5df None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:28.393193 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d68c5-971b-41b0-9fea-1fc68ecad5df None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:28.393501 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d68c5-971b-41b0-9fea-1fc68ecad5df None admin] PATH_INFO: `/v3/services` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:28.394140 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150d68c5-971b-41b0-9fea-1fc68ecad5df None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:28.394443 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150d68c5-971b-41b0-9fea-1fc68ecad5df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:28.395813 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150d68c5-971b-41b0-9fea-1fc68ecad5df None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:28.401285 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 516/1013] 10.222.0.47 () {56 vars in 1122 bytes} [Mon Aug 29 22:33:28 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:28.407132 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59fc415-d100-4fdc-9b02-5dafd754fbbd None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:28.515643 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59fc415-d100-4fdc-9b02-5dafd754fbbd None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:28.551083 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce8a58d-5773-494d-b7a1-b52fd35c8ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:28.551693 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce8a58d-5773-494d-b7a1-b52fd35c8ff8 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:28.551974 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce8a58d-5773-494d-b7a1-b52fd35c8ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:28.552775 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce8a58d-5773-494d-b7a1-b52fd35c8ff8 None admin] PATH_INFO: `/v3/services` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:28.553451 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce8a58d-5773-494d-b7a1-b52fd35c8ff8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:28.553795 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce8a58d-5773-494d-b7a1-b52fd35c8ff8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:28.555112 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce8a58d-5773-494d-b7a1-b52fd35c8ff8 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:28.560146 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 498/1014] 10.222.0.47 () {56 vars in 1122 bytes} [Mon Aug 29 22:33:28 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:28.565676 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d68c5-971b-41b0-9fea-1fc68ecad5df None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:28.614398 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:28.645244 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce8a58d-5773-494d-b7a1-b52fd35c8ff8 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:28.664781 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:28.679888 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d68c5-971b-41b0-9fea-1fc68ecad5df None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:28.719145 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8a204c-12f4-4a4b-80c0-0335135dd59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:28.719740 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a204c-12f4-4a4b-80c0-0335135dd59d None admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:28.720017 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a204c-12f4-4a4b-80c0-0335135dd59d None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:28.720286 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a204c-12f4-4a4b-80c0-0335135dd59d None admin] PATH_INFO: `/v3/endpoints` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:28.720966 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8a204c-12f4-4a4b-80c0-0335135dd59d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:28.722673 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8a204c-12f4-4a4b-80c0-0335135dd59d None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:28.745421 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 517/1015] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:33:28 2022] POST /identity/v3/endpoints => generated 325 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:33:28.782584 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce8a58d-5773-494d-b7a1-b52fd35c8ff8 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:28.830533 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7ba7f5-0439-48ef-a83f-df998f406200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:28.831350 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ba7f5-0439-48ef-a83f-df998f406200 None admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:28.831633 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ba7f5-0439-48ef-a83f-df998f406200 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:28.831903 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ba7f5-0439-48ef-a83f-df998f406200 None admin] PATH_INFO: `/v3/services` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:28.832558 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7ba7f5-0439-48ef-a83f-df998f406200 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:28.834150 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7ba7f5-0439-48ef-a83f-df998f406200 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:28.852525 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 499/1016] 10.222.0.47 () {60 vars in 1141 bytes} [Mon Aug 29 22:33:28 2022] POST /identity/v3/services => generated 242 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:33:29.983952 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373cf0ba-c0d5-410e-a81b-00bc510a58ce None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:29.984466 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373cf0ba-c0d5-410e-a81b-00bc510a58ce None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:29.984569 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373cf0ba-c0d5-410e-a81b-00bc510a58ce None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:29.986036 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 518/1017] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:33:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:33:29.992077 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea097f-97d4-4ebf-bedb-72c0df67f86c None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:29.992478 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea097f-97d4-4ebf-bedb-72c0df67f86c None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:29.992668 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea097f-97d4-4ebf-bedb-72c0df67f86c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:30.011297 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-5fea097f-97d4-4ebf-bedb-72c0df67f86c None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:30.012517 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-5fea097f-97d4-4ebf-bedb-72c0df67f86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:30.076829 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:30.090145 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 500/1018] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:33:29 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:33:30.362144 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373cf0ba-c0d5-410e-a81b-00bc510a58ce None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:30.466456 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373cf0ba-c0d5-410e-a81b-00bc510a58ce None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:30.468870 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:30.504613 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc17c04d-f6cd-44f3-9834-cb6a25f073c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:30.505234 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17c04d-f6cd-44f3-9834-cb6a25f073c0 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:30.505846 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17c04d-f6cd-44f3-9834-cb6a25f073c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:30.506133 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17c04d-f6cd-44f3-9834-cb6a25f073c0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:30.516438 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc17c04d-f6cd-44f3-9834-cb6a25f073c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:33:30.521423 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-cc17c04d-f6cd-44f3-9834-cb6a25f073c0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 22:33:30.521423 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:30.521423 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:30.521423 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:30.521423 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:30.521423 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:30.521423 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:30.521423 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:30.521423 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:30.521423 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:30.521423 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:30.521423 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:30.521423 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:33:30.521423 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:33:30.521423 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:33:30.521423 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:33:30.522436 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:33:30.522436 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:33:30.522436 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:33:30.522436 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:33:30.522436 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:30.522436 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:30.522436 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:30.522436 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:30.522436 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:30.522436 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:30.522436 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:30.522436 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:30.522436 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:30.522436 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:30.522436 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:30.522436 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:30.526420 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:30.526420 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:30.526420 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:30.526420 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:30.526420 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:33:30.526420 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:33:30.526420 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:33:30.526420 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:33:30.526420 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:33:30.526420 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:33:30.526420 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 22:33:30.526420 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:33:30.526420 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 519/1019] 10.222.0.47 () {56 vars in 1120 bytes} [Mon Aug 29 22:33:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:33:30.528575 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fea097f-97d4-4ebf-bedb-72c0df67f86c None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:30.631584 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fea097f-97d4-4ebf-bedb-72c0df67f86c None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:30.666190 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e761f50-68d3-4302-83ed-ebb4cc96d6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:30.666796 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e761f50-68d3-4302-83ed-ebb4cc96d6ac None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:30.667071 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e761f50-68d3-4302-83ed-ebb4cc96d6ac None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:30.667338 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e761f50-68d3-4302-83ed-ebb4cc96d6ac None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:30.667995 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e761f50-68d3-4302-83ed-ebb4cc96d6ac None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:30.668293 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e761f50-68d3-4302-83ed-ebb4cc96d6ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:30.669680 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e761f50-68d3-4302-83ed-ebb4cc96d6ac None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:30.678550 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 501/1020] 10.222.0.47 () {56 vars in 1115 bytes} [Mon Aug 29 22:33:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:30.684201 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc17c04d-f6cd-44f3-9834-cb6a25f073c0 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:30.712435 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc18248-b898-489f-a60d-0c3640baa677 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:30.712723 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc18248-b898-489f-a60d-0c3640baa677 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:30.713004 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc18248-b898-489f-a60d-0c3640baa677 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:30.714508 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 502/1021] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:33:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:33:30.719211 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041cdc5-cdcb-4d29-b405-65ffa0f3bf71 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:30.719451 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041cdc5-cdcb-4d29-b405-65ffa0f3bf71 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:30.719730 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041cdc5-cdcb-4d29-b405-65ffa0f3bf71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:30.742832 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-9041cdc5-cdcb-4d29-b405-65ffa0f3bf71 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:30.744051 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-9041cdc5-cdcb-4d29-b405-65ffa0f3bf71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:30.790994 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc17c04d-f6cd-44f3-9834-cb6a25f073c0 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:30.797957 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:30.815885 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 503/1022] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:33:30 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:33:30.817133 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774e886-91a8-4113-ac71-bb48526e32ab None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:30.817449 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774e886-91a8-4113-ac71-bb48526e32ab None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:30.817729 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774e886-91a8-4113-ac71-bb48526e32ab None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:30.819815 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 504/1023] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:33:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:33:30.824879 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5639a-b570-4e49-8809-8cacbc43e878 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:30.825165 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5639a-b570-4e49-8809-8cacbc43e878 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:30.825468 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5639a-b570-4e49-8809-8cacbc43e878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:30.831415 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c35ed3b-7edb-4e07-8c2e-8377e66b4fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:30.832042 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c35ed3b-7edb-4e07-8c2e-8377e66b4fd1 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:30.832323 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c35ed3b-7edb-4e07-8c2e-8377e66b4fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:30.832596 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c35ed3b-7edb-4e07-8c2e-8377e66b4fd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:30.843333 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c35ed3b-7edb-4e07-8c2e-8377e66b4fd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:30.844605 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-a1d5639a-b570-4e49-8809-8cacbc43e878 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:30.844796 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c35ed3b-7edb-4e07-8c2e-8377e66b4fd1 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:30.845838 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-a1d5639a-b570-4e49-8809-8cacbc43e878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:30.860142 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-6c35ed3b-7edb-4e07-8c2e-8377e66b4fd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:33:30.860142 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:30.860142 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:30.860142 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:30.860142 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:30.860142 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:30.860142 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:30.860142 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:30.860142 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:30.860142 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:30.860142 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:30.860142 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:30.860142 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:33:30.860142 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:33:30.860142 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:33:30.860142 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:33:30.861127 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:30.861127 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:30.861127 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:30.861127 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:30.861127 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:30.861127 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:30.861127 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:30.861127 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:30.861127 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:30.861127 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:30.861127 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:30.861127 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:30.861127 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:30.861127 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:30.861127 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:30.861127 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:30.861127 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:33:30.862587 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:33:30.862587 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:33:30.862587 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:33:30.862587 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 520/1024] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:33:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:33:30.867654 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c35ed3b-7edb-4e07-8c2e-8377e66b4fd1 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:30.889029 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:30.921378 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 505/1025] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:33:30 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:33:30.981700 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c35ed3b-7edb-4e07-8c2e-8377e66b4fd1 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:31.017616 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe205d58-1161-4f74-bab1-0c8f0bd22496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:31.018262 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe205d58-1161-4f74-bab1-0c8f0bd22496 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:31.018489 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe205d58-1161-4f74-bab1-0c8f0bd22496 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:31.018755 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe205d58-1161-4f74-bab1-0c8f0bd22496 None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:31.019391 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe205d58-1161-4f74-bab1-0c8f0bd22496 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:31.019692 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe205d58-1161-4f74-bab1-0c8f0bd22496 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:31.021082 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe205d58-1161-4f74-bab1-0c8f0bd22496 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:31.034264 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 521/1026] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:33:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:33:31.040036 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d5639a-b570-4e49-8809-8cacbc43e878 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:31.087059 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe205d58-1161-4f74-bab1-0c8f0bd22496 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:31.150797 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d5639a-b570-4e49-8809-8cacbc43e878 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:31.170334 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:31.170913 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:31.192264 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a27ae2-6766-4eaf-834f-26ba353819c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:31.193010 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a27ae2-6766-4eaf-834f-26ba353819c3 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:31.193437 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a27ae2-6766-4eaf-834f-26ba353819c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:31.193725 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a27ae2-6766-4eaf-834f-26ba353819c3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:31.196885 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe205d58-1161-4f74-bab1-0c8f0bd22496 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:31.201515 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a27ae2-6766-4eaf-834f-26ba353819c3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:31.202968 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a27ae2-6766-4eaf-834f-26ba353819c3 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:31.216255 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-c8a27ae2-6766-4eaf-834f-26ba353819c3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 22:33:31.216255 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:31.216255 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:31.216255 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:31.216255 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:31.216255 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:31.216255 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:31.216255 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:31.216255 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:31.216255 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:31.216255 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:31.216255 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:31.216255 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:33:31.216255 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:33:31.216255 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:33:31.216255 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:33:31.217277 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:31.217277 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:31.217277 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:33:31.217277 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:33:31.217277 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:33:31.217277 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:33:31.217277 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:31.217277 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:31.217277 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:31.217277 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:31.217277 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:31.217277 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:31.217277 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:31.217277 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:31.217277 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:31.217277 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:31.217277 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:31.217277 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:31.218261 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:31.218261 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:31.218261 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:33:31.218261 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:33:31.218261 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:33:31.218261 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:33:31.218261 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:33:31.218261 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:33:31.218261 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 22:33:31.218261 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:33:31.218261 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 506/1027] 10.222.0.47 () {56 vars in 1093 bytes} [Mon Aug 29 22:33:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:33:31.218261 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a27ae2-6766-4eaf-834f-26ba353819c3 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:31.236510 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8673d5b-11ac-431e-8075-9c23b862dad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:31.237143 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8673d5b-11ac-431e-8075-9c23b862dad5 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:31.237450 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8673d5b-11ac-431e-8075-9c23b862dad5 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:31.237725 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8673d5b-11ac-431e-8075-9c23b862dad5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:31.238818 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8673d5b-11ac-431e-8075-9c23b862dad5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:31.241066 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8673d5b-11ac-431e-8075-9c23b862dad5 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:31.245480 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 522/1028] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:33:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:33:31.245480 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8673d5b-11ac-431e-8075-9c23b862dad5 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:31.323093 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a27ae2-6766-4eaf-834f-26ba353819c3 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:31.350858 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8673d5b-11ac-431e-8075-9c23b862dad5 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:31.358787 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c170dd2-e758-4d60-b708-7734bb8766d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:31.359701 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c170dd2-e758-4d60-b708-7734bb8766d2 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:31.360072 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c170dd2-e758-4d60-b708-7734bb8766d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:31.360452 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c170dd2-e758-4d60-b708-7734bb8766d2 None admin] PATH_INFO: `/v3/services/image` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:31.361216 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c170dd2-e758-4d60-b708-7734bb8766d2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:31.362732 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c170dd2-e758-4d60-b708-7734bb8766d2 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:31.372247 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-7c170dd2-e758-4d60-b708-7734bb8766d2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 22:33:31.372247 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:31.372247 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:33:31.372247 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:33:31.372247 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:33:31.372247 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:33:31.372247 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:33:31.372247 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:33:31.372247 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 22:33:31.372247 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:33:31.372247 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:33:31.372247 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:33:31.372247 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:31.372247 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:31.372247 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:31.372247 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:31.372247 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:31.373276 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:31.373276 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:31.373276 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:31.373276 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:31.373276 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:31.373276 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:31.373276 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:33:31.373276 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:33:31.373276 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:33:31.373276 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:33:31.373276 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:31.373276 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:31.373276 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:31.373276 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:31.373276 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:31.373276 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:31.374150 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:31.374150 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:31.374150 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:31.374150 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:31.374150 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:31.374150 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:31.374150 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:31.374150 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:31.374150 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:31.374150 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:31.374150 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:33:31.374150 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:33:31.374150 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 22:33:31.374150 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:33:31.374150 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 507/1029] 10.222.0.47 () {56 vars in 1105 bytes} [Mon Aug 29 22:33:31 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:33:31.374934 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c170dd2-e758-4d60-b708-7734bb8766d2 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:31.389788 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483896d-28d0-41c3-97ac-6c4efc596a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:31.390393 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483896d-28d0-41c3-97ac-6c4efc596a65 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:31.390670 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483896d-28d0-41c3-97ac-6c4efc596a65 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:31.390947 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483896d-28d0-41c3-97ac-6c4efc596a65 None admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:31.391786 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8483896d-28d0-41c3-97ac-6c4efc596a65 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:31.392094 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8483896d-28d0-41c3-97ac-6c4efc596a65 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:31.393544 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8483896d-28d0-41c3-97ac-6c4efc596a65 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:31.410974 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 523/1030] 10.222.0.47 () {56 vars in 1133 bytes} [Mon Aug 29 22:33:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:31.412251 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483896d-28d0-41c3-97ac-6c4efc596a65 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:31.415191 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:31.417460 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:31.477643 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c170dd2-e758-4d60-b708-7734bb8766d2 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:31.516835 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483896d-28d0-41c3-97ac-6c4efc596a65 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:31.519890 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24038598-1f3f-40b4-9eaf-bdcc3d47073c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:31.520512 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24038598-1f3f-40b4-9eaf-bdcc3d47073c None admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:31.520798 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24038598-1f3f-40b4-9eaf-bdcc3d47073c None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:31.521754 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24038598-1f3f-40b4-9eaf-bdcc3d47073c None admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:31.522434 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24038598-1f3f-40b4-9eaf-bdcc3d47073c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:31.523873 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24038598-1f3f-40b4-9eaf-bdcc3d47073c None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:31.554747 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4f73b5-6095-412e-a6a8-1115f1e8bca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:31.555338 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f73b5-6095-412e-a6a8-1115f1e8bca7 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:31.555471 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 508/1031] 10.222.0.47 () {60 vars in 1141 bytes} [Mon Aug 29 22:33:31 2022] POST /identity/v3/projects => generated 311 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:33:31.555691 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f73b5-6095-412e-a6a8-1115f1e8bca7 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:31.555964 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f73b5-6095-412e-a6a8-1115f1e8bca7 None admin] PATH_INFO: `/v3/services` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:31.556686 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4f73b5-6095-412e-a6a8-1115f1e8bca7 None admin] RBAC: Adding query filter params (name=image) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:31.556885 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24038598-1f3f-40b4-9eaf-bdcc3d47073c None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:31.556993 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4f73b5-6095-412e-a6a8-1115f1e8bca7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:31.558380 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4f73b5-6095-412e-a6a8-1115f1e8bca7 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:31.569515 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 524/1032] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:33:31 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:31.571223 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4f73b5-6095-412e-a6a8-1115f1e8bca7 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:31.653766 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:31.692177 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4f73b5-6095-412e-a6a8-1115f1e8bca7 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:31.696446 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:31.709258 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24038598-1f3f-40b4-9eaf-bdcc3d47073c None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:31.734050 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc858dc2-7820-4464-b2a7-8f2bff63e50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:31.734659 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc858dc2-7820-4464-b2a7-8f2bff63e50a None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:31.734936 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc858dc2-7820-4464-b2a7-8f2bff63e50a None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:31.735210 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc858dc2-7820-4464-b2a7-8f2bff63e50a None admin] PATH_INFO: `/v3/services` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:31.735837 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc858dc2-7820-4464-b2a7-8f2bff63e50a None admin] RBAC: Adding query filter params (type=image) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:31.736140 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc858dc2-7820-4464-b2a7-8f2bff63e50a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:31.737939 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc858dc2-7820-4464-b2a7-8f2bff63e50a None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:31.744048 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 525/1033] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:33:31 2022] GET /identity/v3/services?type=image => generated 350 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:31.750117 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc858dc2-7820-4464-b2a7-8f2bff63e50a None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:31.752570 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d1996e-48dc-48da-9ee2-c9e0bb2b0917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:31.753454 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d1996e-48dc-48da-9ee2-c9e0bb2b0917 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:31.753816 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d1996e-48dc-48da-9ee2-c9e0bb2b0917 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:31.754094 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d1996e-48dc-48da-9ee2-c9e0bb2b0917 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:31.836995 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d1996e-48dc-48da-9ee2-c9e0bb2b0917 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:31.838623 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d1996e-48dc-48da-9ee2-c9e0bb2b0917 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:31.861562 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc858dc2-7820-4464-b2a7-8f2bff63e50a None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:31.891375 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:31.899169 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad9262-5b51-4f93-89ca-6d4ae6cb83e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:31.899883 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad9262-5b51-4f93-89ca-6d4ae6cb83e9 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:31.900224 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad9262-5b51-4f93-89ca-6d4ae6cb83e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:31.900562 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad9262-5b51-4f93-89ca-6d4ae6cb83e9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:31.901354 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ad9262-5b51-4f93-89ca-6d4ae6cb83e9 None admin] RBAC: Adding query filter params (interface=public, service_id=2a71351eb04c476bbfcc500deea1a4dd, region_id=RegionOne) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:31.901748 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ad9262-5b51-4f93-89ca-6d4ae6cb83e9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:31.903183 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ad9262-5b51-4f93-89ca-6d4ae6cb83e9 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:31.909372 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 526/1034] 10.222.0.47 () {56 vars in 1251 bytes} [Mon Aug 29 22:33:31 2022] GET /identity/v3/endpoints?service_id=2a71351eb04c476bbfcc500deea1a4dd&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:33:31.914488 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad9262-5b51-4f93-89ca-6d4ae6cb83e9 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:31.956905 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:31.972477 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 509/1035] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Aug 29 22:33:31 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 22:33:31.976287 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d1996e-48dc-48da-9ee2-c9e0bb2b0917 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:32.044547 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad9262-5b51-4f93-89ca-6d4ae6cb83e9 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:32.082934 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b28c0-b788-4fe7-a8dd-16813d43790a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:32.084113 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b28c0-b788-4fe7-a8dd-16813d43790a None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:32.084522 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b28c0-b788-4fe7-a8dd-16813d43790a None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:32.084802 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b28c0-b788-4fe7-a8dd-16813d43790a None admin] PATH_INFO: `/v3/services` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:32.085443 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6b28c0-b788-4fe7-a8dd-16813d43790a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:32.086818 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6b28c0-b788-4fe7-a8dd-16813d43790a None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:32.093408 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 527/1036] 10.222.0.47 () {56 vars in 1087 bytes} [Mon Aug 29 22:33:31 2022] GET /identity/v3/services => generated 1957 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:33:32.097140 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d1996e-48dc-48da-9ee2-c9e0bb2b0917 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:32.137636 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e16606-6306-4b3b-9f39-266895321989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:32.138299 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e16606-6306-4b3b-9f39-266895321989 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:32.138579 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e16606-6306-4b3b-9f39-266895321989 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:32.138849 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e16606-6306-4b3b-9f39-266895321989 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:32.152044 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e16606-6306-4b3b-9f39-266895321989 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:32.153548 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e16606-6306-4b3b-9f39-266895321989 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:32.170234 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-d4e16606-6306-4b3b-9f39-266895321989 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:33:32.170234 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:32.170234 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:32.170234 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:32.170234 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:32.170234 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:32.170234 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:32.170234 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:32.170234 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:32.170234 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:32.170234 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:32.170234 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:32.170234 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:33:32.170234 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:33:32.170234 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:33:32.170234 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:33:32.171269 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:32.171269 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:32.171269 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:32.171269 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:32.171269 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:32.171269 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:32.171269 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:32.171269 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:32.171269 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:32.171269 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:32.171269 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:32.171269 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:32.171269 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:32.171269 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:32.171269 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:32.171269 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:32.171269 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:33:32.172769 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:33:32.172769 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:33:32.172769 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:33:32.172769 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 510/1037] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:33:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:33:32.177180 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b28c0-b788-4fe7-a8dd-16813d43790a None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:32.248610 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:32.297748 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b28c0-b788-4fe7-a8dd-16813d43790a None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:32.337639 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cbe2e4-cb8e-48a3-8074-d9878e357958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:32.338251 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cbe2e4-cb8e-48a3-8074-d9878e357958 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:32.338531 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cbe2e4-cb8e-48a3-8074-d9878e357958 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:32.338802 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cbe2e4-cb8e-48a3-8074-d9878e357958 None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:32.339450 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cbe2e4-cb8e-48a3-8074-d9878e357958 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:32.339751 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cbe2e4-cb8e-48a3-8074-d9878e357958 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:32.341115 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cbe2e4-cb8e-48a3-8074-d9878e357958 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:32.359250 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 528/1038] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:33:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:32.361007 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e16606-6306-4b3b-9f39-266895321989 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:32.410716 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:32.468897 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e16606-6306-4b3b-9f39-266895321989 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:32.504660 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea62a5dd-29f7-43ac-8cbf-b59c4d43ee59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:32.505221 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62a5dd-29f7-43ac-8cbf-b59c4d43ee59 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:32.506959 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62a5dd-29f7-43ac-8cbf-b59c4d43ee59 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:32.506959 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62a5dd-29f7-43ac-8cbf-b59c4d43ee59 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:32.513633 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea62a5dd-29f7-43ac-8cbf-b59c4d43ee59 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:32.515079 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea62a5dd-29f7-43ac-8cbf-b59c4d43ee59 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:32.527378 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-ea62a5dd-29f7-43ac-8cbf-b59c4d43ee59 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:33:32.527378 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:32.527378 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:32.527378 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:32.527378 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:32.527378 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:32.527378 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:32.527378 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:32.527378 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:32.527378 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:32.527378 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:32.527378 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:32.527378 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:33:32.527378 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:33:32.527378 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:33:32.528275 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:33:32.528275 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:32.528275 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:32.528275 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:32.528275 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:32.528275 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:32.528275 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:32.528275 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:32.528275 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:32.528275 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:32.528275 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:32.528275 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:32.528275 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:32.528275 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:32.528275 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:32.528275 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:32.528275 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:32.529151 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:33:32.529151 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:33:32.529151 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:33:32.529151 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:33:32.529151 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:33:32.529151 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:33:32.529151 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:33:32.529151 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:33:32.533630 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 511/1039] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Aug 29 22:33:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:33:32.534958 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cbe2e4-cb8e-48a3-8074-d9878e357958 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:32.647693 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cbe2e4-cb8e-48a3-8074-d9878e357958 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:32.672659 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:32.691121 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3091903c-aa31-47f8-8c8f-0c3ec660fa65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:32.691722 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091903c-aa31-47f8-8c8f-0c3ec660fa65 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:32.691996 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091903c-aa31-47f8-8c8f-0c3ec660fa65 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:32.692262 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091903c-aa31-47f8-8c8f-0c3ec660fa65 None admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:32.693578 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3091903c-aa31-47f8-8c8f-0c3ec660fa65 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:32.694081 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3091903c-aa31-47f8-8c8f-0c3ec660fa65 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:32.695677 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3091903c-aa31-47f8-8c8f-0c3ec660fa65 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:32.713409 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 529/1040] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Aug 29 22:33:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:32.715315 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea62a5dd-29f7-43ac-8cbf-b59c4d43ee59 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:32.824334 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea62a5dd-29f7-43ac-8cbf-b59c4d43ee59 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:32.826750 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:32.860818 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d4183-5f08-4a70-91ea-1a63843ddffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:32.861453 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d4183-5f08-4a70-91ea-1a63843ddffe None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:32.861738 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d4183-5f08-4a70-91ea-1a63843ddffe None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:32.862011 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d4183-5f08-4a70-91ea-1a63843ddffe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:32.862738 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d4183-5f08-4a70-91ea-1a63843ddffe None admin] RBAC: Adding query filter params (role.id=ad49d96eb9164c789bc74d8748e637b5, scope.project.id=ce09f0beb1a342febbb4a8b3c7cf60c2, user.id=35441c061e514b1b9341e7694ec2c0bc) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:32.863047 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d4183-5f08-4a70-91ea-1a63843ddffe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:32.864475 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d4183-5f08-4a70-91ea-1a63843ddffe None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:32.870512 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 512/1041] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Aug 29 22:33:32 2022] GET /identity/v3/role_assignments?user.id=35441c061e514b1b9341e7694ec2c0bc&scope.project.id=ce09f0beb1a342febbb4a8b3c7cf60c2&role.id=ad49d96eb9164c789bc74d8748e637b5 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:33.563673 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e921251-ca85-4280-97f4-f11c8b0ae183 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:33.564200 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e921251-ca85-4280-97f4-f11c8b0ae183 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:33.564200 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e921251-ca85-4280-97f4-f11c8b0ae183 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:33.565754 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 530/1042] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:33:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:33:33.571481 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c25a2-5bf7-4b88-954f-083d09d41660 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:33.571913 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c25a2-5bf7-4b88-954f-083d09d41660 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:33.572117 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c25a2-5bf7-4b88-954f-083d09d41660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:33.591253 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-d20c25a2-5bf7-4b88-954f-083d09d41660 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:33.592445 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-d20c25a2-5bf7-4b88-954f-083d09d41660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:33.663249 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 513/1043] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:33:33 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:33:33.938269 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e921251-ca85-4280-97f4-f11c8b0ae183 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:34.035159 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15346ab-1b0a-4190-9e99-8d801802a790 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:34.035449 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15346ab-1b0a-4190-9e99-8d801802a790 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:34.035729 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15346ab-1b0a-4190-9e99-8d801802a790 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:34.037695 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 514/1044] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:33:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:33:34.042887 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e10413a-5e3e-427d-8731-85fdaa22d544 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:34.043174 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e10413a-5e3e-427d-8731-85fdaa22d544 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:34.043453 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e10413a-5e3e-427d-8731-85fdaa22d544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:34.062654 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-8e10413a-5e3e-427d-8731-85fdaa22d544 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:34.063880 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-8e10413a-5e3e-427d-8731-85fdaa22d544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:34.068042 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e921251-ca85-4280-97f4-f11c8b0ae183 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:34.104122 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944063c2-2ac2-4bde-b32f-0255c9ae7de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:34.104708 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944063c2-2ac2-4bde-b32f-0255c9ae7de4 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:34.104980 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944063c2-2ac2-4bde-b32f-0255c9ae7de4 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:34.105249 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944063c2-2ac2-4bde-b32f-0255c9ae7de4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:34.106402 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944063c2-2ac2-4bde-b32f-0255c9ae7de4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:34.107826 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944063c2-2ac2-4bde-b32f-0255c9ae7de4 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:34.109421 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 531/1045] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:33:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:34.114998 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944063c2-2ac2-4bde-b32f-0255c9ae7de4 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:34.141783 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 515/1046] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:33:34 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:33:34.178561 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:34.243313 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944063c2-2ac2-4bde-b32f-0255c9ae7de4 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:34.288277 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e43085e-683a-4d54-a694-97c976249fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:34.288884 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e43085e-683a-4d54-a694-97c976249fa9 None admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:34.289159 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e43085e-683a-4d54-a694-97c976249fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:34.289479 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e43085e-683a-4d54-a694-97c976249fa9 None admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:34.290105 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e43085e-683a-4d54-a694-97c976249fa9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:34.291535 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e43085e-683a-4d54-a694-97c976249fa9 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:34.325171 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 532/1047] 10.222.0.47 () {60 vars in 1132 bytes} [Mon Aug 29 22:33:34 2022] POST /identity/v3/users => generated 285 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:33:34.422851 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e10413a-5e3e-427d-8731-85fdaa22d544 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:34.462075 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:34.540964 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e10413a-5e3e-427d-8731-85fdaa22d544 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:34.576932 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ec60e-5cea-42b4-b3ed-54bf1d301b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:34.577645 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ec60e-5cea-42b4-b3ed-54bf1d301b6a None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:34.577975 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ec60e-5cea-42b4-b3ed-54bf1d301b6a None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:34.578255 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ec60e-5cea-42b4-b3ed-54bf1d301b6a None admin] PATH_INFO: `/v3/services/image` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:34.578847 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2ec60e-5cea-42b4-b3ed-54bf1d301b6a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:34.580214 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2ec60e-5cea-42b4-b3ed-54bf1d301b6a None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:34.589198 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-7f2ec60e-5cea-42b4-b3ed-54bf1d301b6a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 22:33:34.589198 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:34.589198 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:33:34.589198 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:33:34.589198 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:33:34.589198 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:33:34.589198 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:33:34.589198 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:33:34.589198 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 22:33:34.589198 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:33:34.589198 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:33:34.589198 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:33:34.589198 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:34.589198 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:34.589198 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:34.589198 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:34.589198 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:34.590293 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:34.590293 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:34.590293 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:34.590293 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:34.590293 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:34.590293 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:34.590293 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:33:34.590293 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:33:34.590293 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:33:34.590293 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:33:34.590293 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:34.590293 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:34.590293 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:34.590293 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:34.590293 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:34.590293 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:34.591125 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:34.591125 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:34.591125 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:34.591125 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:34.591125 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:34.591125 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:34.591125 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:34.591125 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:34.591125 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:34.591125 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:34.591125 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:33:34.591125 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:33:34.591125 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 22:33:34.591125 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:33:34.591125 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 516/1048] 10.222.0.47 () {56 vars in 1105 bytes} [Mon Aug 29 22:33:34 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:33:34.596512 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e43085e-683a-4d54-a694-97c976249fa9 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:34.701939 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e43085e-683a-4d54-a694-97c976249fa9 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:34.703523 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:34.740210 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b86b4e-6851-4600-92ab-a18d738b0d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:34.740816 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b86b4e-6851-4600-92ab-a18d738b0d21 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:34.741099 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b86b4e-6851-4600-92ab-a18d738b0d21 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:34.741406 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b86b4e-6851-4600-92ab-a18d738b0d21 None admin] PATH_INFO: `/v3/services` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:34.742048 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b86b4e-6851-4600-92ab-a18d738b0d21 None admin] RBAC: Adding query filter params (name=image) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:34.742351 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b86b4e-6851-4600-92ab-a18d738b0d21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:34.743721 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b86b4e-6851-4600-92ab-a18d738b0d21 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:34.749852 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 533/1049] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:33:34 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:33:34.755443 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ec60e-5cea-42b4-b3ed-54bf1d301b6a None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:34.777672 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b058a-26aa-43a6-9219-97d4e38150b7 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:34.778003 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b058a-26aa-43a6-9219-97d4e38150b7 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:34.778231 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b058a-26aa-43a6-9219-97d4e38150b7 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:34.780156 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 534/1050] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:33:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:33:34.785167 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5780cfd0-63fe-4a6a-8f6e-bd1b68adbac8 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:34.785484 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5780cfd0-63fe-4a6a-8f6e-bd1b68adbac8 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:34.785761 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5780cfd0-63fe-4a6a-8f6e-bd1b68adbac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:34.805293 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-5780cfd0-63fe-4a6a-8f6e-bd1b68adbac8 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:34.806450 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-5780cfd0-63fe-4a6a-8f6e-bd1b68adbac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:34.856124 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:34.867211 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ec60e-5cea-42b4-b3ed-54bf1d301b6a None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:34.881658 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 535/1051] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:33:34 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:33:34.906403 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e5aa6c-228d-4071-9875-c5949ad9856d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:34.907256 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e5aa6c-228d-4071-9875-c5949ad9856d None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:34.907678 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e5aa6c-228d-4071-9875-c5949ad9856d None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:34.908087 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e5aa6c-228d-4071-9875-c5949ad9856d None admin] PATH_INFO: `/v3/services` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:34.908873 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e5aa6c-228d-4071-9875-c5949ad9856d None admin] RBAC: Adding query filter params (type=image) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:34.909313 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e5aa6c-228d-4071-9875-c5949ad9856d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:34.910834 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e5aa6c-228d-4071-9875-c5949ad9856d None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:34.917219 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 517/1052] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:33:34 2022] GET /identity/v3/services?type=image => generated 350 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:34.922721 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5780cfd0-63fe-4a6a-8f6e-bd1b68adbac8 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:35.023004 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:35.031691 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5780cfd0-63fe-4a6a-8f6e-bd1b68adbac8 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:35.073441 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45c5427-3f01-4788-b0ca-a57d0e82456e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:35.074322 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c5427-3f01-4788-b0ca-a57d0e82456e None admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:35.074738 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c5427-3f01-4788-b0ca-a57d0e82456e None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:35.075099 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c5427-3f01-4788-b0ca-a57d0e82456e None admin] PATH_INFO: `/v3/endpoints` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:35.075775 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45c5427-3f01-4788-b0ca-a57d0e82456e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:35.077153 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45c5427-3f01-4788-b0ca-a57d0e82456e None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:35.104275 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 536/1053] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:33:34 2022] POST /identity/v3/endpoints => generated 327 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:33:35.151011 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e5aa6c-228d-4071-9875-c5949ad9856d None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:35.261233 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e5aa6c-228d-4071-9875-c5949ad9856d None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:35.309799 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e676d-ad60-410a-9193-e4f1450816bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:35.310681 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e676d-ad60-410a-9193-e4f1450816bc None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:35.311147 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e676d-ad60-410a-9193-e4f1450816bc None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:35.311632 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e676d-ad60-410a-9193-e4f1450816bc None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:35.324066 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7e676d-ad60-410a-9193-e4f1450816bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:33:35.329219 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-5a7e676d-ad60-410a-9193-e4f1450816bc None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 22:33:35.329219 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:35.329219 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:35.329219 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:35.329219 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:35.329219 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:35.329219 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:35.329219 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:35.329219 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:35.329219 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:35.329219 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:35.329219 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:35.329219 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:33:35.329219 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:33:35.329219 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:33:35.329219 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:33:35.330251 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:33:35.330251 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:33:35.330251 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:33:35.330251 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:33:35.330251 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:35.330251 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:35.330251 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:35.330251 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:35.330251 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:35.330251 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:35.330251 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:35.330251 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:35.330251 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:35.330251 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:35.330251 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:35.330251 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:35.331081 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:35.331081 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:35.331081 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:35.331081 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:35.331081 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:33:35.331081 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:33:35.331081 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:33:35.331081 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:33:35.331081 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:33:35.331081 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:33:35.331081 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 22:33:35.331081 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:33:35.331714 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 518/1054] 10.222.0.47 () {56 vars in 1120 bytes} [Mon Aug 29 22:33:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:33:35.337020 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45c5427-3f01-4788-b0ca-a57d0e82456e None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:35.447739 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45c5427-3f01-4788-b0ca-a57d0e82456e None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:35.482773 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae38d01f-2eee-4652-8aaa-02ad21aded58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:35.483383 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38d01f-2eee-4652-8aaa-02ad21aded58 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:35.483661 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38d01f-2eee-4652-8aaa-02ad21aded58 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:35.483932 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38d01f-2eee-4652-8aaa-02ad21aded58 None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:35.484592 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae38d01f-2eee-4652-8aaa-02ad21aded58 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:35.484893 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae38d01f-2eee-4652-8aaa-02ad21aded58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:35.486290 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae38d01f-2eee-4652-8aaa-02ad21aded58 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:35.500176 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 537/1055] 10.222.0.47 () {56 vars in 1115 bytes} [Mon Aug 29 22:33:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:35.501512 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e676d-ad60-410a-9193-e4f1450816bc None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:35.518829 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:35.618645 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e676d-ad60-410a-9193-e4f1450816bc None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:35.651539 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e974e-dbb3-4bd2-9a44-259e6eab17a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:35.652166 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e974e-dbb3-4bd2-9a44-259e6eab17a1 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:35.652440 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e974e-dbb3-4bd2-9a44-259e6eab17a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:35.652709 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e974e-dbb3-4bd2-9a44-259e6eab17a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:35.664287 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156e974e-dbb3-4bd2-9a44-259e6eab17a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:35.665756 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156e974e-dbb3-4bd2-9a44-259e6eab17a1 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:35.680387 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-156e974e-dbb3-4bd2-9a44-259e6eab17a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:33:35.680387 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:35.680387 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:35.680387 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:35.680387 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:35.680387 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:35.680387 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:35.680387 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:35.680387 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:35.680387 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:35.680387 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:35.680387 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:35.680387 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:33:35.680387 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:33:35.680387 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:33:35.680387 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:33:35.681631 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:35.681631 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:35.681631 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:35.681631 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:35.681631 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:35.681631 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:35.681631 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:35.681631 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:35.681631 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:35.681631 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:35.681631 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:35.681631 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:35.681631 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:35.681631 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:35.681631 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:35.681631 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:35.681631 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:33:35.682810 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:33:35.682810 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:33:35.682810 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:33:35.683237 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 519/1056] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:33:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:33:35.687166 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae38d01f-2eee-4652-8aaa-02ad21aded58 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:35.704468 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:35.793862 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae38d01f-2eee-4652-8aaa-02ad21aded58 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:35.827995 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e9a8a-d39e-4016-9b22-c94b0c4ce63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:35.828597 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e9a8a-d39e-4016-9b22-c94b0c4ce63c None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:35.828873 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e9a8a-d39e-4016-9b22-c94b0c4ce63c None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:35.829141 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e9a8a-d39e-4016-9b22-c94b0c4ce63c None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:35.829806 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0e9a8a-d39e-4016-9b22-c94b0c4ce63c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:35.830107 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0e9a8a-d39e-4016-9b22-c94b0c4ce63c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:35.831465 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0e9a8a-d39e-4016-9b22-c94b0c4ce63c None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:35.843419 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 538/1057] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:33:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:35.848958 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e974e-dbb3-4bd2-9a44-259e6eab17a1 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:35.914081 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:35.954912 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e974e-dbb3-4bd2-9a44-259e6eab17a1 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:35.989355 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a3d412-be01-4363-9f3a-831a898c9b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:35.990718 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3d412-be01-4363-9f3a-831a898c9b6e None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:35.991053 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3d412-be01-4363-9f3a-831a898c9b6e None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:35.991295 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3d412-be01-4363-9f3a-831a898c9b6e None admin] PATH_INFO: `/v3/users/nova` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:35.999191 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a3d412-be01-4363-9f3a-831a898c9b6e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:36.000628 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a3d412-be01-4363-9f3a-831a898c9b6e None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:36.012898 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-91a3d412-be01-4363-9f3a-831a898c9b6e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 22:33:36.012898 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:36.012898 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:36.012898 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:36.012898 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:36.012898 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:36.012898 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:36.012898 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:36.012898 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:36.012898 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:36.012898 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:36.012898 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:36.012898 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:33:36.012898 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:33:36.012898 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:33:36.012898 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:33:36.013870 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:36.013870 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:36.013870 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:33:36.013870 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:33:36.013870 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:33:36.013870 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:33:36.013870 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:36.013870 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:36.013870 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:36.013870 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:36.013870 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:36.013870 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:36.013870 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:36.013870 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:36.013870 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:36.013870 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:36.013870 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:36.013870 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:36.014819 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:36.014819 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:36.014819 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:33:36.014819 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:33:36.014819 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:33:36.014819 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:33:36.014819 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:33:36.014819 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:33:36.014819 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 22:33:36.014819 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:33:36.017416 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 520/1058] 10.222.0.47 () {56 vars in 1093 bytes} [Mon Aug 29 22:33:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:33:36.020195 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e9a8a-d39e-4016-9b22-c94b0c4ce63c None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:36.098422 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:36.126736 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e9a8a-d39e-4016-9b22-c94b0c4ce63c None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:36.161459 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1188be2e-9d50-460a-96f4-b7d08891479a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:36.162833 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1188be2e-9d50-460a-96f4-b7d08891479a None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:36.163113 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1188be2e-9d50-460a-96f4-b7d08891479a None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:36.163389 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1188be2e-9d50-460a-96f4-b7d08891479a None admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:36.164177 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1188be2e-9d50-460a-96f4-b7d08891479a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:36.164428 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1188be2e-9d50-460a-96f4-b7d08891479a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:36.165894 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1188be2e-9d50-460a-96f4-b7d08891479a None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:36.187830 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 539/1059] 10.222.0.47 () {56 vars in 1133 bytes} [Mon Aug 29 22:33:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:36.189121 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a3d412-be01-4363-9f3a-831a898c9b6e None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:36.300434 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a3d412-be01-4363-9f3a-831a898c9b6e None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:36.327846 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:36.340195 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f060f0-3807-4fac-ab8f-f3b8474e1e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:36.340832 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f060f0-3807-4fac-ab8f-f3b8474e1e04 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:36.341110 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f060f0-3807-4fac-ab8f-f3b8474e1e04 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:36.341403 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f060f0-3807-4fac-ab8f-f3b8474e1e04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:36.353543 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f060f0-3807-4fac-ab8f-f3b8474e1e04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:36.354979 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f060f0-3807-4fac-ab8f-f3b8474e1e04 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:36.369281 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-17f060f0-3807-4fac-ab8f-f3b8474e1e04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:33:36.369281 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:36.369281 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:36.369281 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:36.369281 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:36.369281 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:36.369281 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:36.369281 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:36.369281 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:36.369281 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:36.369281 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:36.369281 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:36.369281 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:33:36.369281 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:33:36.369281 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:33:36.369281 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:33:36.370428 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:36.370428 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:36.370428 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:36.370428 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:36.370428 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:36.370428 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:36.370428 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:36.370428 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:36.370428 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:36.370428 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:36.370428 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:36.370428 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:36.370428 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:36.370428 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:36.370428 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:36.370428 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:36.370428 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:33:36.371537 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:33:36.371537 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:33:36.371537 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:33:36.371746 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352625dd-bcc7-4343-8e39-01f7af28ab62 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:36.371746 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352625dd-bcc7-4343-8e39-01f7af28ab62 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:36.371746 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352625dd-bcc7-4343-8e39-01f7af28ab62 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:36.372174 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 521/1060] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:33:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:33:36.373106 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 540/1061] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:33:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:33:36.375894 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f060f0-3807-4fac-ab8f-f3b8474e1e04 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:36.377726 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2979ed-2f42-44e9-a837-f8b15f35894d None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:36.378012 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2979ed-2f42-44e9-a837-f8b15f35894d None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:36.378284 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2979ed-2f42-44e9-a837-f8b15f35894d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:36.398509 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-8c2979ed-2f42-44e9-a837-f8b15f35894d None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:36.399706 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-8c2979ed-2f42-44e9-a837-f8b15f35894d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:36.473135 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 541/1062] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:33:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:33:36.486994 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f060f0-3807-4fac-ab8f-f3b8474e1e04 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:36.527269 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a056e7e-347e-48c7-b4e4-74b280529a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:36.527881 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a056e7e-347e-48c7-b4e4-74b280529a09 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:36.528163 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a056e7e-347e-48c7-b4e4-74b280529a09 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:36.528439 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a056e7e-347e-48c7-b4e4-74b280529a09 None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:36.529086 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a056e7e-347e-48c7-b4e4-74b280529a09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:36.529418 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a056e7e-347e-48c7-b4e4-74b280529a09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:36.531041 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a056e7e-347e-48c7-b4e4-74b280529a09 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:36.547705 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 522/1063] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:33:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:36.549016 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2979ed-2f42-44e9-a837-f8b15f35894d None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:36.618620 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:36.660497 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2979ed-2f42-44e9-a837-f8b15f35894d None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:36.695423 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b106553-9e52-4aea-adcc-2036e66fadf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:36.696048 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b106553-9e52-4aea-adcc-2036e66fadf7 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:36.696319 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b106553-9e52-4aea-adcc-2036e66fadf7 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:36.696591 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b106553-9e52-4aea-adcc-2036e66fadf7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:36.703448 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b106553-9e52-4aea-adcc-2036e66fadf7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:36.704891 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b106553-9e52-4aea-adcc-2036e66fadf7 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:36.716887 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-5b106553-9e52-4aea-adcc-2036e66fadf7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:33:36.716887 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:36.716887 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:36.716887 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:36.716887 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:36.716887 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:36.716887 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:36.716887 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:36.716887 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:36.716887 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:36.716887 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:36.716887 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:36.716887 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:33:36.716887 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:33:36.716887 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:33:36.718013 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:33:36.718013 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:36.718013 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:36.718013 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:36.718013 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:36.718013 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:36.718013 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:36.718013 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:36.718013 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:36.718013 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:36.718013 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:36.718013 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:36.718013 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:36.718013 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:36.718013 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:36.718013 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:36.718013 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:36.718944 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:33:36.718944 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:33:36.718944 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:33:36.718944 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:33:36.718944 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:33:36.718944 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:33:36.718944 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:33:36.718944 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:33:36.718944 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 542/1064] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Aug 29 22:33:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:33:36.726678 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a056e7e-347e-48c7-b4e4-74b280529a09 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:36.750501 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b106553-9e52-4aea-adcc-2036e66fadf7 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:36.767087 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:36.839691 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a056e7e-347e-48c7-b4e4-74b280529a09 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:36.868750 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b106553-9e52-4aea-adcc-2036e66fadf7 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:36.875832 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54a4c64-4a18-4703-85b5-47201a3db256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:36.876564 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a4c64-4a18-4703-85b5-47201a3db256 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:36.876844 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a4c64-4a18-4703-85b5-47201a3db256 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:36.877116 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a4c64-4a18-4703-85b5-47201a3db256 None admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:36.877842 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54a4c64-4a18-4703-85b5-47201a3db256 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:36.878153 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54a4c64-4a18-4703-85b5-47201a3db256 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:36.879576 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54a4c64-4a18-4703-85b5-47201a3db256 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:36.892020 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 523/1065] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Aug 29 22:33:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:36.893540 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:36.898826 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54a4c64-4a18-4703-85b5-47201a3db256 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:36.910457 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb150a56-2f28-4c08-aced-b2c14764fa49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:36.911308 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb150a56-2f28-4c08-aced-b2c14764fa49 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:36.911875 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb150a56-2f28-4c08-aced-b2c14764fa49 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:36.912554 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb150a56-2f28-4c08-aced-b2c14764fa49 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:36.924772 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb150a56-2f28-4c08-aced-b2c14764fa49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:33:36.931381 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-fb150a56-2f28-4c08-aced-b2c14764fa49 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:33:36.931381 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:36.931381 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:36.931381 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:36.931381 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:36.931381 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:36.931381 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:36.931381 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:36.931381 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:36.931381 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:36.931381 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:36.931381 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:36.931381 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:33:36.931381 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:33:36.931381 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:33:36.931381 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:33:36.932529 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:33:36.932529 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:33:36.932529 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:33:36.932529 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:33:36.932529 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:36.932529 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:36.932529 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:36.932529 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:36.932529 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:36.932529 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:36.932529 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:36.932529 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:36.932529 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:36.932529 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:36.932529 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:36.932529 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:36.933628 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:36.933628 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:36.933628 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:36.933628 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:36.933628 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:33:36.933628 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:33:36.933628 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:33:36.933628 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:33:36.933628 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:33:36.933628 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:33:36.933628 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:33:36.933628 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:33:36.937594 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 543/1066] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Aug 29 22:33:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:33:36.938291 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb150a56-2f28-4c08-aced-b2c14764fa49 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:37.000164 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:37.006649 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54a4c64-4a18-4703-85b5-47201a3db256 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:37.044268 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05670f00-9dbd-40b0-9a13-c81ae1d4196b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:37.044937 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05670f00-9dbd-40b0-9a13-c81ae1d4196b None admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:37.045223 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05670f00-9dbd-40b0-9a13-c81ae1d4196b None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:37.045530 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05670f00-9dbd-40b0-9a13-c81ae1d4196b None admin] PATH_INFO: `/v3/projects/ce09f0beb1a342febbb4a8b3c7cf60c2/users/35441c061e514b1b9341e7694ec2c0bc/roles/ad49d96eb9164c789bc74d8748e637b5` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:37.047727 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05670f00-9dbd-40b0-9a13-c81ae1d4196b None admin] RBAC: Authorizing `identity:create_grant(project_id=ce09f0beb1a342febbb4a8b3c7cf60c2, user_id=35441c061e514b1b9341e7694ec2c0bc, role_id=ad49d96eb9164c789bc74d8748e637b5)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:37.049199 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05670f00-9dbd-40b0-9a13-c81ae1d4196b None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:37.057520 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb150a56-2f28-4c08-aced-b2c14764fa49 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:37.062553 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 524/1067] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Aug 29 22:33:36 2022] PUT /identity/v3/projects/ce09f0beb1a342febbb4a8b3c7cf60c2/users/35441c061e514b1b9341e7694ec2c0bc/roles/ad49d96eb9164c789bc74d8748e637b5 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:33:37.101371 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d23de-fc2f-4ebb-8629-7a28d7e84c1f None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:37.101655 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d23de-fc2f-4ebb-8629-7a28d7e84c1f None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:37.101933 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d23de-fc2f-4ebb-8629-7a28d7e84c1f None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:37.103304 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 525/1068] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:33:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:33:37.104350 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a16392-5edb-4306-928b-b7a681b0b621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:37.105232 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a16392-5edb-4306-928b-b7a681b0b621 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:37.105672 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a16392-5edb-4306-928b-b7a681b0b621 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:37.106091 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a16392-5edb-4306-928b-b7a681b0b621 None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:37.106919 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a16392-5edb-4306-928b-b7a681b0b621 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:37.107457 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a16392-5edb-4306-928b-b7a681b0b621 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:37.108789 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64534594-409b-42c8-a4b5-c5d30570a5a3 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:37.109075 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64534594-409b-42c8-a4b5-c5d30570a5a3 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:37.109371 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64534594-409b-42c8-a4b5-c5d30570a5a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:37.109527 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a16392-5edb-4306-928b-b7a681b0b621 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:37.121983 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 544/1069] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Aug 29 22:33:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:37.127957 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a16392-5edb-4306-928b-b7a681b0b621 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:37.128748 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-64534594-409b-42c8-a4b5-c5d30570a5a3 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:37.130019 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-64534594-409b-42c8-a4b5-c5d30570a5a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:37.186312 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:37.216978 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 526/1070] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:33:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:33:37.248460 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a16392-5edb-4306-928b-b7a681b0b621 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:37.294378 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f78775-663f-4ac2-a9e2-207a6486d321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:37.294932 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f78775-663f-4ac2-a9e2-207a6486d321 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:37.295213 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f78775-663f-4ac2-a9e2-207a6486d321 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:37.295483 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f78775-663f-4ac2-a9e2-207a6486d321 None admin] PATH_INFO: `/v3/users/51579151b1e74db084c17e882795275d` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:37.310919 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f78775-663f-4ac2-a9e2-207a6486d321 None admin] RBAC: Authorizing `identity:get_user(user_id=51579151b1e74db084c17e882795275d)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:37.312384 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f78775-663f-4ac2-a9e2-207a6486d321 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:37.314241 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 545/1071] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Aug 29 22:33:37 2022] GET /identity/v3/users/51579151b1e74db084c17e882795275d => generated 285 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:37.321174 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64534594-409b-42c8-a4b5-c5d30570a5a3 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:37.409641 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:37.426498 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64534594-409b-42c8-a4b5-c5d30570a5a3 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:37.462010 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9242c592-5d13-41f3-b8d9-64ea360ce9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:37.462625 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9242c592-5d13-41f3-b8d9-64ea360ce9b2 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:37.462909 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9242c592-5d13-41f3-b8d9-64ea360ce9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:37.463184 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9242c592-5d13-41f3-b8d9-64ea360ce9b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:37.491121 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f78775-663f-4ac2-a9e2-207a6486d321 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:37.534619 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9242c592-5d13-41f3-b8d9-64ea360ce9b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:37.536025 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9242c592-5d13-41f3-b8d9-64ea360ce9b2 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:37.602576 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f78775-663f-4ac2-a9e2-207a6486d321 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:37.604312 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:37.629687 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:37.644598 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab4f66e-ccba-476d-8e4f-1c94e60982d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:37.645203 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4f66e-ccba-476d-8e4f-1c94e60982d8 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:37.645508 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4f66e-ccba-476d-8e4f-1c94e60982d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:37.645777 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4f66e-ccba-476d-8e4f-1c94e60982d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:37.651713 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 527/1072] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Aug 29 22:33:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 22:33:37.652478 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9242c592-5d13-41f3-b8d9-64ea360ce9b2 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:37.731054 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab4f66e-ccba-476d-8e4f-1c94e60982d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:37.732511 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab4f66e-ccba-476d-8e4f-1c94e60982d8 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:37.752983 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9242c592-5d13-41f3-b8d9-64ea360ce9b2 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:37.789191 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d92d6c-d24a-4367-8a73-40022463bbfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:37.789942 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d92d6c-d24a-4367-8a73-40022463bbfe None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:37.790225 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d92d6c-d24a-4367-8a73-40022463bbfe None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:37.790501 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d92d6c-d24a-4367-8a73-40022463bbfe None admin] PATH_INFO: `/v3/projects/90d30ce0b888433c819ccccde9e15d8d` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:37.791641 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d92d6c-d24a-4367-8a73-40022463bbfe None admin] RBAC: Authorizing `identity:get_project(project_id=90d30ce0b888433c819ccccde9e15d8d)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:37.793074 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d92d6c-d24a-4367-8a73-40022463bbfe None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:37.794904 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 528/1073] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Aug 29 22:33:37 2022] GET /identity/v3/projects/90d30ce0b888433c819ccccde9e15d8d => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:37.800751 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d92d6c-d24a-4367-8a73-40022463bbfe None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:37.841370 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 546/1074] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Aug 29 22:33:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 22:33:37.846308 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab4f66e-ccba-476d-8e4f-1c94e60982d8 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:37.848175 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:37.863534 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:37.909039 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d92d6c-d24a-4367-8a73-40022463bbfe None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:37.945967 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b667085-fec8-4a50-b6a1-6100faf7208e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:37.946587 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b667085-fec8-4a50-b6a1-6100faf7208e None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:37.946868 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b667085-fec8-4a50-b6a1-6100faf7208e None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:37.947140 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b667085-fec8-4a50-b6a1-6100faf7208e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:37.947866 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b667085-fec8-4a50-b6a1-6100faf7208e None admin] RBAC: Adding query filter params (role.id=d00eabaec96a4956aaec2c37a5819c25, scope.project.id=90d30ce0b888433c819ccccde9e15d8d, user.id=51579151b1e74db084c17e882795275d) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:37.948174 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b667085-fec8-4a50-b6a1-6100faf7208e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:37.949625 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b667085-fec8-4a50-b6a1-6100faf7208e None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:37.955243 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 529/1075] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Aug 29 22:33:37 2022] GET /identity/v3/role_assignments?user.id=51579151b1e74db084c17e882795275d&scope.project.id=90d30ce0b888433c819ccccde9e15d8d&role.id=d00eabaec96a4956aaec2c37a5819c25 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:33:37.968031 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab4f66e-ccba-476d-8e4f-1c94e60982d8 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:38.009058 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4d9874-2c44-4ec1-a2d0-323feaaa516b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:38.009745 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4d9874-2c44-4ec1-a2d0-323feaaa516b None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:38.010024 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4d9874-2c44-4ec1-a2d0-323feaaa516b None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:38.010298 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4d9874-2c44-4ec1-a2d0-323feaaa516b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:38.022837 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4d9874-2c44-4ec1-a2d0-323feaaa516b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:38.024325 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4d9874-2c44-4ec1-a2d0-323feaaa516b None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:38.041714 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-0d4d9874-2c44-4ec1-a2d0-323feaaa516b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:33:38.041714 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:38.041714 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:38.041714 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:38.041714 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:38.041714 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:38.041714 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:38.041714 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:38.041714 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:38.041714 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:38.041714 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:38.041714 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:38.041714 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:33:38.041714 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:33:38.041714 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:33:38.041714 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:33:38.042717 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:38.042717 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:38.042717 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:38.042717 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:38.042717 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:38.042717 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:38.042717 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:38.042717 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:38.042717 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:38.042717 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:38.042717 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:38.042717 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:38.042717 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:38.042717 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:38.042717 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:38.042717 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:38.042717 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:33:38.047597 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:33:38.047597 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:33:38.047597 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:33:38.047597 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 547/1076] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:33:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:33:38.051174 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b667085-fec8-4a50-b6a1-6100faf7208e None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:38.163910 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b667085-fec8-4a50-b6a1-6100faf7208e None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:38.181872 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:38.200215 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d4556-799a-497c-b008-72ad977fa666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:38.200847 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d4556-799a-497c-b008-72ad977fa666 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:38.201123 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d4556-799a-497c-b008-72ad977fa666 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:38.201424 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d4556-799a-497c-b008-72ad977fa666 None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:38.202087 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4d4556-799a-497c-b008-72ad977fa666 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:38.202390 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4d4556-799a-497c-b008-72ad977fa666 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:38.203797 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4d4556-799a-497c-b008-72ad977fa666 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:38.225379 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 530/1077] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:33:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:39.063385 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8698bd04-50cf-4568-883d-923c0bb4b05f None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:39.064015 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8698bd04-50cf-4568-883d-923c0bb4b05f None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:39.064015 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8698bd04-50cf-4568-883d-923c0bb4b05f None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:39.065276 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 548/1078] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:33:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:33:39.071491 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3cf7c-ed7a-4f38-b386-9e4af8a447ce None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:39.071970 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3cf7c-ed7a-4f38-b386-9e4af8a447ce None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:39.072071 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3cf7c-ed7a-4f38-b386-9e4af8a447ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:39.090018 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-b2e3cf7c-ed7a-4f38-b386-9e4af8a447ce None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:39.091210 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-b2e3cf7c-ed7a-4f38-b386-9e4af8a447ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:39.157311 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 531/1079] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:33:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:33:39.431552 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8698bd04-50cf-4568-883d-923c0bb4b05f None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:39.489139 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:39.535996 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8698bd04-50cf-4568-883d-923c0bb4b05f None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:39.571216 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00129c5-2a7d-4b32-8550-626839df3f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:39.571844 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00129c5-2a7d-4b32-8550-626839df3f55 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:39.572123 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00129c5-2a7d-4b32-8550-626839df3f55 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:39.572396 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00129c5-2a7d-4b32-8550-626839df3f55 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:39.582382 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00129c5-2a7d-4b32-8550-626839df3f55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:33:39.587492 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-a00129c5-2a7d-4b32-8550-626839df3f55 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 22:33:39.587492 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:39.587492 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:39.587492 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:39.587492 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:39.587492 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:39.587492 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:39.587492 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:39.587492 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:39.587492 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:39.587492 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:39.587492 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:39.587492 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:33:39.587492 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:33:39.587492 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:33:39.587492 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:33:39.588648 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:33:39.588648 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:33:39.588648 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:33:39.588648 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:33:39.588648 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:39.588648 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:39.588648 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:39.588648 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:39.588648 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:39.588648 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:39.588648 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:39.588648 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:39.588648 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:39.588648 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:39.588648 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:39.588648 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:39.589594 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:39.589594 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:39.589594 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:39.589594 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:39.589594 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:33:39.589594 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:33:39.589594 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:33:39.589594 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:33:39.589594 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:33:39.589594 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:33:39.589594 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 22:33:39.589594 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:33:39.589594 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 549/1080] 10.222.0.47 () {56 vars in 1120 bytes} [Mon Aug 29 22:33:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:33:39.594516 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e3cf7c-ed7a-4f38-b386-9e4af8a447ce None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:39.697653 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e3cf7c-ed7a-4f38-b386-9e4af8a447ce None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:39.706892 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:39.733747 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e2d794-f600-4b17-9090-2efffc8e6519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:39.734364 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2d794-f600-4b17-9090-2efffc8e6519 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:39.734646 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2d794-f600-4b17-9090-2efffc8e6519 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:39.734923 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2d794-f600-4b17-9090-2efffc8e6519 None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:39.735588 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e2d794-f600-4b17-9090-2efffc8e6519 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:39.735894 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e2d794-f600-4b17-9090-2efffc8e6519 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:39.737274 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e2d794-f600-4b17-9090-2efffc8e6519 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:39.745339 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 532/1081] 10.222.0.47 () {56 vars in 1115 bytes} [Mon Aug 29 22:33:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:33:39.751068 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00129c5-2a7d-4b32-8550-626839df3f55 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:39.849850 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00129c5-2a7d-4b32-8550-626839df3f55 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:39.863733 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:39.871066 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f85394-dc06-44bd-8b04-ad76d907ad77 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:39.871357 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f85394-dc06-44bd-8b04-ad76d907ad77 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:39.871634 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f85394-dc06-44bd-8b04-ad76d907ad77 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:39.872983 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 533/1082] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:33:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:33:39.878071 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1460aea-89e8-4b72-84e6-5d49e4568b8a None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:39.878355 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1460aea-89e8-4b72-84e6-5d49e4568b8a None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:39.878635 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1460aea-89e8-4b72-84e6-5d49e4568b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:39.887353 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505909bf-c3fc-47cd-82a1-920fa1c7db84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:39.887979 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505909bf-c3fc-47cd-82a1-920fa1c7db84 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:39.888262 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505909bf-c3fc-47cd-82a1-920fa1c7db84 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:39.888535 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505909bf-c3fc-47cd-82a1-920fa1c7db84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:39.897531 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-d1460aea-89e8-4b72-84e6-5d49e4568b8a None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:39.898767 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-d1460aea-89e8-4b72-84e6-5d49e4568b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:39.899775 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505909bf-c3fc-47cd-82a1-920fa1c7db84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:39.901226 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505909bf-c3fc-47cd-82a1-920fa1c7db84 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:39.916593 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-505909bf-c3fc-47cd-82a1-920fa1c7db84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:33:39.916593 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:39.916593 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:39.916593 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:39.916593 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:39.916593 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:39.916593 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:39.916593 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:39.916593 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:39.916593 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:39.916593 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:39.916593 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:39.916593 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:33:39.916593 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:33:39.916593 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:33:39.916593 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:33:39.917665 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:39.917665 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:39.917665 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:39.917665 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:39.917665 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:39.917665 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:39.917665 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:39.917665 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:39.917665 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:39.917665 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:39.917665 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:39.917665 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:39.917665 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:39.917665 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:39.917665 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:39.917665 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:39.917665 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:33:39.918556 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:33:39.918556 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:33:39.918556 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:33:39.918556 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 550/1083] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:33:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:33:39.923520 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505909bf-c3fc-47cd-82a1-920fa1c7db84 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:39.968420 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 534/1084] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:33:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:33:40.022675 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505909bf-c3fc-47cd-82a1-920fa1c7db84 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:40.058611 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48919773-8031-464d-9e72-9446d0ccb0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:40.059212 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48919773-8031-464d-9e72-9446d0ccb0b1 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:40.059492 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48919773-8031-464d-9e72-9446d0ccb0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:40.059762 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48919773-8031-464d-9e72-9446d0ccb0b1 None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:40.060397 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48919773-8031-464d-9e72-9446d0ccb0b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:40.060696 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48919773-8031-464d-9e72-9446d0ccb0b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:40.062157 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48919773-8031-464d-9e72-9446d0ccb0b1 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:40.074354 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 551/1085] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:33:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:33:40.080089 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1460aea-89e8-4b72-84e6-5d49e4568b8a None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:40.176091 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:40.179306 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1460aea-89e8-4b72-84e6-5d49e4568b8a None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:40.215402 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d9b50-a66b-4b07-ba41-c1a7cc431b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:40.216034 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d9b50-a66b-4b07-ba41-c1a7cc431b9d None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:40.216313 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d9b50-a66b-4b07-ba41-c1a7cc431b9d None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:40.216584 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d9b50-a66b-4b07-ba41-c1a7cc431b9d None admin] PATH_INFO: `/v3/users/nova` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:40.223680 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172d9b50-a66b-4b07-ba41-c1a7cc431b9d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:40.225527 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172d9b50-a66b-4b07-ba41-c1a7cc431b9d None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:40.236970 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-172d9b50-a66b-4b07-ba41-c1a7cc431b9d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 22:33:40.236970 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:40.236970 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:40.236970 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:40.236970 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:40.236970 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:40.236970 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:40.236970 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:40.236970 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:40.236970 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:40.236970 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:40.236970 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:40.236970 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:33:40.236970 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:33:40.236970 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:33:40.236970 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:33:40.238172 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:40.238172 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:40.238172 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:33:40.238172 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:33:40.238172 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:33:40.238172 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:33:40.238172 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:40.238172 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:40.238172 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:40.238172 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:40.238172 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:40.238172 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:40.238172 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:40.238172 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:40.238172 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:40.238172 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:40.238172 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:40.238172 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:40.239131 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:40.239131 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:40.239131 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:33:40.239131 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:33:40.239131 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:33:40.239131 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:33:40.239131 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:33:40.239131 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:33:40.239131 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 22:33:40.239131 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:33:40.239721 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48919773-8031-464d-9e72-9446d0ccb0b1 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:40.239804 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 535/1086] 10.222.0.47 () {56 vars in 1093 bytes} [Mon Aug 29 22:33:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:33:40.243824 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d9b50-a66b-4b07-ba41-c1a7cc431b9d None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:40.268501 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:40.347111 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48919773-8031-464d-9e72-9446d0ccb0b1 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:40.347355 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d9b50-a66b-4b07-ba41-c1a7cc431b9d None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:40.384298 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4934dca9-74df-43c1-b27d-56907d54750c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:40.384782 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e9acc4-7c5e-455b-8ab6-0431f22fc83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:40.385023 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4934dca9-74df-43c1-b27d-56907d54750c None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:40.385306 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4934dca9-74df-43c1-b27d-56907d54750c None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:40.385451 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9acc4-7c5e-455b-8ab6-0431f22fc83f None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:40.385612 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4934dca9-74df-43c1-b27d-56907d54750c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:40.385712 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9acc4-7c5e-455b-8ab6-0431f22fc83f None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:40.385950 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9acc4-7c5e-455b-8ab6-0431f22fc83f None admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:40.386682 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e9acc4-7c5e-455b-8ab6-0431f22fc83f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:40.386988 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e9acc4-7c5e-455b-8ab6-0431f22fc83f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:40.388414 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e9acc4-7c5e-455b-8ab6-0431f22fc83f None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:40.395662 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4934dca9-74df-43c1-b27d-56907d54750c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:33:40.400686 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-4934dca9-74df-43c1-b27d-56907d54750c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:33:40.400686 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:40.400686 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:40.400686 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:40.400686 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:40.400686 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:40.400686 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:40.400686 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:40.400686 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:40.400686 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:40.400686 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:40.400686 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:40.400686 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:33:40.400686 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:33:40.400686 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:33:40.400686 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:33:40.401786 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:33:40.401786 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:33:40.401786 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:33:40.401786 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:33:40.401786 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:40.401786 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:40.401786 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:40.401786 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:40.401786 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:40.401786 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:40.401786 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:40.401786 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:40.401786 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:40.401786 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:40.401786 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:40.401786 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:40.402638 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:40.402638 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:40.402638 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:40.402638 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:40.402638 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:33:40.402638 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:33:40.402638 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:33:40.402638 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:33:40.402638 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:33:40.402638 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:33:40.402638 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:33:40.402638 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:33:40.402638 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 552/1087] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Aug 29 22:33:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:33:40.407760 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 536/1088] 10.222.0.47 () {56 vars in 1133 bytes} [Mon Aug 29 22:33:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:33:40.408046 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4934dca9-74df-43c1-b27d-56907d54750c None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:40.413848 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e9acc4-7c5e-455b-8ab6-0431f22fc83f None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:40.432603 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:40.496883 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:40.512413 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4934dca9-74df-43c1-b27d-56907d54750c None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:40.514727 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e9acc4-7c5e-455b-8ab6-0431f22fc83f None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:40.548947 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92276d02-1603-485c-a4cd-ec75eedfa183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:40.549586 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92276d02-1603-485c-a4cd-ec75eedfa183 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:40.549866 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92276d02-1603-485c-a4cd-ec75eedfa183 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:40.550135 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92276d02-1603-485c-a4cd-ec75eedfa183 None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:40.550472 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ff287a-f0ee-4d60-bcdf-d2110918253d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:40.550795 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92276d02-1603-485c-a4cd-ec75eedfa183 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:40.551075 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff287a-f0ee-4d60-bcdf-d2110918253d None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:40.551180 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92276d02-1603-485c-a4cd-ec75eedfa183 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:40.551350 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff287a-f0ee-4d60-bcdf-d2110918253d None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:40.551616 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff287a-f0ee-4d60-bcdf-d2110918253d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:40.552451 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92276d02-1603-485c-a4cd-ec75eedfa183 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:40.560589 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 553/1089] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Aug 29 22:33:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:33:40.566367 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92276d02-1603-485c-a4cd-ec75eedfa183 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:40.620323 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ff287a-f0ee-4d60-bcdf-d2110918253d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:40.621851 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ff287a-f0ee-4d60-bcdf-d2110918253d None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:40.639327 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:40.668262 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92276d02-1603-485c-a4cd-ec75eedfa183 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:40.701904 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628aa6b-7f7b-4abb-ba8c-c55ba47102c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:40.702523 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628aa6b-7f7b-4abb-ba8c-c55ba47102c8 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:40.702798 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628aa6b-7f7b-4abb-ba8c-c55ba47102c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:40.703065 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628aa6b-7f7b-4abb-ba8c-c55ba47102c8 None admin] PATH_INFO: `/v3/users/51579151b1e74db084c17e882795275d` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:40.704173 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8628aa6b-7f7b-4abb-ba8c-c55ba47102c8 None admin] RBAC: Authorizing `identity:get_user(user_id=51579151b1e74db084c17e882795275d)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:40.705615 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8628aa6b-7f7b-4abb-ba8c-c55ba47102c8 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:40.707215 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 554/1090] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Aug 29 22:33:40 2022] GET /identity/v3/users/51579151b1e74db084c17e882795275d => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:33:40.713691 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628aa6b-7f7b-4abb-ba8c-c55ba47102c8 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:40.725151 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 537/1091] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Aug 29 22:33:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 22:33:40.731263 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ff287a-f0ee-4d60-bcdf-d2110918253d None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:40.734784 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:40.820692 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628aa6b-7f7b-4abb-ba8c-c55ba47102c8 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:40.829357 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ff287a-f0ee-4d60-bcdf-d2110918253d None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:40.847003 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:40.855950 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f34130-6173-4f9f-ac3e-0a1d59d88cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:40.856588 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f34130-6173-4f9f-ac3e-0a1d59d88cb4 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:40.856870 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f34130-6173-4f9f-ac3e-0a1d59d88cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:40.857148 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f34130-6173-4f9f-ac3e-0a1d59d88cb4 None admin] PATH_INFO: `/v3/projects/90d30ce0b888433c819ccccde9e15d8d` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:40.858284 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f34130-6173-4f9f-ac3e-0a1d59d88cb4 None admin] RBAC: Authorizing `identity:get_project(project_id=90d30ce0b888433c819ccccde9e15d8d)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:40.859715 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f34130-6173-4f9f-ac3e-0a1d59d88cb4 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:40.861393 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 555/1092] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Aug 29 22:33:40 2022] GET /identity/v3/projects/90d30ce0b888433c819ccccde9e15d8d => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:33:40.864900 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950ac1e9-0ac2-41b6-8669-b485be06a3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:40.865568 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950ac1e9-0ac2-41b6-8669-b485be06a3d6 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:40.865853 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950ac1e9-0ac2-41b6-8669-b485be06a3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:40.866130 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950ac1e9-0ac2-41b6-8669-b485be06a3d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:40.867520 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f34130-6173-4f9f-ac3e-0a1d59d88cb4 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:40.876404 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950ac1e9-0ac2-41b6-8669-b485be06a3d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:40.877875 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950ac1e9-0ac2-41b6-8669-b485be06a3d6 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:40.894832 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-950ac1e9-0ac2-41b6-8669-b485be06a3d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:33:40.894832 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:40.894832 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:40.894832 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:40.894832 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:40.894832 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:40.894832 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:40.894832 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:40.894832 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:40.894832 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:40.894832 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:40.894832 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:40.894832 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:33:40.894832 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:33:40.894832 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:33:40.894832 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:33:40.895817 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:40.895817 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:40.895817 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:40.895817 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:40.895817 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:40.895817 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:40.895817 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:40.895817 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:40.895817 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:40.895817 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:40.895817 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:40.895817 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:40.895817 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:40.895817 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:40.895817 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:40.895817 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:40.895817 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:33:40.896910 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:33:40.896910 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:33:40.896910 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:33:40.896910 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 538/1093] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:33:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:33:40.902134 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950ac1e9-0ac2-41b6-8669-b485be06a3d6 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:40.956497 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:40.973933 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f34130-6173-4f9f-ac3e-0a1d59d88cb4 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:41.006609 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950ac1e9-0ac2-41b6-8669-b485be06a3d6 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:41.008992 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74972783-59e0-41e3-abc2-3dd966def3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:41.009685 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74972783-59e0-41e3-abc2-3dd966def3f2 None admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:41.009964 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74972783-59e0-41e3-abc2-3dd966def3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:41.010238 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74972783-59e0-41e3-abc2-3dd966def3f2 None admin] PATH_INFO: `/v3/projects/90d30ce0b888433c819ccccde9e15d8d/users/51579151b1e74db084c17e882795275d/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:41.012202 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74972783-59e0-41e3-abc2-3dd966def3f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=90d30ce0b888433c819ccccde9e15d8d, user_id=51579151b1e74db084c17e882795275d, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:41.013699 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74972783-59e0-41e3-abc2-3dd966def3f2 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:41.027122 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 556/1094] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Aug 29 22:33:40 2022] PUT /identity/v3/projects/90d30ce0b888433c819ccccde9e15d8d/users/51579151b1e74db084c17e882795275d/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:33:41.042511 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767a067-ea31-441f-ad3e-92be259490e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:41.043145 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767a067-ea31-441f-ad3e-92be259490e4 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:41.043424 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767a067-ea31-441f-ad3e-92be259490e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:41.043696 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767a067-ea31-441f-ad3e-92be259490e4 None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:41.044358 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f767a067-ea31-441f-ad3e-92be259490e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:41.044659 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f767a067-ea31-441f-ad3e-92be259490e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:41.046112 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f767a067-ea31-441f-ad3e-92be259490e4 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:41.059742 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 539/1095] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:33:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:33:41.065735 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74972783-59e0-41e3-abc2-3dd966def3f2 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:41.179071 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74972783-59e0-41e3-abc2-3dd966def3f2 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:41.214359 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d16f64-0b83-4d22-8447-5e562c0c80ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:41.214983 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d16f64-0b83-4d22-8447-5e562c0c80ef None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:41.215263 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d16f64-0b83-4d22-8447-5e562c0c80ef None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:41.215537 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d16f64-0b83-4d22-8447-5e562c0c80ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:41.222315 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d16f64-0b83-4d22-8447-5e562c0c80ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:41.223754 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d16f64-0b83-4d22-8447-5e562c0c80ef None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:41.235063 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-63d16f64-0b83-4d22-8447-5e562c0c80ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:33:41.235063 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:41.235063 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:41.235063 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:41.235063 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:41.235063 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:41.235063 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:41.235063 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:41.235063 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:41.235063 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:41.235063 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:41.235063 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:41.235063 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:33:41.235063 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:33:41.235063 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:33:41.236188 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:33:41.236188 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:41.236188 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:41.236188 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:41.236188 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:41.236188 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:41.236188 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:41.236188 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:41.236188 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:41.236188 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:41.236188 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:41.236188 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:41.236188 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:41.236188 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:41.236188 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:41.236188 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:41.236188 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:41.237099 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:33:41.237099 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:33:41.237099 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:33:41.237099 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:33:41.237099 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:33:41.237099 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:33:41.237099 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:33:41.237099 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:33:41.237099 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 557/1096] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Aug 29 22:33:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:33:41.242853 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767a067-ea31-441f-ad3e-92be259490e4 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:41.274154 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:41.357587 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767a067-ea31-441f-ad3e-92be259490e4 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:41.394379 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cd6d4a-4dfc-475d-a1fd-62a48f61c6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:41.395005 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd6d4a-4dfc-475d-a1fd-62a48f61c6a7 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:41.395287 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd6d4a-4dfc-475d-a1fd-62a48f61c6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:41.395564 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd6d4a-4dfc-475d-a1fd-62a48f61c6a7 None admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:41.396317 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cd6d4a-4dfc-475d-a1fd-62a48f61c6a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:41.396624 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cd6d4a-4dfc-475d-a1fd-62a48f61c6a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:41.398084 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cd6d4a-4dfc-475d-a1fd-62a48f61c6a7 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:41.410666 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 540/1097] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Aug 29 22:33:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:41.417134 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d16f64-0b83-4d22-8447-5e562c0c80ef None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:41.421103 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:41.526014 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d16f64-0b83-4d22-8447-5e562c0c80ef None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:41.562447 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85efaea2-e30e-484a-a716-79a3f097f4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:41.563050 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85efaea2-e30e-484a-a716-79a3f097f4b3 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:41.563326 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85efaea2-e30e-484a-a716-79a3f097f4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:41.563592 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85efaea2-e30e-484a-a716-79a3f097f4b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:41.564324 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85efaea2-e30e-484a-a716-79a3f097f4b3 None admin] RBAC: Adding query filter params (role.id=ad49d96eb9164c789bc74d8748e637b5, scope.project.id=ce09f0beb1a342febbb4a8b3c7cf60c2, user.id=35441c061e514b1b9341e7694ec2c0bc) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:41.564629 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85efaea2-e30e-484a-a716-79a3f097f4b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:41.566093 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85efaea2-e30e-484a-a716-79a3f097f4b3 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:41.581352 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 558/1098] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Aug 29 22:33:41 2022] GET /identity/v3/role_assignments?user.id=35441c061e514b1b9341e7694ec2c0bc&scope.project.id=ce09f0beb1a342febbb4a8b3c7cf60c2&role.id=ad49d96eb9164c789bc74d8748e637b5 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:42.932652 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1103069-0af7-4292-87e3-60e39ab45c48 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:42.933192 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1103069-0af7-4292-87e3-60e39ab45c48 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:42.933319 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1103069-0af7-4292-87e3-60e39ab45c48 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:42.934582 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 541/1099] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:33:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:33:42.939729 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252e65e-37ff-4e78-b158-d1fab09f12ff None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:42.940146 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252e65e-37ff-4e78-b158-d1fab09f12ff None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:42.940253 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252e65e-37ff-4e78-b158-d1fab09f12ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:42.959331 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-7252e65e-37ff-4e78-b158-d1fab09f12ff None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:42.960595 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-7252e65e-37ff-4e78-b158-d1fab09f12ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:43.022002 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:43.027789 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 559/1100] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:33:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:33:43.296790 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1103069-0af7-4292-87e3-60e39ab45c48 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:43.386971 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:43.397642 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1103069-0af7-4292-87e3-60e39ab45c48 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:43.431781 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd18fb0-86b4-4a2c-ac6d-17da40ea00b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:43.432399 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd18fb0-86b4-4a2c-ac6d-17da40ea00b0 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:43.432674 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd18fb0-86b4-4a2c-ac6d-17da40ea00b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:43.432943 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd18fb0-86b4-4a2c-ac6d-17da40ea00b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:43.443254 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd18fb0-86b4-4a2c-ac6d-17da40ea00b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:33:43.448005 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-acd18fb0-86b4-4a2c-ac6d-17da40ea00b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:33:43.448005 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:33:43.448005 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:33:43.448005 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:33:43.448005 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:33:43.448005 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:33:43.448005 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:33:43.448005 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:33:43.448005 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:33:43.448005 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:33:43.448005 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:33:43.448005 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:33:43.448005 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:33:43.448005 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:33:43.448005 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:33:43.448005 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:33:43.449106 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:33:43.449106 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:33:43.449106 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:33:43.449106 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:33:43.449106 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:33:43.449106 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:33:43.449106 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:33:43.449106 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:33:43.449106 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:33:43.449106 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:33:43.449106 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:33:43.449106 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:33:43.449106 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:33:43.449106 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:33:43.449106 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:33:43.449106 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:33:43.450290 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:33:43.450290 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:33:43.450290 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:33:43.450290 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:33:43.450290 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:33:43.450290 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:33:43.450290 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:33:43.450290 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:33:43.450290 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:33:43.450290 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:33:43.450290 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:33:43.450290 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:33:43.450290 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 542/1101] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Aug 29 22:33:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:33:43.455108 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7252e65e-37ff-4e78-b158-d1fab09f12ff None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:43.553192 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7252e65e-37ff-4e78-b158-d1fab09f12ff None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:43.586800 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559ad679-8fbe-4c56-b329-bacfedfe7489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:43.587389 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ad679-8fbe-4c56-b329-bacfedfe7489 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:43.587667 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ad679-8fbe-4c56-b329-bacfedfe7489 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:43.587935 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ad679-8fbe-4c56-b329-bacfedfe7489 None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:43.588585 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559ad679-8fbe-4c56-b329-bacfedfe7489 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:43.588882 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559ad679-8fbe-4c56-b329-bacfedfe7489 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:43.590267 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559ad679-8fbe-4c56-b329-bacfedfe7489 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:43.598062 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 560/1102] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Aug 29 22:33:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:43.604389 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd18fb0-86b4-4a2c-ac6d-17da40ea00b0 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:43.702392 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd18fb0-86b4-4a2c-ac6d-17da40ea00b0 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:43.736073 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5616e1-d349-4cbe-8964-80724101a4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:43.736693 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5616e1-d349-4cbe-8964-80724101a4b2 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:43.736981 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5616e1-d349-4cbe-8964-80724101a4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:43.737258 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5616e1-d349-4cbe-8964-80724101a4b2 None admin] PATH_INFO: `/v3/users/51579151b1e74db084c17e882795275d` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:43.738403 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5616e1-d349-4cbe-8964-80724101a4b2 None admin] RBAC: Authorizing `identity:get_user(user_id=51579151b1e74db084c17e882795275d)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:43.739871 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5616e1-d349-4cbe-8964-80724101a4b2 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:43.741476 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 543/1103] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Aug 29 22:33:43 2022] GET /identity/v3/users/51579151b1e74db084c17e882795275d => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:43.748335 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559ad679-8fbe-4c56-b329-bacfedfe7489 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:43.807186 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:43.847512 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559ad679-8fbe-4c56-b329-bacfedfe7489 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:43.880115 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada848c7-2d92-4418-a9cb-b67ce8bfa967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:43.881349 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada848c7-2d92-4418-a9cb-b67ce8bfa967 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:43.881698 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada848c7-2d92-4418-a9cb-b67ce8bfa967 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:43.882008 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada848c7-2d92-4418-a9cb-b67ce8bfa967 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:43.948335 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada848c7-2d92-4418-a9cb-b67ce8bfa967 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:43.949817 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada848c7-2d92-4418-a9cb-b67ce8bfa967 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:44.006468 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:44.048419 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 561/1104] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Aug 29 22:33:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 22:33:44.054765 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5616e1-d349-4cbe-8964-80724101a4b2 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:44.074834 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:44.156764 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5616e1-d349-4cbe-8964-80724101a4b2 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:44.189420 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0b7fb5-31c7-4350-a297-1d281ee231a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:44.190037 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b7fb5-31c7-4350-a297-1d281ee231a6 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:44.190316 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b7fb5-31c7-4350-a297-1d281ee231a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:44.190591 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b7fb5-31c7-4350-a297-1d281ee231a6 None admin] PATH_INFO: `/v3/projects/90d30ce0b888433c819ccccde9e15d8d` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:44.191688 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0b7fb5-31c7-4350-a297-1d281ee231a6 None admin] RBAC: Authorizing `identity:get_project(project_id=90d30ce0b888433c819ccccde9e15d8d)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:44.193945 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0b7fb5-31c7-4350-a297-1d281ee231a6 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:44.195580 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 544/1105] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Aug 29 22:33:44 2022] GET /identity/v3/projects/90d30ce0b888433c819ccccde9e15d8d => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:44.201787 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada848c7-2d92-4418-a9cb-b67ce8bfa967 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:44.300907 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada848c7-2d92-4418-a9cb-b67ce8bfa967 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:44.340363 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a405f-81fc-4420-9c3a-05ff97a6b022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:44.340921 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a405f-81fc-4420-9c3a-05ff97a6b022 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:44.341290 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a405f-81fc-4420-9c3a-05ff97a6b022 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:44.341599 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a405f-81fc-4420-9c3a-05ff97a6b022 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:44.342331 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9a405f-81fc-4420-9c3a-05ff97a6b022 None admin] RBAC: Adding query filter params (role.id=d00eabaec96a4956aaec2c37a5819c25, scope.project.id=90d30ce0b888433c819ccccde9e15d8d, user.id=51579151b1e74db084c17e882795275d) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:44.342644 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9a405f-81fc-4420-9c3a-05ff97a6b022 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:44.344077 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9a405f-81fc-4420-9c3a-05ff97a6b022 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:44.350659 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 562/1106] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Aug 29 22:33:44 2022] GET /identity/v3/role_assignments?user.id=51579151b1e74db084c17e882795275d&scope.project.id=90d30ce0b888433c819ccccde9e15d8d&role.id=d00eabaec96a4956aaec2c37a5819c25 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:46.263978 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb6dde3-17ff-415d-9b9a-f5be4848e14b None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:46.264511 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb6dde3-17ff-415d-9b9a-f5be4848e14b None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:46.264625 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb6dde3-17ff-415d-9b9a-f5be4848e14b None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:46.265964 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 545/1107] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:33:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:33:46.271043 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f899192-dd0d-4b6a-a77e-c2f72a7c7cdc None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:46.271464 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f899192-dd0d-4b6a-a77e-c2f72a7c7cdc None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:46.271626 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f899192-dd0d-4b6a-a77e-c2f72a7c7cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:46.290475 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-5f899192-dd0d-4b6a-a77e-c2f72a7c7cdc None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:46.291657 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-5f899192-dd0d-4b6a-a77e-c2f72a7c7cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:46.309508 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:46.358355 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 563/1108] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:33:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:33:46.629752 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb6dde3-17ff-415d-9b9a-f5be4848e14b None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:46.715572 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:46.735130 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb6dde3-17ff-415d-9b9a-f5be4848e14b None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:46.771810 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6be0d0-c141-45df-a543-5259f70ac84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:46.772448 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6be0d0-c141-45df-a543-5259f70ac84a None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:46.772720 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6be0d0-c141-45df-a543-5259f70ac84a None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:46.772991 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6be0d0-c141-45df-a543-5259f70ac84a None admin] PATH_INFO: `/v3/domains/default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:46.774151 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6be0d0-c141-45df-a543-5259f70ac84a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:46.775585 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6be0d0-c141-45df-a543-5259f70ac84a None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:46.777147 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 546/1109] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:33:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:46.783184 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f899192-dd0d-4b6a-a77e-c2f72a7c7cdc None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:46.880154 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f899192-dd0d-4b6a-a77e-c2f72a7c7cdc None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:46.914238 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff19c2bc-e00c-4d25-a353-b3465271664f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:46.914834 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff19c2bc-e00c-4d25-a353-b3465271664f None admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:46.915111 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff19c2bc-e00c-4d25-a353-b3465271664f None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:46.915379 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff19c2bc-e00c-4d25-a353-b3465271664f None admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:46.916029 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff19c2bc-e00c-4d25-a353-b3465271664f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:46.917481 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff19c2bc-e00c-4d25-a353-b3465271664f None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:46.937911 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 564/1110] 10.222.0.47 () {60 vars in 1132 bytes} [Mon Aug 29 22:33:46 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:33:48.972513 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af52411-c24e-402b-a3e9-941368afe96e None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:48.973046 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af52411-c24e-402b-a3e9-941368afe96e None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:48.973046 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af52411-c24e-402b-a3e9-941368afe96e None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:48.974512 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 547/1111] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:33:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:33:48.979794 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd24d6-d635-4835-b3e1-30b45d9bfc61 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:48.980191 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd24d6-d635-4835-b3e1-30b45d9bfc61 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:48.980345 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd24d6-d635-4835-b3e1-30b45d9bfc61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:48.998836 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-04fd24d6-d635-4835-b3e1-30b45d9bfc61 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:49.000015 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-04fd24d6-d635-4835-b3e1-30b45d9bfc61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:49.002747 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:49.068738 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 565/1112] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:33:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:33:49.337982 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af52411-c24e-402b-a3e9-941368afe96e None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:49.439924 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af52411-c24e-402b-a3e9-941368afe96e None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:49.472747 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97b342e-c500-4114-8cdc-b96ee603c815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:49.473389 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b342e-c500-4114-8cdc-b96ee603c815 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:49.473674 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b342e-c500-4114-8cdc-b96ee603c815 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:49.473950 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b342e-c500-4114-8cdc-b96ee603c815 None admin] PATH_INFO: `/v3/roles/066c4a2915d247089e9df06936eb9a97` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:49.475995 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97b342e-c500-4114-8cdc-b96ee603c815 None admin] RBAC: Authorizing `identity:get_role(role_id=066c4a2915d247089e9df06936eb9a97)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:49.477378 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97b342e-c500-4114-8cdc-b96ee603c815 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:49.478685 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 548/1113] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Aug 29 22:33:49 2022] GET /identity/v3/roles/066c4a2915d247089e9df06936eb9a97 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:49.484592 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd24d6-d635-4835-b3e1-30b45d9bfc61 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:49.582551 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd24d6-d635-4835-b3e1-30b45d9bfc61 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:49.616746 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc70859e-b930-4da0-967e-6c33129f58a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:49.617385 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc70859e-b930-4da0-967e-6c33129f58a2 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:49.617667 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc70859e-b930-4da0-967e-6c33129f58a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:49.617940 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc70859e-b930-4da0-967e-6c33129f58a2 None admin] PATH_INFO: `/v3/users/0de4a9c249754426a17cc5e82b444bcb` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:49.627965 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:49.631425 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc70859e-b930-4da0-967e-6c33129f58a2 None admin] RBAC: Authorizing `identity:get_user(user_id=0de4a9c249754426a17cc5e82b444bcb)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:49.633099 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc70859e-b930-4da0-967e-6c33129f58a2 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:49.634749 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 566/1114] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Aug 29 22:33:49 2022] GET /identity/v3/users/0de4a9c249754426a17cc5e82b444bcb => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:49.640478 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97b342e-c500-4114-8cdc-b96ee603c815 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:49.666318 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:49.741761 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97b342e-c500-4114-8cdc-b96ee603c815 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:49.775273 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b01486-1d4d-4ae4-8ae8-2fc779f687ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:49.775875 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b01486-1d4d-4ae4-8ae8-2fc779f687ed None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:49.776157 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b01486-1d4d-4ae4-8ae8-2fc779f687ed None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:49.776469 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b01486-1d4d-4ae4-8ae8-2fc779f687ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:49.842848 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b01486-1d4d-4ae4-8ae8-2fc779f687ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:49.844224 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b01486-1d4d-4ae4-8ae8-2fc779f687ed None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:49.867784 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:49.944045 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 549/1115] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Aug 29 22:33:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 22:33:49.950042 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc70859e-b930-4da0-967e-6c33129f58a2 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:50.047241 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc70859e-b930-4da0-967e-6c33129f58a2 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:50.080036 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f9c8d3-964b-4280-b722-a15fff615e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:50.080649 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f9c8d3-964b-4280-b722-a15fff615e02 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:50.080923 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f9c8d3-964b-4280-b722-a15fff615e02 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:50.081191 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f9c8d3-964b-4280-b722-a15fff615e02 None admin] PATH_INFO: `/v3/projects/90d30ce0b888433c819ccccde9e15d8d` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:50.082309 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f9c8d3-964b-4280-b722-a15fff615e02 None admin] RBAC: Authorizing `identity:get_project(project_id=90d30ce0b888433c819ccccde9e15d8d)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:50.083757 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f9c8d3-964b-4280-b722-a15fff615e02 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:50.085388 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 567/1116] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Aug 29 22:33:49 2022] GET /identity/v3/projects/90d30ce0b888433c819ccccde9e15d8d => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:50.091553 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b01486-1d4d-4ae4-8ae8-2fc779f687ed None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:50.189092 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b01486-1d4d-4ae4-8ae8-2fc779f687ed None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:50.211588 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:50.223414 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a00d9-49d9-466e-8b19-7fea8d36b765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:50.224012 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a00d9-49d9-466e-8b19-7fea8d36b765 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:50.224875 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a00d9-49d9-466e-8b19-7fea8d36b765 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:50.225168 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a00d9-49d9-466e-8b19-7fea8d36b765 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:50.225947 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62a00d9-49d9-466e-8b19-7fea8d36b765 None admin] RBAC: Adding query filter params (role.id=066c4a2915d247089e9df06936eb9a97, scope.project.id=90d30ce0b888433c819ccccde9e15d8d, user.id=0de4a9c249754426a17cc5e82b444bcb) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:50.226254 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62a00d9-49d9-466e-8b19-7fea8d36b765 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:50.227674 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62a00d9-49d9-466e-8b19-7fea8d36b765 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:50.233010 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 550/1117] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Aug 29 22:33:50 2022] GET /identity/v3/role_assignments?user.id=0de4a9c249754426a17cc5e82b444bcb&scope.project.id=90d30ce0b888433c819ccccde9e15d8d&role.id=066c4a2915d247089e9df06936eb9a97 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:52.121861 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b516cd-3049-416b-9d64-e8df545b600d None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:52.122424 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b516cd-3049-416b-9d64-e8df545b600d None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:52.122424 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b516cd-3049-416b-9d64-e8df545b600d None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:52.123732 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 568/1118] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:33:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:33:52.129665 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b6ed0-1134-45a8-ba44-114678bc7093 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:52.130096 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b6ed0-1134-45a8-ba44-114678bc7093 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:52.130750 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b6ed0-1134-45a8-ba44-114678bc7093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:52.151314 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-331b6ed0-1134-45a8-ba44-114678bc7093 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:52.152523 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-331b6ed0-1134-45a8-ba44-114678bc7093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:52.229912 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 551/1119] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:33:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:33:52.524448 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b516cd-3049-416b-9d64-e8df545b600d None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:52.597311 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:52.636704 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b516cd-3049-416b-9d64-e8df545b600d None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:52.671687 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f3dce4-68ea-4244-a0c3-e7ad071dddad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:52.672305 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3dce4-68ea-4244-a0c3-e7ad071dddad None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:52.672580 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3dce4-68ea-4244-a0c3-e7ad071dddad None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:52.672850 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3dce4-68ea-4244-a0c3-e7ad071dddad None admin] PATH_INFO: `/v3/roles/066c4a2915d247089e9df06936eb9a97` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:52.674248 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f3dce4-68ea-4244-a0c3-e7ad071dddad None admin] RBAC: Authorizing `identity:get_role(role_id=066c4a2915d247089e9df06936eb9a97)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:52.675603 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f3dce4-68ea-4244-a0c3-e7ad071dddad None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:52.677087 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 569/1120] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Aug 29 22:33:52 2022] GET /identity/v3/roles/066c4a2915d247089e9df06936eb9a97 => generated 223 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:52.683659 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b6ed0-1134-45a8-ba44-114678bc7093 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:52.784855 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b6ed0-1134-45a8-ba44-114678bc7093 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:52.801716 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:52.821734 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb06092-780d-4a62-9208-6ae12b84b455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:52.822375 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb06092-780d-4a62-9208-6ae12b84b455 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:52.822651 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb06092-780d-4a62-9208-6ae12b84b455 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:52.822922 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb06092-780d-4a62-9208-6ae12b84b455 None admin] PATH_INFO: `/v3/users/0de4a9c249754426a17cc5e82b444bcb` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:52.824051 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb06092-780d-4a62-9208-6ae12b84b455 None admin] RBAC: Authorizing `identity:get_user(user_id=0de4a9c249754426a17cc5e82b444bcb)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:52.825544 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb06092-780d-4a62-9208-6ae12b84b455 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:52.828275 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 552/1121] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Aug 29 22:33:52 2022] GET /identity/v3/users/0de4a9c249754426a17cc5e82b444bcb => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:52.834332 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f3dce4-68ea-4244-a0c3-e7ad071dddad None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:52.935224 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f3dce4-68ea-4244-a0c3-e7ad071dddad None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:52.968098 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb338d1-895d-419a-87eb-a27f43274fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:52.968714 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb338d1-895d-419a-87eb-a27f43274fc6 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:52.968997 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb338d1-895d-419a-87eb-a27f43274fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:52.969267 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb338d1-895d-419a-87eb-a27f43274fc6 None admin] PATH_INFO: `/v3/projects/90d30ce0b888433c819ccccde9e15d8d` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:52.970392 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb338d1-895d-419a-87eb-a27f43274fc6 None admin] RBAC: Authorizing `identity:get_project(project_id=90d30ce0b888433c819ccccde9e15d8d)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:52.971816 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb338d1-895d-419a-87eb-a27f43274fc6 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:52.973438 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 570/1122] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Aug 29 22:33:52 2022] GET /identity/v3/projects/90d30ce0b888433c819ccccde9e15d8d => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:52.980131 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb06092-780d-4a62-9208-6ae12b84b455 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:53.080283 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb06092-780d-4a62-9208-6ae12b84b455 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:53.114218 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2fd966-f898-4b60-a8bd-7fca64ba6179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:53.114868 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2fd966-f898-4b60-a8bd-7fca64ba6179 None admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:53.115213 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2fd966-f898-4b60-a8bd-7fca64ba6179 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:53.115585 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2fd966-f898-4b60-a8bd-7fca64ba6179 None admin] PATH_INFO: `/v3/projects/90d30ce0b888433c819ccccde9e15d8d/users/0de4a9c249754426a17cc5e82b444bcb/roles/066c4a2915d247089e9df06936eb9a97` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:53.117806 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2fd966-f898-4b60-a8bd-7fca64ba6179 None admin] RBAC: Authorizing `identity:create_grant(project_id=90d30ce0b888433c819ccccde9e15d8d, user_id=0de4a9c249754426a17cc5e82b444bcb, role_id=066c4a2915d247089e9df06936eb9a97)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:53.119225 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2fd966-f898-4b60-a8bd-7fca64ba6179 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:53.132128 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 553/1123] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Aug 29 22:33:52 2022] PUT /identity/v3/projects/90d30ce0b888433c819ccccde9e15d8d/users/0de4a9c249754426a17cc5e82b444bcb/roles/066c4a2915d247089e9df06936eb9a97 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:33:55.044459 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ec604-fa54-469e-b62e-09fab68084bd None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:55.045020 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ec604-fa54-469e-b62e-09fab68084bd None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:55.045020 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ec604-fa54-469e-b62e-09fab68084bd None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:55.046402 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 571/1124] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:33:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:33:55.052975 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cca02c-3c40-462d-8496-f9b763f69cfc None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:55.053399 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cca02c-3c40-462d-8496-f9b763f69cfc None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:55.053625 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cca02c-3c40-462d-8496-f9b763f69cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:55.072179 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-45cca02c-3c40-462d-8496-f9b763f69cfc None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:55.073411 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-45cca02c-3c40-462d-8496-f9b763f69cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:55.112931 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:55.142033 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 554/1125] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:33:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:33:55.423278 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3ec604-fa54-469e-b62e-09fab68084bd None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:55.426229 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:55.526699 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3ec604-fa54-469e-b62e-09fab68084bd None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:55.560343 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a136d4b-d551-4aa5-816a-1e13529cf604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:55.560892 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a136d4b-d551-4aa5-816a-1e13529cf604 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:55.561170 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a136d4b-d551-4aa5-816a-1e13529cf604 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:55.561476 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a136d4b-d551-4aa5-816a-1e13529cf604 None admin] PATH_INFO: `/v3/roles/066c4a2915d247089e9df06936eb9a97` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:55.562855 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a136d4b-d551-4aa5-816a-1e13529cf604 None admin] RBAC: Authorizing `identity:get_role(role_id=066c4a2915d247089e9df06936eb9a97)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:55.564213 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a136d4b-d551-4aa5-816a-1e13529cf604 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:55.565540 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 572/1126] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Aug 29 22:33:55 2022] GET /identity/v3/roles/066c4a2915d247089e9df06936eb9a97 => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:55.571539 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cca02c-3c40-462d-8496-f9b763f69cfc None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:55.676484 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cca02c-3c40-462d-8496-f9b763f69cfc None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:55.710559 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b567d2a-7aa6-4371-96cd-1728207d32af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:55.711187 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b567d2a-7aa6-4371-96cd-1728207d32af None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:55.711483 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b567d2a-7aa6-4371-96cd-1728207d32af None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:55.711751 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b567d2a-7aa6-4371-96cd-1728207d32af None admin] PATH_INFO: `/v3/users/0de4a9c249754426a17cc5e82b444bcb` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:55.712878 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b567d2a-7aa6-4371-96cd-1728207d32af None admin] RBAC: Authorizing `identity:get_user(user_id=0de4a9c249754426a17cc5e82b444bcb)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:55.714348 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b567d2a-7aa6-4371-96cd-1728207d32af None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:55.715936 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 555/1127] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Aug 29 22:33:55 2022] GET /identity/v3/users/0de4a9c249754426a17cc5e82b444bcb => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:55.721757 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a136d4b-d551-4aa5-816a-1e13529cf604 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:55.791058 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:55.820974 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a136d4b-d551-4aa5-816a-1e13529cf604 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:55.854448 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be782043-86d2-47d0-873c-6887fe684dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:55.855032 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be782043-86d2-47d0-873c-6887fe684dcd None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:55.855306 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be782043-86d2-47d0-873c-6887fe684dcd None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:55.855571 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be782043-86d2-47d0-873c-6887fe684dcd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:55.921839 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be782043-86d2-47d0-873c-6887fe684dcd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:55.923275 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be782043-86d2-47d0-873c-6887fe684dcd None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:55.989868 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:56.022297 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 573/1128] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Aug 29 22:33:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 22:33:56.028249 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b567d2a-7aa6-4371-96cd-1728207d32af None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:56.071341 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:56.127000 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b567d2a-7aa6-4371-96cd-1728207d32af None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:56.161054 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c01cea-ff32-4d5a-9327-7279433fbdc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:56.161732 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c01cea-ff32-4d5a-9327-7279433fbdc5 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:56.162017 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c01cea-ff32-4d5a-9327-7279433fbdc5 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:56.162295 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c01cea-ff32-4d5a-9327-7279433fbdc5 None admin] PATH_INFO: `/v3/projects/90d30ce0b888433c819ccccde9e15d8d` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:56.163409 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c01cea-ff32-4d5a-9327-7279433fbdc5 None admin] RBAC: Authorizing `identity:get_project(project_id=90d30ce0b888433c819ccccde9e15d8d)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:56.164843 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c01cea-ff32-4d5a-9327-7279433fbdc5 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:56.166497 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 556/1129] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Aug 29 22:33:56 2022] GET /identity/v3/projects/90d30ce0b888433c819ccccde9e15d8d => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:56.172577 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be782043-86d2-47d0-873c-6887fe684dcd None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:56.270760 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be782043-86d2-47d0-873c-6887fe684dcd None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:56.304735 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb9bc7-185d-4812-8a50-6455563b09c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:56.305349 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb9bc7-185d-4812-8a50-6455563b09c3 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:56.305627 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb9bc7-185d-4812-8a50-6455563b09c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:56.305894 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb9bc7-185d-4812-8a50-6455563b09c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:56.306616 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfb9bc7-185d-4812-8a50-6455563b09c3 None admin] RBAC: Adding query filter params (role.id=066c4a2915d247089e9df06936eb9a97, scope.project.id=90d30ce0b888433c819ccccde9e15d8d, user.id=0de4a9c249754426a17cc5e82b444bcb) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:33:56.307416 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfb9bc7-185d-4812-8a50-6455563b09c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:56.308322 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfb9bc7-185d-4812-8a50-6455563b09c3 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:56.314114 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 574/1130] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Aug 29 22:33:56 2022] GET /identity/v3/role_assignments?user.id=0de4a9c249754426a17cc5e82b444bcb&scope.project.id=90d30ce0b888433c819ccccde9e15d8d&role.id=066c4a2915d247089e9df06936eb9a97 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:58.212059 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891aa4e5-b54b-4e07-86c0-ab7a3b4ee6ad None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:58.212615 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891aa4e5-b54b-4e07-86c0-ab7a3b4ee6ad None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:58.212615 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891aa4e5-b54b-4e07-86c0-ab7a3b4ee6ad None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:58.213952 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 557/1131] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:33:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:33:58.219022 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76303b5-ff7e-40a3-9e43-abce0a0b52c4 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:58.219459 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76303b5-ff7e-40a3-9e43-abce0a0b52c4 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:58.219553 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76303b5-ff7e-40a3-9e43-abce0a0b52c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:58.237805 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-f76303b5-ff7e-40a3-9e43-abce0a0b52c4 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:33:58.238990 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-f76303b5-ff7e-40a3-9e43-abce0a0b52c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:33:58.265806 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:58.307505 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 575/1132] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:33:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:33:58.577154 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891aa4e5-b54b-4e07-86c0-ab7a3b4ee6ad None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:58.685935 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891aa4e5-b54b-4e07-86c0-ab7a3b4ee6ad None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:58.696560 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:33:58.725653 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af4c187-79fe-493b-9b7d-145379eeb8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:58.726275 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4c187-79fe-493b-9b7d-145379eeb8a8 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:58.726551 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4c187-79fe-493b-9b7d-145379eeb8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:58.726822 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4c187-79fe-493b-9b7d-145379eeb8a8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:58.727919 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af4c187-79fe-493b-9b7d-145379eeb8a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:58.729348 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af4c187-79fe-493b-9b7d-145379eeb8a8 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:58.730911 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 558/1133] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:33:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:33:58.736797 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76303b5-ff7e-40a3-9e43-abce0a0b52c4 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:33:58.832850 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76303b5-ff7e-40a3-9e43-abce0a0b52c4 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:33:58.866792 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcaffde-77c6-496f-94ab-42459cb2e2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:33:58.867389 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcaffde-77c6-496f-94ab-42459cb2e2f3 None admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:33:58.867669 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcaffde-77c6-496f-94ab-42459cb2e2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:33:58.867939 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcaffde-77c6-496f-94ab-42459cb2e2f3 None admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:33:58.868579 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcaffde-77c6-496f-94ab-42459cb2e2f3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:33:58.870039 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcaffde-77c6-496f-94ab-42459cb2e2f3 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:33:58.898036 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 576/1134] 10.222.0.47 () {60 vars in 1141 bytes} [Mon Aug 29 22:33:58 2022] POST /identity/v3/projects => generated 311 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:34:00.845995 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507acf97-5c3f-41d4-8a81-77b82f310d35 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:00.846560 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507acf97-5c3f-41d4-8a81-77b82f310d35 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:00.846560 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507acf97-5c3f-41d4-8a81-77b82f310d35 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:00.847879 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 559/1135] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:34:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:34:00.853486 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f35a1f-f9ae-47fe-a7ae-7e5634bc195d None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:00.853939 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f35a1f-f9ae-47fe-a7ae-7e5634bc195d None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:00.854043 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f35a1f-f9ae-47fe-a7ae-7e5634bc195d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:00.872686 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-c2f35a1f-f9ae-47fe-a7ae-7e5634bc195d None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:34:00.873915 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-c2f35a1f-f9ae-47fe-a7ae-7e5634bc195d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:00.885315 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:00.941643 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 577/1136] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:34:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:34:01.213553 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507acf97-5c3f-41d4-8a81-77b82f310d35 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:01.315467 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507acf97-5c3f-41d4-8a81-77b82f310d35 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:01.349952 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d36f8a8-9f8f-41b4-a864-4ef7949050be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:01.350590 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d36f8a8-9f8f-41b4-a864-4ef7949050be None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:01.350886 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d36f8a8-9f8f-41b4-a864-4ef7949050be None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:01.351163 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d36f8a8-9f8f-41b4-a864-4ef7949050be None admin] PATH_INFO: `/v3/domains/default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:01.352298 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d36f8a8-9f8f-41b4-a864-4ef7949050be None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:01.353763 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d36f8a8-9f8f-41b4-a864-4ef7949050be None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:01.355333 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 560/1137] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:34:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:34:01.361080 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f35a1f-f9ae-47fe-a7ae-7e5634bc195d None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:01.458391 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f35a1f-f9ae-47fe-a7ae-7e5634bc195d None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:01.492145 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4bdd0f-d61c-4b94-9da2-a6a9d6cb9165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:01.492672 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4bdd0f-d61c-4b94-9da2-a6a9d6cb9165 None admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:01.492949 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4bdd0f-d61c-4b94-9da2-a6a9d6cb9165 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:01.493217 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4bdd0f-d61c-4b94-9da2-a6a9d6cb9165 None admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:01.493898 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4bdd0f-d61c-4b94-9da2-a6a9d6cb9165 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:01.495318 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4bdd0f-d61c-4b94-9da2-a6a9d6cb9165 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:01.516253 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 578/1138] 10.222.0.47 () {60 vars in 1132 bytes} [Mon Aug 29 22:34:01 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:34:03.488312 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374a4ce-1875-4688-96d6-3373ac4dd6b8 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:03.488858 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374a4ce-1875-4688-96d6-3373ac4dd6b8 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:03.488858 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374a4ce-1875-4688-96d6-3373ac4dd6b8 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:03.490510 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 561/1139] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:34:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:34:03.495828 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b882b28-20fb-48ff-b29a-1d019fc38d6f None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:03.496234 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b882b28-20fb-48ff-b29a-1d019fc38d6f None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:03.496379 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b882b28-20fb-48ff-b29a-1d019fc38d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:03.502626 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:03.516389 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-4b882b28-20fb-48ff-b29a-1d019fc38d6f None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:34:03.517620 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-4b882b28-20fb-48ff-b29a-1d019fc38d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:03.583498 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 579/1140] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:34:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:34:03.854885 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5374a4ce-1875-4688-96d6-3373ac4dd6b8 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:03.903543 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:03.957269 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5374a4ce-1875-4688-96d6-3373ac4dd6b8 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:03.991770 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f3ac2-656f-484c-aa3b-7c39b33f7355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:03.992372 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f3ac2-656f-484c-aa3b-7c39b33f7355 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:03.992793 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f3ac2-656f-484c-aa3b-7c39b33f7355 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:03.993207 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f3ac2-656f-484c-aa3b-7c39b33f7355 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:04.008759 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60f3ac2-656f-484c-aa3b-7c39b33f7355 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:34:04.016602 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-f60f3ac2-656f-484c-aa3b-7c39b33f7355 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:34:04.016602 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:34:04.016602 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:34:04.016602 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:34:04.016602 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:34:04.016602 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:34:04.016602 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:34:04.016602 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:34:04.016602 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:34:04.016602 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:34:04.016602 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:34:04.016602 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:34:04.016602 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:34:04.016602 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:34:04.016602 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:34:04.016602 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:34:04.017617 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:34:04.017617 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:34:04.017617 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:34:04.017617 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:34:04.017617 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:34:04.017617 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:34:04.017617 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:34:04.017617 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:34:04.017617 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:34:04.017617 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:34:04.017617 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:34:04.017617 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:34:04.017617 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:34:04.017617 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:34:04.017617 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:34:04.017617 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:34:04.018526 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:34:04.018526 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:34:04.018526 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:34:04.018526 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:34:04.018526 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:34:04.018526 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:34:04.018526 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:34:04.018526 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:34:04.018526 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:34:04.018526 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:34:04.018526 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:34:04.018526 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:34:04.018526 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 562/1141] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Aug 29 22:34:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:34:04.025286 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b882b28-20fb-48ff-b29a-1d019fc38d6f None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:04.126906 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b882b28-20fb-48ff-b29a-1d019fc38d6f None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:04.155049 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:04.160843 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f204ccf1-1427-4f81-b584-fd8fc312cdc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:04.161476 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204ccf1-1427-4f81-b584-fd8fc312cdc4 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:04.162266 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204ccf1-1427-4f81-b584-fd8fc312cdc4 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:04.162532 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204ccf1-1427-4f81-b584-fd8fc312cdc4 None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:04.163198 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f204ccf1-1427-4f81-b584-fd8fc312cdc4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:34:04.163499 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f204ccf1-1427-4f81-b584-fd8fc312cdc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:04.164866 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f204ccf1-1427-4f81-b584-fd8fc312cdc4 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:04.172980 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 580/1142] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Aug 29 22:34:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:34:04.179471 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f3ac2-656f-484c-aa3b-7c39b33f7355 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:04.280243 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f3ac2-656f-484c-aa3b-7c39b33f7355 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:04.288372 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:04.318043 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4cd471-0273-4090-aa91-be20d4647ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:04.318782 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4cd471-0273-4090-aa91-be20d4647ef1 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:04.319064 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4cd471-0273-4090-aa91-be20d4647ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:04.319340 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4cd471-0273-4090-aa91-be20d4647ef1 None admin] PATH_INFO: `/v3/users/57bbabeb0ad44a9fb132a06f44f87922` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:04.332320 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4cd471-0273-4090-aa91-be20d4647ef1 None admin] RBAC: Authorizing `identity:get_user(user_id=57bbabeb0ad44a9fb132a06f44f87922)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:04.333844 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4cd471-0273-4090-aa91-be20d4647ef1 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:04.335445 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 563/1143] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Aug 29 22:34:04 2022] GET /identity/v3/users/57bbabeb0ad44a9fb132a06f44f87922 => generated 286 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:34:04.341410 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f204ccf1-1427-4f81-b584-fd8fc312cdc4 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:04.441387 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f204ccf1-1427-4f81-b584-fd8fc312cdc4 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:04.474906 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f3e6f3-efcf-45d8-bfc3-d84622e1aa05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:04.475496 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3e6f3-efcf-45d8-bfc3-d84622e1aa05 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:04.475774 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3e6f3-efcf-45d8-bfc3-d84622e1aa05 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:04.476046 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3e6f3-efcf-45d8-bfc3-d84622e1aa05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:04.534721 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:04.542834 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f3e6f3-efcf-45d8-bfc3-d84622e1aa05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:04.544266 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f3e6f3-efcf-45d8-bfc3-d84622e1aa05 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:04.640129 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 581/1144] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Aug 29 22:34:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 22:34:04.646185 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4cd471-0273-4090-aa91-be20d4647ef1 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:04.746980 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4cd471-0273-4090-aa91-be20d4647ef1 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:04.780024 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a98bcd-0924-4295-af73-44c03131414c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:04.780640 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a98bcd-0924-4295-af73-44c03131414c None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:04.780917 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a98bcd-0924-4295-af73-44c03131414c None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:04.781185 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a98bcd-0924-4295-af73-44c03131414c None admin] PATH_INFO: `/v3/projects/52d1250452c94305a26840c217a8794e` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:04.782575 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a98bcd-0924-4295-af73-44c03131414c None admin] RBAC: Authorizing `identity:get_project(project_id=52d1250452c94305a26840c217a8794e)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:04.783990 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a98bcd-0924-4295-af73-44c03131414c None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:04.785637 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 564/1145] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Aug 29 22:34:04 2022] GET /identity/v3/projects/52d1250452c94305a26840c217a8794e => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:34:04.792434 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f3e6f3-efcf-45d8-bfc3-d84622e1aa05 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:04.883987 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:04.890748 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f3e6f3-efcf-45d8-bfc3-d84622e1aa05 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:04.925083 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b99538-e222-4dc4-b88c-9fbfb1fd18ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:04.925696 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b99538-e222-4dc4-b88c-9fbfb1fd18ee None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:04.925971 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b99538-e222-4dc4-b88c-9fbfb1fd18ee None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:04.926236 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b99538-e222-4dc4-b88c-9fbfb1fd18ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:04.926948 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b99538-e222-4dc4-b88c-9fbfb1fd18ee None admin] RBAC: Adding query filter params (role.id=d00eabaec96a4956aaec2c37a5819c25, scope.project.id=52d1250452c94305a26840c217a8794e, user.id=57bbabeb0ad44a9fb132a06f44f87922) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:34:04.927247 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b99538-e222-4dc4-b88c-9fbfb1fd18ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:04.929141 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b99538-e222-4dc4-b88c-9fbfb1fd18ee None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:04.934348 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 582/1146] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Aug 29 22:34:04 2022] GET /identity/v3/role_assignments?user.id=57bbabeb0ad44a9fb132a06f44f87922&scope.project.id=52d1250452c94305a26840c217a8794e&role.id=d00eabaec96a4956aaec2c37a5819c25 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:34:06.796145 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9109eda-8f08-4bfe-8b33-c40468d016d7 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:06.796672 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9109eda-8f08-4bfe-8b33-c40468d016d7 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:06.796672 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9109eda-8f08-4bfe-8b33-c40468d016d7 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:06.798058 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 565/1147] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:34:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:34:06.803757 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d036428-0a5b-4d5d-ae73-bb0f1a8f8948 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:06.804183 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d036428-0a5b-4d5d-ae73-bb0f1a8f8948 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:06.804307 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d036428-0a5b-4d5d-ae73-bb0f1a8f8948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:06.822935 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-8d036428-0a5b-4d5d-ae73-bb0f1a8f8948 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:34:06.824128 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-8d036428-0a5b-4d5d-ae73-bb0f1a8f8948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:06.892309 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 583/1148] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:34:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:34:07.157072 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9109eda-8f08-4bfe-8b33-c40468d016d7 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:07.188552 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:07.260464 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9109eda-8f08-4bfe-8b33-c40468d016d7 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:07.294318 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99353a1-38d8-4bf9-a2eb-e64f39a248ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:07.294945 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99353a1-38d8-4bf9-a2eb-e64f39a248ac None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:07.295223 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99353a1-38d8-4bf9-a2eb-e64f39a248ac None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:07.295496 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99353a1-38d8-4bf9-a2eb-e64f39a248ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:07.306500 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99353a1-38d8-4bf9-a2eb-e64f39a248ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:34:07.311349 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-e99353a1-38d8-4bf9-a2eb-e64f39a248ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:34:07.311349 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:34:07.311349 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:34:07.311349 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:34:07.311349 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:34:07.311349 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:34:07.311349 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:34:07.311349 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:34:07.311349 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:34:07.311349 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:34:07.311349 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:34:07.311349 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:34:07.311349 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:34:07.311349 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:34:07.311349 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:34:07.311349 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:34:07.312441 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:34:07.312441 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:34:07.312441 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:34:07.312441 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:34:07.312441 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:34:07.312441 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:34:07.312441 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:34:07.312441 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:34:07.312441 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:34:07.312441 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:34:07.312441 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:34:07.312441 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:34:07.312441 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:34:07.312441 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:34:07.312441 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:34:07.312441 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:34:07.313489 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:34:07.313489 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:34:07.313489 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:34:07.313489 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:34:07.313489 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:34:07.313489 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:34:07.313489 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:34:07.313489 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:34:07.313489 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:34:07.313489 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:34:07.313489 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:34:07.313489 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:34:07.313489 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 566/1149] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Aug 29 22:34:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:34:07.318615 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d036428-0a5b-4d5d-ae73-bb0f1a8f8948 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:07.403567 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:07.416761 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d036428-0a5b-4d5d-ae73-bb0f1a8f8948 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:07.450608 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851e93ac-7a2b-420a-8976-80ae61fe3ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:07.451198 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e93ac-7a2b-420a-8976-80ae61fe3ef7 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:07.451473 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e93ac-7a2b-420a-8976-80ae61fe3ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:07.451740 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e93ac-7a2b-420a-8976-80ae61fe3ef7 None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:07.452385 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851e93ac-7a2b-420a-8976-80ae61fe3ef7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:34:07.452680 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851e93ac-7a2b-420a-8976-80ae61fe3ef7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:07.454053 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851e93ac-7a2b-420a-8976-80ae61fe3ef7 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:07.462655 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 584/1150] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Aug 29 22:34:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:34:07.468439 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99353a1-38d8-4bf9-a2eb-e64f39a248ac None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:07.559048 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:07.568790 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99353a1-38d8-4bf9-a2eb-e64f39a248ac None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:07.603233 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1522ed65-c6e6-4182-8c79-e7841d4873ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:07.603859 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1522ed65-c6e6-4182-8c79-e7841d4873ba None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:07.604143 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1522ed65-c6e6-4182-8c79-e7841d4873ba None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:07.604421 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1522ed65-c6e6-4182-8c79-e7841d4873ba None admin] PATH_INFO: `/v3/users/57bbabeb0ad44a9fb132a06f44f87922` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:07.605568 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1522ed65-c6e6-4182-8c79-e7841d4873ba None admin] RBAC: Authorizing `identity:get_user(user_id=57bbabeb0ad44a9fb132a06f44f87922)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:07.607002 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1522ed65-c6e6-4182-8c79-e7841d4873ba None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:07.608578 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 567/1151] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Aug 29 22:34:07 2022] GET /identity/v3/users/57bbabeb0ad44a9fb132a06f44f87922 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:34:07.614386 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851e93ac-7a2b-420a-8976-80ae61fe3ef7 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:07.712917 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851e93ac-7a2b-420a-8976-80ae61fe3ef7 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:07.745743 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92034c74-e8c7-4c32-8892-230dc4267568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:07.746354 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92034c74-e8c7-4c32-8892-230dc4267568 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:07.746633 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92034c74-e8c7-4c32-8892-230dc4267568 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:07.746905 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92034c74-e8c7-4c32-8892-230dc4267568 None admin] PATH_INFO: `/v3/projects/52d1250452c94305a26840c217a8794e` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:07.748010 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92034c74-e8c7-4c32-8892-230dc4267568 None admin] RBAC: Authorizing `identity:get_project(project_id=52d1250452c94305a26840c217a8794e)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:07.749455 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92034c74-e8c7-4c32-8892-230dc4267568 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:07.751061 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 585/1152] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Aug 29 22:34:07 2022] GET /identity/v3/projects/52d1250452c94305a26840c217a8794e => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:34:07.757129 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1522ed65-c6e6-4182-8c79-e7841d4873ba None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:07.854911 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1522ed65-c6e6-4182-8c79-e7841d4873ba None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:07.888310 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adc4caf-e011-48ae-8b2a-40e2364e0ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:07.888952 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc4caf-e011-48ae-8b2a-40e2364e0ad8 None admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:07.889227 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc4caf-e011-48ae-8b2a-40e2364e0ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:07.889534 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc4caf-e011-48ae-8b2a-40e2364e0ad8 None admin] PATH_INFO: `/v3/projects/52d1250452c94305a26840c217a8794e/users/57bbabeb0ad44a9fb132a06f44f87922/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:07.891394 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adc4caf-e011-48ae-8b2a-40e2364e0ad8 None admin] RBAC: Authorizing `identity:create_grant(project_id=52d1250452c94305a26840c217a8794e, user_id=57bbabeb0ad44a9fb132a06f44f87922, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:07.892805 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adc4caf-e011-48ae-8b2a-40e2364e0ad8 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:07.906136 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 568/1153] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Aug 29 22:34:07 2022] PUT /identity/v3/projects/52d1250452c94305a26840c217a8794e/users/57bbabeb0ad44a9fb132a06f44f87922/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:34:09.785878 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f49b7-7b00-4d33-875b-fdb400cf2b26 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:09.786429 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f49b7-7b00-4d33-875b-fdb400cf2b26 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:09.786429 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f49b7-7b00-4d33-875b-fdb400cf2b26 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:09.788359 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 586/1154] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:34:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:34:09.793489 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27eff1-f0a2-4a87-92ba-878ac8136a35 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:09.793928 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27eff1-f0a2-4a87-92ba-878ac8136a35 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:09.794045 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27eff1-f0a2-4a87-92ba-878ac8136a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:09.812144 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-dc27eff1-f0a2-4a87-92ba-878ac8136a35 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:34:09.813365 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-dc27eff1-f0a2-4a87-92ba-878ac8136a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:09.827276 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:09.880191 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 569/1155] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:34:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:34:10.150001 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979f49b7-7b00-4d33-875b-fdb400cf2b26 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:10.169684 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:10.251441 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979f49b7-7b00-4d33-875b-fdb400cf2b26 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:10.286983 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3bdad1-4041-4762-997f-98ec734897cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:10.287620 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3bdad1-4041-4762-997f-98ec734897cc None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:10.287894 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3bdad1-4041-4762-997f-98ec734897cc None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:10.288168 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3bdad1-4041-4762-997f-98ec734897cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:10.298265 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3bdad1-4041-4762-997f-98ec734897cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:34:10.303260 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-ce3bdad1-4041-4762-997f-98ec734897cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:34:10.303260 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:34:10.303260 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:34:10.303260 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:34:10.303260 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:34:10.303260 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:34:10.303260 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:34:10.303260 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:34:10.303260 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:34:10.303260 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:34:10.303260 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:34:10.303260 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:34:10.303260 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:34:10.303260 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:34:10.303260 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:34:10.303260 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:34:10.304183 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:34:10.304183 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:34:10.304183 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:34:10.304183 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:34:10.304183 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:34:10.304183 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:34:10.304183 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:34:10.304183 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:34:10.304183 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:34:10.304183 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:34:10.304183 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:34:10.304183 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:34:10.304183 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:34:10.304183 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:34:10.304183 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:34:10.304183 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:34:10.305298 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:34:10.305298 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:34:10.305298 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:34:10.305298 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:34:10.305298 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:34:10.305298 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:34:10.305298 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:34:10.305298 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:34:10.305298 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:34:10.305298 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:34:10.305298 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:34:10.305298 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:34:10.305298 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 587/1156] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Aug 29 22:34:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:34:10.310439 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc27eff1-f0a2-4a87-92ba-878ac8136a35 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:10.405870 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc27eff1-f0a2-4a87-92ba-878ac8136a35 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:10.438446 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28f1ca1-121a-4bad-bd46-6d060213b302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:10.439042 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f1ca1-121a-4bad-bd46-6d060213b302 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:10.439318 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f1ca1-121a-4bad-bd46-6d060213b302 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:10.439584 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f1ca1-121a-4bad-bd46-6d060213b302 None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:10.440227 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28f1ca1-121a-4bad-bd46-6d060213b302 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:34:10.440525 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28f1ca1-121a-4bad-bd46-6d060213b302 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:10.441912 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28f1ca1-121a-4bad-bd46-6d060213b302 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:10.450474 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 570/1157] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Aug 29 22:34:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:34:10.456368 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3bdad1-4041-4762-997f-98ec734897cc None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:10.535094 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:10.557205 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3bdad1-4041-4762-997f-98ec734897cc None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:10.590381 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916843f3-ea6b-40e9-bbcf-dc7d0229c410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:10.590996 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916843f3-ea6b-40e9-bbcf-dc7d0229c410 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:10.591270 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916843f3-ea6b-40e9-bbcf-dc7d0229c410 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:10.591539 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916843f3-ea6b-40e9-bbcf-dc7d0229c410 None admin] PATH_INFO: `/v3/users/57bbabeb0ad44a9fb132a06f44f87922` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:10.592630 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916843f3-ea6b-40e9-bbcf-dc7d0229c410 None admin] RBAC: Authorizing `identity:get_user(user_id=57bbabeb0ad44a9fb132a06f44f87922)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:10.594075 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916843f3-ea6b-40e9-bbcf-dc7d0229c410 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:10.595616 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 588/1158] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Aug 29 22:34:10 2022] GET /identity/v3/users/57bbabeb0ad44a9fb132a06f44f87922 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:34:10.601679 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28f1ca1-121a-4bad-bd46-6d060213b302 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:10.618127 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:10.706369 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28f1ca1-121a-4bad-bd46-6d060213b302 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:10.738902 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0469ef5-9915-442c-a4cf-87155fce2221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:10.739529 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0469ef5-9915-442c-a4cf-87155fce2221 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:10.739807 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0469ef5-9915-442c-a4cf-87155fce2221 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:10.740686 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0469ef5-9915-442c-a4cf-87155fce2221 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:10.807798 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0469ef5-9915-442c-a4cf-87155fce2221 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:10.809245 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0469ef5-9915-442c-a4cf-87155fce2221 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:10.823234 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:10.905693 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 571/1159] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Aug 29 22:34:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 22:34:10.912478 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916843f3-ea6b-40e9-bbcf-dc7d0229c410 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:11.014497 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916843f3-ea6b-40e9-bbcf-dc7d0229c410 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:11.048256 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3846276b-7fc5-4c9c-a37a-04efce682e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:11.048879 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3846276b-7fc5-4c9c-a37a-04efce682e75 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:11.049160 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3846276b-7fc5-4c9c-a37a-04efce682e75 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:11.049463 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3846276b-7fc5-4c9c-a37a-04efce682e75 None admin] PATH_INFO: `/v3/projects/52d1250452c94305a26840c217a8794e` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:11.050580 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3846276b-7fc5-4c9c-a37a-04efce682e75 None admin] RBAC: Authorizing `identity:get_project(project_id=52d1250452c94305a26840c217a8794e)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:11.052016 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3846276b-7fc5-4c9c-a37a-04efce682e75 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:11.054508 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 589/1160] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Aug 29 22:34:10 2022] GET /identity/v3/projects/52d1250452c94305a26840c217a8794e => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:34:11.060790 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0469ef5-9915-442c-a4cf-87155fce2221 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:11.159013 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0469ef5-9915-442c-a4cf-87155fce2221 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:11.172364 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:11.193610 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647c045f-6b12-44fc-9c09-30f9d99906df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:11.194203 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c045f-6b12-44fc-9c09-30f9d99906df None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:11.194483 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c045f-6b12-44fc-9c09-30f9d99906df None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:11.194754 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c045f-6b12-44fc-9c09-30f9d99906df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:11.195473 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647c045f-6b12-44fc-9c09-30f9d99906df None admin] RBAC: Adding query filter params (role.id=d00eabaec96a4956aaec2c37a5819c25, scope.project.id=52d1250452c94305a26840c217a8794e, user.id=57bbabeb0ad44a9fb132a06f44f87922) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:34:11.195778 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647c045f-6b12-44fc-9c09-30f9d99906df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:11.197200 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647c045f-6b12-44fc-9c09-30f9d99906df None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:11.202833 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 572/1161] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Aug 29 22:34:11 2022] GET /identity/v3/role_assignments?user.id=57bbabeb0ad44a9fb132a06f44f87922&scope.project.id=52d1250452c94305a26840c217a8794e&role.id=d00eabaec96a4956aaec2c37a5819c25 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:34:13.137983 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7627159-6bac-4bcb-af90-733b7c9717d4 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:13.138549 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7627159-6bac-4bcb-af90-733b7c9717d4 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:13.138549 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7627159-6bac-4bcb-af90-733b7c9717d4 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:13.139860 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 590/1162] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:34:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:34:13.145074 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514f0b2a-b85b-4764-bbbe-6d6f7504ba76 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:13.145519 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514f0b2a-b85b-4764-bbbe-6d6f7504ba76 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:13.145656 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514f0b2a-b85b-4764-bbbe-6d6f7504ba76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:13.164391 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-514f0b2a-b85b-4764-bbbe-6d6f7504ba76 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:34:13.165628 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-514f0b2a-b85b-4764-bbbe-6d6f7504ba76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:13.231497 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 573/1163] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:34:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:34:13.501873 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7627159-6bac-4bcb-af90-733b7c9717d4 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:13.518409 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:13.603256 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7627159-6bac-4bcb-af90-733b7c9717d4 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:13.636807 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7fc526-e2f4-4c63-9aef-f550b6ce661e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:13.637427 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7fc526-e2f4-4c63-9aef-f550b6ce661e None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:13.637708 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7fc526-e2f4-4c63-9aef-f550b6ce661e None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:13.637979 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7fc526-e2f4-4c63-9aef-f550b6ce661e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:13.703465 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7fc526-e2f4-4c63-9aef-f550b6ce661e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:13.704905 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7fc526-e2f4-4c63-9aef-f550b6ce661e None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:13.718948 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:13.800488 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 591/1164] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Aug 29 22:34:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 22:34:13.806893 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514f0b2a-b85b-4764-bbbe-6d6f7504ba76 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:13.903297 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514f0b2a-b85b-4764-bbbe-6d6f7504ba76 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:13.910707 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:13.938732 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7e271e-baf1-41bd-9045-68cab6abf277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:13.939353 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e271e-baf1-41bd-9045-68cab6abf277 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:13.939634 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e271e-baf1-41bd-9045-68cab6abf277 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:13.939904 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e271e-baf1-41bd-9045-68cab6abf277 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:13.946500 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7e271e-baf1-41bd-9045-68cab6abf277 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:13.947935 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7e271e-baf1-41bd-9045-68cab6abf277 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:13.959243 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-0d7e271e-baf1-41bd-9045-68cab6abf277 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 29 22:34:13.959243 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:34:13.959243 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 29 22:34:13.959243 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 29 22:34:13.959243 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:34:13.959243 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:34:13.959243 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:34:13.959243 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:34:13.959243 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 29 22:34:13.959243 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:34:13.959243 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:34:13.959243 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:34:13.959243 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:34:13.959243 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:34:13.959243 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:34:13.959243 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:34:13.959243 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:34:13.960429 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:34:13.960429 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:34:13.960429 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:34:13.960429 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:34:13.960429 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:34:13.960429 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:34:13.960429 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:34:13.960429 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:34:13.960429 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:34:13.960429 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:34:13.960429 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:34:13.960429 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:34:13.960429 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:34:13.960429 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:34:13.960429 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:34:13.960429 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:34:13.961284 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:34:13.961284 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:34:13.961284 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:34:13.961284 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:34:13.961284 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:34:13.961284 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:34:13.961284 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:34:13.961284 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:34:13.961284 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:34:13.961284 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:34:13.961284 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 29 22:34:13.961284 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:34:13.961284 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 29 22:34:13.961284 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:34:13.961284 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 574/1165] 10.222.0.47 () {56 vars in 1117 bytes} [Mon Aug 29 22:34:13 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:34:13.966327 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7fc526-e2f4-4c63-9aef-f550b6ce661e None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:14.066707 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7fc526-e2f4-4c63-9aef-f550b6ce661e None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:14.081201 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:14.102481 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e2fa59-0bba-44de-8f6d-6448a6efd538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:14.103074 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2fa59-0bba-44de-8f6d-6448a6efd538 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:14.103351 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2fa59-0bba-44de-8f6d-6448a6efd538 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:14.103619 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2fa59-0bba-44de-8f6d-6448a6efd538 None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:14.104245 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e2fa59-0bba-44de-8f6d-6448a6efd538 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:34:14.104540 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e2fa59-0bba-44de-8f6d-6448a6efd538 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:14.106067 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e2fa59-0bba-44de-8f6d-6448a6efd538 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:14.112958 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 592/1166] 10.222.0.47 () {56 vars in 1115 bytes} [Mon Aug 29 22:34:13 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:34:15.990205 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac924e4-ca6d-4e5c-8149-45cb730c3534 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:15.990736 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac924e4-ca6d-4e5c-8149-45cb730c3534 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:15.990858 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac924e4-ca6d-4e5c-8149-45cb730c3534 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:15.992212 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 575/1167] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:34:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:34:15.997301 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f0dc43-2dbd-4177-8dfa-c96a6a10332f None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:15.997706 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f0dc43-2dbd-4177-8dfa-c96a6a10332f None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:15.997887 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f0dc43-2dbd-4177-8dfa-c96a6a10332f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:16.015868 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-f9f0dc43-2dbd-4177-8dfa-c96a6a10332f None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:34:16.017074 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-f9f0dc43-2dbd-4177-8dfa-c96a6a10332f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:16.084452 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 593/1168] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:34:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:34:16.358517 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac924e4-ca6d-4e5c-8149-45cb730c3534 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:16.460369 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac924e4-ca6d-4e5c-8149-45cb730c3534 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:16.493183 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf7e71a-39fa-438a-85b5-40be488da6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:16.493799 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7e71a-39fa-438a-85b5-40be488da6ea None admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:16.494073 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7e71a-39fa-438a-85b5-40be488da6ea None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:16.494340 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7e71a-39fa-438a-85b5-40be488da6ea None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:16.494998 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf7e71a-39fa-438a-85b5-40be488da6ea None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:16.496351 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf7e71a-39fa-438a-85b5-40be488da6ea None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:16.511986 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 576/1169] 10.222.0.47 () {60 vars in 1138 bytes} [Mon Aug 29 22:34:16 2022] POST /identity/v3/domains => generated 267 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:34:18.464519 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ba5f2-ba1b-4d65-9dd7-0fc23c6ec0eb None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:18.465065 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ba5f2-ba1b-4d65-9dd7-0fc23c6ec0eb None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:18.465065 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ba5f2-ba1b-4d65-9dd7-0fc23c6ec0eb None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:18.466453 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 594/1170] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:34:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:34:18.471518 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27bed9-88f3-4648-b4bc-aa91be7c63a4 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:18.471921 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27bed9-88f3-4648-b4bc-aa91be7c63a4 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:18.472068 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27bed9-88f3-4648-b4bc-aa91be7c63a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:18.490180 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-0a27bed9-88f3-4648-b4bc-aa91be7c63a4 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:34:18.491468 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-0a27bed9-88f3-4648-b4bc-aa91be7c63a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:18.512102 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:18.559445 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 577/1171] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:34:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 22:34:18.831808 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ba5f2-ba1b-4d65-9dd7-0fc23c6ec0eb None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:18.933069 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ba5f2-ba1b-4d65-9dd7-0fc23c6ec0eb None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:18.942328 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:18.972528 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0204f9bb-7bc8-4f91-bf38-63f66768c35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:18.973142 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0204f9bb-7bc8-4f91-bf38-63f66768c35c None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:18.973567 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0204f9bb-7bc8-4f91-bf38-63f66768c35c None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:18.973844 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0204f9bb-7bc8-4f91-bf38-63f66768c35c None admin] PATH_INFO: `/v3/domains/0d9b6191fa0c49dca592973c538e7aae` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:18.984286 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0204f9bb-7bc8-4f91-bf38-63f66768c35c None admin] RBAC: Authorizing `identity:get_domain(domain_id=0d9b6191fa0c49dca592973c538e7aae)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:18.985747 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0204f9bb-7bc8-4f91-bf38-63f66768c35c None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:18.987352 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 595/1172] 10.222.0.47 () {56 vars in 1183 bytes} [Mon Aug 29 22:34:18 2022] GET /identity/v3/domains/0d9b6191fa0c49dca592973c538e7aae => generated 267 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:34:18.994050 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a27bed9-88f3-4648-b4bc-aa91be7c63a4 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:19.094042 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a27bed9-88f3-4648-b4bc-aa91be7c63a4 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:19.127946 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb29cea9-3ccf-4834-bb00-98436b270ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:19.128552 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29cea9-3ccf-4834-bb00-98436b270ca4 None admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:19.128833 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29cea9-3ccf-4834-bb00-98436b270ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:19.129109 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29cea9-3ccf-4834-bb00-98436b270ca4 None admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:19.129802 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb29cea9-3ccf-4834-bb00-98436b270ca4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:19.131256 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb29cea9-3ccf-4834-bb00-98436b270ca4 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:19.157102 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 578/1173] 10.222.0.47 () {60 vars in 1141 bytes} [Mon Aug 29 22:34:18 2022] POST /identity/v3/projects => generated 361 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:34:21.161538 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd274997-1ee2-41cc-b898-595dd36b2bbb None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:21.162121 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd274997-1ee2-41cc-b898-595dd36b2bbb None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:21.162121 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd274997-1ee2-41cc-b898-595dd36b2bbb None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:21.163837 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 596/1174] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:34:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:34:21.168921 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f448d-537c-4c55-aa05-95a92043dc5e None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:21.169394 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f448d-537c-4c55-aa05-95a92043dc5e None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:21.169519 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f448d-537c-4c55-aa05-95a92043dc5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:21.188308 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-2b8f448d-537c-4c55-aa05-95a92043dc5e None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:34:21.189556 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-2b8f448d-537c-4c55-aa05-95a92043dc5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:21.191521 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:21.257890 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 579/1175] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:34:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:34:21.538206 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd274997-1ee2-41cc-b898-595dd36b2bbb None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:21.640084 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd274997-1ee2-41cc-b898-595dd36b2bbb None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:21.673062 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ae4c3-be4c-470f-a62e-8820b87f47f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:21.673769 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ae4c3-be4c-470f-a62e-8820b87f47f7 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:21.674046 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ae4c3-be4c-470f-a62e-8820b87f47f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:21.674311 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ae4c3-be4c-470f-a62e-8820b87f47f7 None admin] PATH_INFO: `/v3/domains/0d9b6191fa0c49dca592973c538e7aae` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:21.675409 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106ae4c3-be4c-470f-a62e-8820b87f47f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=0d9b6191fa0c49dca592973c538e7aae)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:21.676819 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106ae4c3-be4c-470f-a62e-8820b87f47f7 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:21.679142 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 597/1176] 10.222.0.47 () {56 vars in 1183 bytes} [Mon Aug 29 22:34:21 2022] GET /identity/v3/domains/0d9b6191fa0c49dca592973c538e7aae => generated 267 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:34:21.684878 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f448d-537c-4c55-aa05-95a92043dc5e None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:21.795106 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f448d-537c-4c55-aa05-95a92043dc5e None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:21.827581 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c91da-b73c-4c1f-a9ef-9545597768c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:21.828176 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c91da-b73c-4c1f-a9ef-9545597768c7 None admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:21.828451 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c91da-b73c-4c1f-a9ef-9545597768c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:21.828719 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c91da-b73c-4c1f-a9ef-9545597768c7 None admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:21.829381 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1c91da-b73c-4c1f-a9ef-9545597768c7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:21.830814 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1c91da-b73c-4c1f-a9ef-9545597768c7 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:21.841194 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:21.854276 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 580/1177] 10.222.0.47 () {60 vars in 1132 bytes} [Mon Aug 29 22:34:21 2022] POST /identity/v3/users => generated 311 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:34:23.798834 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd7917-1f7c-4cff-9bc2-2b7021b606af None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:23.799649 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd7917-1f7c-4cff-9bc2-2b7021b606af None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:23.799649 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd7917-1f7c-4cff-9bc2-2b7021b606af None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:23.800870 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 598/1178] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:34:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:34:23.807143 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f106e024-a468-4053-bfc2-796ad11e65bf None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:23.807597 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f106e024-a468-4053-bfc2-796ad11e65bf None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:23.807706 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f106e024-a468-4053-bfc2-796ad11e65bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:23.829110 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-f106e024-a468-4053-bfc2-796ad11e65bf None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:34:23.830349 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-f106e024-a468-4053-bfc2-796ad11e65bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:23.895620 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 581/1179] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:34:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:34:24.170496 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd7917-1f7c-4cff-9bc2-2b7021b606af None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:24.205516 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:24.269620 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd7917-1f7c-4cff-9bc2-2b7021b606af None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:24.305637 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546af566-0d7b-4053-965c-23a27b424e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:24.306267 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546af566-0d7b-4053-965c-23a27b424e6e None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:24.306547 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546af566-0d7b-4053-965c-23a27b424e6e None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:24.307277 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546af566-0d7b-4053-965c-23a27b424e6e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:24.317071 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546af566-0d7b-4053-965c-23a27b424e6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:34:24.322043 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-546af566-0d7b-4053-965c-23a27b424e6e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:34:24.322043 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:34:24.322043 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:34:24.322043 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:34:24.322043 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:34:24.322043 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:34:24.322043 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:34:24.322043 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:34:24.322043 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:34:24.322043 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:34:24.322043 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:34:24.322043 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:34:24.322043 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:34:24.322043 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:34:24.322043 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:34:24.322043 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:34:24.323112 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:34:24.323112 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:34:24.323112 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:34:24.323112 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:34:24.323112 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:34:24.323112 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:34:24.323112 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:34:24.323112 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:34:24.323112 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:34:24.323112 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:34:24.323112 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:34:24.323112 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:34:24.323112 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:34:24.323112 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:34:24.323112 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:34:24.323112 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:34:24.324027 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:34:24.324027 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:34:24.324027 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:34:24.324027 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:34:24.324027 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:34:24.324027 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:34:24.324027 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:34:24.324027 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:34:24.324027 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:34:24.324027 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:34:24.324027 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:34:24.324027 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:34:24.324027 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 599/1180] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Aug 29 22:34:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:34:24.329257 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f106e024-a468-4053-bfc2-796ad11e65bf None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:24.426840 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f106e024-a468-4053-bfc2-796ad11e65bf None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:24.450830 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:24.462782 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170088d6-495f-4bf7-9029-eaf25a2cdd94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:24.463384 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170088d6-495f-4bf7-9029-eaf25a2cdd94 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:24.463663 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170088d6-495f-4bf7-9029-eaf25a2cdd94 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:24.463935 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170088d6-495f-4bf7-9029-eaf25a2cdd94 None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:24.464595 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170088d6-495f-4bf7-9029-eaf25a2cdd94 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:34:24.464894 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170088d6-495f-4bf7-9029-eaf25a2cdd94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:24.466279 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170088d6-495f-4bf7-9029-eaf25a2cdd94 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:24.474129 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 582/1181] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Aug 29 22:34:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:34:24.479980 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546af566-0d7b-4053-965c-23a27b424e6e None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:24.572788 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:24.579124 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546af566-0d7b-4053-965c-23a27b424e6e None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:24.612818 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a883da1-555e-4f5b-8eb9-f922b5bab4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:24.613462 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a883da1-555e-4f5b-8eb9-f922b5bab4d0 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:24.613745 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a883da1-555e-4f5b-8eb9-f922b5bab4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:24.614020 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a883da1-555e-4f5b-8eb9-f922b5bab4d0 None admin] PATH_INFO: `/v3/users/022260d55472473ea637a666a6270842` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:24.627154 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a883da1-555e-4f5b-8eb9-f922b5bab4d0 None admin] RBAC: Authorizing `identity:get_user(user_id=022260d55472473ea637a666a6270842)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:24.628669 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a883da1-555e-4f5b-8eb9-f922b5bab4d0 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:24.630298 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 600/1182] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Aug 29 22:34:24 2022] GET /identity/v3/users/022260d55472473ea637a666a6270842 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:34:24.636987 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170088d6-495f-4bf7-9029-eaf25a2cdd94 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:24.735316 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170088d6-495f-4bf7-9029-eaf25a2cdd94 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:24.768646 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1f0b35-de04-477b-9f19-19fbeb3bf827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:24.769243 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1f0b35-de04-477b-9f19-19fbeb3bf827 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:24.769547 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1f0b35-de04-477b-9f19-19fbeb3bf827 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:24.769819 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1f0b35-de04-477b-9f19-19fbeb3bf827 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:24.824081 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:24.837442 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1f0b35-de04-477b-9f19-19fbeb3bf827 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:24.838886 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1f0b35-de04-477b-9f19-19fbeb3bf827 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:24.934635 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 583/1183] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Aug 29 22:34:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 22:34:24.940620 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a883da1-555e-4f5b-8eb9-f922b5bab4d0 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:25.039252 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a883da1-555e-4f5b-8eb9-f922b5bab4d0 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:25.076326 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf7437f-aa03-4193-8bc4-8ca9b028c731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:25.076946 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7437f-aa03-4193-8bc4-8ca9b028c731 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:25.077289 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7437f-aa03-4193-8bc4-8ca9b028c731 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:25.077508 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7437f-aa03-4193-8bc4-8ca9b028c731 None admin] PATH_INFO: `/v3/projects/4636ec28864c48f2a7d8d47ed38e40ce` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:25.078632 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf7437f-aa03-4193-8bc4-8ca9b028c731 None admin] RBAC: Authorizing `identity:get_project(project_id=4636ec28864c48f2a7d8d47ed38e40ce)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:25.080053 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf7437f-aa03-4193-8bc4-8ca9b028c731 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:25.081696 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 601/1184] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Aug 29 22:34:24 2022] GET /identity/v3/projects/4636ec28864c48f2a7d8d47ed38e40ce => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:34:25.088053 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1f0b35-de04-477b-9f19-19fbeb3bf827 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:25.174140 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:25.189569 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1f0b35-de04-477b-9f19-19fbeb3bf827 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:25.222613 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cf5163-3cbd-49ac-a189-fa291c59fbf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:25.223213 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf5163-3cbd-49ac-a189-fa291c59fbf4 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:25.223493 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf5163-3cbd-49ac-a189-fa291c59fbf4 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:25.223764 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf5163-3cbd-49ac-a189-fa291c59fbf4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:25.224478 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cf5163-3cbd-49ac-a189-fa291c59fbf4 None admin] RBAC: Adding query filter params (role.id=d00eabaec96a4956aaec2c37a5819c25, scope.project.id=4636ec28864c48f2a7d8d47ed38e40ce, user.id=022260d55472473ea637a666a6270842) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:34:25.224787 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cf5163-3cbd-49ac-a189-fa291c59fbf4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:25.227137 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cf5163-3cbd-49ac-a189-fa291c59fbf4 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:25.232532 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 584/1185] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Aug 29 22:34:25 2022] GET /identity/v3/role_assignments?user.id=022260d55472473ea637a666a6270842&scope.project.id=4636ec28864c48f2a7d8d47ed38e40ce&role.id=d00eabaec96a4956aaec2c37a5819c25 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:34:27.117794 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f5cd73-8354-4e89-af30-50088fb9978f None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:27.118330 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f5cd73-8354-4e89-af30-50088fb9978f None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:27.118330 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f5cd73-8354-4e89-af30-50088fb9978f None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:27.119680 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 602/1186] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:34:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:34:27.124792 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fb168-a742-4a3b-b903-acb2f4ac59f4 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:27.125172 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fb168-a742-4a3b-b903-acb2f4ac59f4 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:27.125376 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fb168-a742-4a3b-b903-acb2f4ac59f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:27.143235 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-4a0fb168-a742-4a3b-b903-acb2f4ac59f4 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:34:27.144441 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-4a0fb168-a742-4a3b-b903-acb2f4ac59f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:27.210775 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 585/1187] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:34:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:34:27.482404 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f5cd73-8354-4e89-af30-50088fb9978f None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:27.507092 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:27.586049 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f5cd73-8354-4e89-af30-50088fb9978f None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:27.618783 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d7fe50-ee49-42b5-8949-6e62f803012c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:27.619402 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d7fe50-ee49-42b5-8949-6e62f803012c None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:27.619679 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d7fe50-ee49-42b5-8949-6e62f803012c None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:27.619949 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d7fe50-ee49-42b5-8949-6e62f803012c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:27.629930 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d7fe50-ee49-42b5-8949-6e62f803012c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:34:27.635289 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-f4d7fe50-ee49-42b5-8949-6e62f803012c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:34:27.635289 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:34:27.635289 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:34:27.635289 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:34:27.635289 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:34:27.635289 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:34:27.635289 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:34:27.635289 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:34:27.635289 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:34:27.635289 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:34:27.635289 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:34:27.635289 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:34:27.635289 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:34:27.635289 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:34:27.635289 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:34:27.635289 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:34:27.636378 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:34:27.636378 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:34:27.636378 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:34:27.636378 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:34:27.636378 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:34:27.636378 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:34:27.636378 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:34:27.636378 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:34:27.636378 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:34:27.636378 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:34:27.636378 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:34:27.636378 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:34:27.636378 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:34:27.636378 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:34:27.636378 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:34:27.636378 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:34:27.637415 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:34:27.637415 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:34:27.637415 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:34:27.637415 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:34:27.637415 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:34:27.637415 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:34:27.637415 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:34:27.637415 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:34:27.637415 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:34:27.637415 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:34:27.637415 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:34:27.637415 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:34:27.637415 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 603/1188] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Aug 29 22:34:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:34:27.642408 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0fb168-a742-4a3b-b903-acb2f4ac59f4 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:27.722441 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:27.743096 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0fb168-a742-4a3b-b903-acb2f4ac59f4 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:27.776227 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c39f3d8-610d-42b6-99a3-02c53777ae1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:27.776829 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39f3d8-610d-42b6-99a3-02c53777ae1e None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:27.777108 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39f3d8-610d-42b6-99a3-02c53777ae1e None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:27.777411 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39f3d8-610d-42b6-99a3-02c53777ae1e None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:27.778067 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c39f3d8-610d-42b6-99a3-02c53777ae1e None admin] RBAC: Adding query filter params (name=admin) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:34:27.778370 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c39f3d8-610d-42b6-99a3-02c53777ae1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:27.779835 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c39f3d8-610d-42b6-99a3-02c53777ae1e None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:27.788026 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 586/1189] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Aug 29 22:34:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:34:27.794063 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d7fe50-ee49-42b5-8949-6e62f803012c None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:27.875545 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:27.894143 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d7fe50-ee49-42b5-8949-6e62f803012c None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:27.927550 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a08c7b-ddb2-4fd6-87b0-cf8e0615fbc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:27.928718 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a08c7b-ddb2-4fd6-87b0-cf8e0615fbc0 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:27.929075 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a08c7b-ddb2-4fd6-87b0-cf8e0615fbc0 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:27.929372 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a08c7b-ddb2-4fd6-87b0-cf8e0615fbc0 None admin] PATH_INFO: `/v3/users/022260d55472473ea637a666a6270842` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:27.930491 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a08c7b-ddb2-4fd6-87b0-cf8e0615fbc0 None admin] RBAC: Authorizing `identity:get_user(user_id=022260d55472473ea637a666a6270842)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:27.931908 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a08c7b-ddb2-4fd6-87b0-cf8e0615fbc0 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:27.933483 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 604/1190] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Aug 29 22:34:27 2022] GET /identity/v3/users/022260d55472473ea637a666a6270842 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:34:27.939326 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c39f3d8-610d-42b6-99a3-02c53777ae1e None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:28.039086 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c39f3d8-610d-42b6-99a3-02c53777ae1e None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:28.073095 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2e9bbb-3d61-45ac-bc75-4391964111bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:28.073748 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e9bbb-3d61-45ac-bc75-4391964111bb None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:28.074030 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e9bbb-3d61-45ac-bc75-4391964111bb None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:28.074304 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e9bbb-3d61-45ac-bc75-4391964111bb None admin] PATH_INFO: `/v3/projects/4636ec28864c48f2a7d8d47ed38e40ce` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:28.075427 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2e9bbb-3d61-45ac-bc75-4391964111bb None admin] RBAC: Authorizing `identity:get_project(project_id=4636ec28864c48f2a7d8d47ed38e40ce)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:28.076854 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2e9bbb-3d61-45ac-bc75-4391964111bb None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:28.078515 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 587/1191] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Aug 29 22:34:27 2022] GET /identity/v3/projects/4636ec28864c48f2a7d8d47ed38e40ce => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:34:28.084648 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a08c7b-ddb2-4fd6-87b0-cf8e0615fbc0 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:28.183778 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a08c7b-ddb2-4fd6-87b0-cf8e0615fbc0 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:28.216336 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f459e0f-31a0-4c7b-9c5b-e0ce0fcbcba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:28.216976 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f459e0f-31a0-4c7b-9c5b-e0ce0fcbcba3 None admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:28.217256 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f459e0f-31a0-4c7b-9c5b-e0ce0fcbcba3 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:28.217559 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f459e0f-31a0-4c7b-9c5b-e0ce0fcbcba3 None admin] PATH_INFO: `/v3/projects/4636ec28864c48f2a7d8d47ed38e40ce/users/022260d55472473ea637a666a6270842/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:28.219449 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f459e0f-31a0-4c7b-9c5b-e0ce0fcbcba3 None admin] RBAC: Authorizing `identity:create_grant(project_id=4636ec28864c48f2a7d8d47ed38e40ce, user_id=022260d55472473ea637a666a6270842, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:28.220875 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f459e0f-31a0-4c7b-9c5b-e0ce0fcbcba3 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:28.234119 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 605/1192] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Aug 29 22:34:28 2022] PUT /identity/v3/projects/4636ec28864c48f2a7d8d47ed38e40ce/users/022260d55472473ea637a666a6270842/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:34:30.112488 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b6ce4-3042-4f7d-a323-927ddd0bb184 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:30.113075 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b6ce4-3042-4f7d-a323-927ddd0bb184 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:30.113075 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b6ce4-3042-4f7d-a323-927ddd0bb184 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:30.114411 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 588/1193] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:34:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:34:30.119637 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa04b94-96a3-4fc9-abde-c780b977a0c7 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:30.120061 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa04b94-96a3-4fc9-abde-c780b977a0c7 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:30.120165 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa04b94-96a3-4fc9-abde-c780b977a0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:30.138156 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-daa04b94-96a3-4fc9-abde-c780b977a0c7 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:34:30.139343 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-daa04b94-96a3-4fc9-abde-c780b977a0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:34:30.142117 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:30.206187 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 606/1194] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:34:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:34:30.478680 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b6ce4-3042-4f7d-a323-927ddd0bb184 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:30.491456 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:30.579143 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b6ce4-3042-4f7d-a323-927ddd0bb184 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:30.611708 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ffddf3-d8f1-41fd-af3c-454dec2fbcf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:30.612321 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ffddf3-d8f1-41fd-af3c-454dec2fbcf8 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:30.612598 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ffddf3-d8f1-41fd-af3c-454dec2fbcf8 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:30.612868 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ffddf3-d8f1-41fd-af3c-454dec2fbcf8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:30.623349 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ffddf3-d8f1-41fd-af3c-454dec2fbcf8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:34:30.628094 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-c7ffddf3-d8f1-41fd-af3c-454dec2fbcf8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:34:30.628094 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:34:30.628094 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:34:30.628094 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:34:30.628094 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:34:30.628094 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:34:30.628094 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:34:30.628094 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:34:30.628094 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:34:30.628094 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:34:30.628094 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:34:30.628094 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:34:30.628094 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:34:30.628094 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:34:30.628094 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:34:30.628094 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:34:30.629145 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:34:30.629145 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:34:30.629145 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:34:30.629145 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:34:30.629145 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:34:30.629145 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:34:30.629145 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:34:30.629145 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:34:30.629145 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:34:30.629145 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:34:30.629145 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:34:30.629145 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:34:30.629145 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:34:30.629145 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:34:30.629145 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:34:30.629145 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:34:30.630024 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:34:30.630024 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:34:30.630024 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:34:30.630024 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:34:30.630024 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:34:30.630024 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:34:30.630024 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:34:30.630024 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:34:30.630024 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:34:30.630024 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:34:30.630024 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:34:30.630024 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:34:30.630024 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 589/1195] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Aug 29 22:34:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:34:30.636113 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa04b94-96a3-4fc9-abde-c780b977a0c7 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:30.734019 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa04b94-96a3-4fc9-abde-c780b977a0c7 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:30.767908 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf4d3e4-b452-4f70-8160-640add973c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:30.768497 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4d3e4-b452-4f70-8160-640add973c96 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:30.768775 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4d3e4-b452-4f70-8160-640add973c96 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:30.769045 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4d3e4-b452-4f70-8160-640add973c96 None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:30.769730 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf4d3e4-b452-4f70-8160-640add973c96 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:34:30.770030 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf4d3e4-b452-4f70-8160-640add973c96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:30.771387 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf4d3e4-b452-4f70-8160-640add973c96 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:30.779194 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 607/1196] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Aug 29 22:34:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:34:30.785178 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ffddf3-d8f1-41fd-af3c-454dec2fbcf8 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:30.853822 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:30.886739 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ffddf3-d8f1-41fd-af3c-454dec2fbcf8 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:30.919213 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aba497-43d8-44cf-8135-3c946df40927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:30.919841 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aba497-43d8-44cf-8135-3c946df40927 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:30.920116 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aba497-43d8-44cf-8135-3c946df40927 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:30.920390 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aba497-43d8-44cf-8135-3c946df40927 None admin] PATH_INFO: `/v3/users/022260d55472473ea637a666a6270842` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:30.921526 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aba497-43d8-44cf-8135-3c946df40927 None admin] RBAC: Authorizing `identity:get_user(user_id=022260d55472473ea637a666a6270842)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:30.922950 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aba497-43d8-44cf-8135-3c946df40927 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:30.924525 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 590/1197] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Aug 29 22:34:30 2022] GET /identity/v3/users/022260d55472473ea637a666a6270842 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:34:30.931175 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf4d3e4-b452-4f70-8160-640add973c96 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:30.934066 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:31.031435 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf4d3e4-b452-4f70-8160-640add973c96 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:31.064960 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a47bb48-d39f-48b1-85d2-1ee6d8353312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:31.065585 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47bb48-d39f-48b1-85d2-1ee6d8353312 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:31.065876 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47bb48-d39f-48b1-85d2-1ee6d8353312 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:31.066149 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47bb48-d39f-48b1-85d2-1ee6d8353312 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:31.135353 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a47bb48-d39f-48b1-85d2-1ee6d8353312 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:31.136829 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a47bb48-d39f-48b1-85d2-1ee6d8353312 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:31.138669 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:31.234191 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 608/1198] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Aug 29 22:34:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 22:34:31.240161 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aba497-43d8-44cf-8135-3c946df40927 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:31.340380 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aba497-43d8-44cf-8135-3c946df40927 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:31.374057 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ee22e7-a8cd-4311-9f91-c28ae4ba4b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:31.374681 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee22e7-a8cd-4311-9f91-c28ae4ba4b6a None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:31.374965 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee22e7-a8cd-4311-9f91-c28ae4ba4b6a None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:31.375243 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee22e7-a8cd-4311-9f91-c28ae4ba4b6a None admin] PATH_INFO: `/v3/projects/4636ec28864c48f2a7d8d47ed38e40ce` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:31.376350 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ee22e7-a8cd-4311-9f91-c28ae4ba4b6a None admin] RBAC: Authorizing `identity:get_project(project_id=4636ec28864c48f2a7d8d47ed38e40ce)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:31.377814 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ee22e7-a8cd-4311-9f91-c28ae4ba4b6a None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:31.379454 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 591/1199] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Aug 29 22:34:31 2022] GET /identity/v3/projects/4636ec28864c48f2a7d8d47ed38e40ce => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:34:31.385825 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a47bb48-d39f-48b1-85d2-1ee6d8353312 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:34:31.488397 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a47bb48-d39f-48b1-85d2-1ee6d8353312 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:34:31.489957 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:31.523985 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1781017a-32a1-4ce8-ae46-b610a596fe19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:34:31.524574 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781017a-32a1-4ce8-ae46-b610a596fe19 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:34:31.524852 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781017a-32a1-4ce8-ae46-b610a596fe19 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:34:31.525126 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781017a-32a1-4ce8-ae46-b610a596fe19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:34:31.525892 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1781017a-32a1-4ce8-ae46-b610a596fe19 None admin] RBAC: Adding query filter params (role.id=d00eabaec96a4956aaec2c37a5819c25, scope.project.id=4636ec28864c48f2a7d8d47ed38e40ce, user.id=022260d55472473ea637a666a6270842) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:34:31.526198 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1781017a-32a1-4ce8-ae46-b610a596fe19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:34:31.527624 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1781017a-32a1-4ce8-ae46-b610a596fe19 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:34:31.533527 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 609/1200] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Aug 29 22:34:31 2022] GET /identity/v3/role_assignments?user.id=022260d55472473ea637a666a6270842&scope.project.id=4636ec28864c48f2a7d8d47ed38e40ce&role.id=d00eabaec96a4956aaec2c37a5819c25 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:34:41.369950 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=97 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:34:41.530705 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=17 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:35:27.206707 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa69d63-268f-48ad-8afe-10045dfb1a00 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:27.207295 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa69d63-268f-48ad-8afe-10045dfb1a00 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:27.207395 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa69d63-268f-48ad-8afe-10045dfb1a00 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:27.208702 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 592/1201] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:35:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:35:27.218720 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db30ed2-4f4b-4618-ba86-7094a0654b4a None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:27.218720 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db30ed2-4f4b-4618-ba86-7094a0654b4a None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:27.218720 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db30ed2-4f4b-4618-ba86-7094a0654b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:27.237825 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-6db30ed2-4f4b-4618-ba86-7094a0654b4a None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:35:27.239399 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-6db30ed2-4f4b-4618-ba86-7094a0654b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:35:27.345432 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 610/1202] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:35:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:35:27.633322 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa69d63-268f-48ad-8afe-10045dfb1a00 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:27.778075 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa69d63-268f-48ad-8afe-10045dfb1a00 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:27.822629 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb31ff0-8601-470c-97ab-2cd3755de940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:27.823372 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb31ff0-8601-470c-97ab-2cd3755de940 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:27.823673 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb31ff0-8601-470c-97ab-2cd3755de940 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:27.824110 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb31ff0-8601-470c-97ab-2cd3755de940 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:27.837286 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb31ff0-8601-470c-97ab-2cd3755de940 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:27.838913 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb31ff0-8601-470c-97ab-2cd3755de940 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:27.854993 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-8bb31ff0-8601-470c-97ab-2cd3755de940 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:35:27.854993 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:35:27.854993 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:35:27.854993 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:35:27.854993 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:35:27.854993 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:35:27.854993 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:35:27.854993 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:35:27.854993 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:35:27.854993 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:35:27.854993 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:35:27.854993 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:35:27.854993 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:35:27.854993 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:35:27.854993 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:35:27.854993 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:35:27.856110 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:35:27.856110 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:35:27.856110 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:35:27.856110 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:35:27.856110 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:35:27.856110 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:35:27.856110 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:35:27.856110 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:35:27.856110 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:35:27.856110 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:35:27.856110 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:35:27.856110 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:35:27.856110 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:35:27.856110 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:35:27.856110 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:35:27.856110 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:35:27.856110 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:35:27.857088 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:35:27.857088 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:35:27.857088 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:35:27.857088 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 593/1203] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:35:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:35:27.863657 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db30ed2-4f4b-4618-ba86-7094a0654b4a None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:28.002030 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db30ed2-4f4b-4618-ba86-7094a0654b4a None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:28.047050 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:35:28.050107 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2830fb51-5088-4247-8ce5-6ceb4b563669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:28.050810 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2830fb51-5088-4247-8ce5-6ceb4b563669 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:28.050996 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2830fb51-5088-4247-8ce5-6ceb4b563669 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:28.051253 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2830fb51-5088-4247-8ce5-6ceb4b563669 None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:28.051952 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2830fb51-5088-4247-8ce5-6ceb4b563669 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:35:28.052253 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2830fb51-5088-4247-8ce5-6ceb4b563669 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:28.053614 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2830fb51-5088-4247-8ce5-6ceb4b563669 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:28.068041 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 611/1204] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:35:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:35:28.074396 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb31ff0-8601-470c-97ab-2cd3755de940 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:28.141935 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:35:28.196282 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb31ff0-8601-470c-97ab-2cd3755de940 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:28.237078 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443346b0-f694-4776-8e69-460534baa91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:28.237917 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443346b0-f694-4776-8e69-460534baa91d None admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:28.238203 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443346b0-f694-4776-8e69-460534baa91d None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:28.238594 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443346b0-f694-4776-8e69-460534baa91d None admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:28.239310 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443346b0-f694-4776-8e69-460534baa91d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:28.241270 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443346b0-f694-4776-8e69-460534baa91d None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:28.266530 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 594/1205] 10.222.0.47 () {60 vars in 1132 bytes} [Mon Aug 29 22:35:28 2022] POST /identity/v3/users => generated 251 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:35:31.231574 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d02836-7e01-475e-802a-d9266db7b0c3 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:31.232126 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d02836-7e01-475e-802a-d9266db7b0c3 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:31.232126 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d02836-7e01-475e-802a-d9266db7b0c3 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:31.233748 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 612/1206] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:35:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:35:31.239706 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff56ca7-d0e6-447c-97f7-d43614c88677 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:31.240166 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff56ca7-d0e6-447c-97f7-d43614c88677 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:31.240271 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff56ca7-d0e6-447c-97f7-d43614c88677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:31.261629 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-dff56ca7-d0e6-447c-97f7-d43614c88677 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:35:31.262849 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-dff56ca7-d0e6-447c-97f7-d43614c88677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:35:31.365421 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 595/1207] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:35:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:35:31.642243 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d02836-7e01-475e-802a-d9266db7b0c3 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:31.771901 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d02836-7e01-475e-802a-d9266db7b0c3 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:31.820305 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f0b38-5b22-47ba-b1fb-c418613d94c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:31.820944 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f0b38-5b22-47ba-b1fb-c418613d94c9 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:31.821235 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f0b38-5b22-47ba-b1fb-c418613d94c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:31.821513 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f0b38-5b22-47ba-b1fb-c418613d94c9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:31.834265 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83f0b38-5b22-47ba-b1fb-c418613d94c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:35:31.839941 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-d83f0b38-5b22-47ba-b1fb-c418613d94c9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:35:31.839941 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:35:31.839941 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:35:31.839941 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:35:31.839941 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:35:31.839941 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:35:31.839941 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:35:31.839941 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:35:31.839941 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:35:31.839941 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:35:31.839941 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:35:31.839941 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:35:31.839941 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:35:31.839941 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:35:31.839941 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:35:31.839941 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:35:31.842188 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:35:31.842188 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:35:31.842188 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:35:31.842188 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:35:31.842188 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:35:31.842188 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:35:31.842188 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:35:31.842188 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:35:31.842188 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:35:31.842188 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:35:31.842188 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:35:31.842188 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:35:31.842188 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:35:31.842188 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:35:31.842188 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:35:31.842188 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:35:31.843331 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:35:31.843331 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:35:31.843331 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:35:31.843331 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:35:31.843331 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:35:31.843331 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:35:31.843331 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:35:31.843331 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:35:31.843331 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:35:31.843331 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:35:31.843331 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:35:31.843331 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:35:31.843331 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 613/1208] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Aug 29 22:35:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:35:31.852042 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff56ca7-d0e6-447c-97f7-d43614c88677 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:31.903440 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:35:31.982086 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff56ca7-d0e6-447c-97f7-d43614c88677 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:32.023448 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362bcc41-595f-4ad5-bd55-e4b1f36a798e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:32.024151 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362bcc41-595f-4ad5-bd55-e4b1f36a798e None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:32.024432 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362bcc41-595f-4ad5-bd55-e4b1f36a798e None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:32.024768 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362bcc41-595f-4ad5-bd55-e4b1f36a798e None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:32.025894 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362bcc41-595f-4ad5-bd55-e4b1f36a798e None admin] RBAC: Adding query filter params (name=service) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:35:32.026268 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362bcc41-595f-4ad5-bd55-e4b1f36a798e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:32.027822 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362bcc41-595f-4ad5-bd55-e4b1f36a798e None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:32.038674 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 596/1209] 10.222.0.47 () {56 vars in 1103 bytes} [Mon Aug 29 22:35:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:35:32.044494 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f0b38-5b22-47ba-b1fb-c418613d94c9 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:32.103619 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:35:32.157841 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f0b38-5b22-47ba-b1fb-c418613d94c9 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:32.195491 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ed9d66-eafa-4943-bcd3-43f7a14818c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:32.196174 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed9d66-eafa-4943-bcd3-43f7a14818c8 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:32.196503 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed9d66-eafa-4943-bcd3-43f7a14818c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:32.197493 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed9d66-eafa-4943-bcd3-43f7a14818c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:32.208544 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ed9d66-eafa-4943-bcd3-43f7a14818c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:32.210134 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ed9d66-eafa-4943-bcd3-43f7a14818c8 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:32.227063 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-05ed9d66-eafa-4943-bcd3-43f7a14818c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:35:32.227063 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:35:32.227063 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:35:32.227063 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:35:32.227063 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:35:32.227063 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:35:32.227063 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:35:32.227063 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:35:32.227063 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:35:32.227063 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:35:32.227063 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:35:32.227063 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:35:32.227063 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:35:32.227063 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:35:32.227063 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:35:32.227063 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:35:32.228207 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:35:32.228207 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:35:32.228207 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:35:32.228207 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:35:32.228207 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:35:32.228207 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:35:32.228207 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:35:32.228207 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:35:32.228207 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:35:32.228207 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:35:32.228207 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:35:32.228207 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:35:32.228207 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:35:32.228207 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:35:32.228207 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:35:32.228207 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:35:32.228207 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:35:32.230638 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:35:32.230638 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:35:32.230638 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:35:32.230638 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 614/1210] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:35:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:35:32.234825 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362bcc41-595f-4ad5-bd55-e4b1f36a798e None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:32.347717 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:35:32.351215 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362bcc41-595f-4ad5-bd55-e4b1f36a798e None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:32.393222 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96269258-d98e-4659-ac82-61d21847cc24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:32.394246 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96269258-d98e-4659-ac82-61d21847cc24 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:32.394688 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96269258-d98e-4659-ac82-61d21847cc24 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:32.395112 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96269258-d98e-4659-ac82-61d21847cc24 None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:32.395910 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96269258-d98e-4659-ac82-61d21847cc24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:35:32.396428 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96269258-d98e-4659-ac82-61d21847cc24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:32.398046 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96269258-d98e-4659-ac82-61d21847cc24 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:32.413315 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 597/1211] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:35:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:35:32.419265 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ed9d66-eafa-4943-bcd3-43f7a14818c8 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:32.536169 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ed9d66-eafa-4943-bcd3-43f7a14818c8 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:32.538267 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:35:32.575521 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34463e02-eb6b-48c3-8356-b7fb2585cb56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:32.576317 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34463e02-eb6b-48c3-8356-b7fb2585cb56 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:32.576650 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34463e02-eb6b-48c3-8356-b7fb2585cb56 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:32.577094 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34463e02-eb6b-48c3-8356-b7fb2585cb56 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:32.585931 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34463e02-eb6b-48c3-8356-b7fb2585cb56 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:32.587531 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34463e02-eb6b-48c3-8356-b7fb2585cb56 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:32.599804 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-34463e02-eb6b-48c3-8356-b7fb2585cb56 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 22:35:32.599804 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:35:32.599804 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:35:32.599804 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:35:32.599804 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:35:32.599804 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:35:32.599804 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:35:32.599804 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:35:32.599804 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:35:32.599804 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:35:32.599804 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:35:32.599804 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:35:32.599804 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:35:32.599804 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:35:32.599804 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:35:32.599804 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:35:32.600858 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:35:32.600858 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:35:32.600858 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:35:32.600858 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:35:32.600858 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:35:32.600858 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:35:32.600858 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:35:32.600858 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:35:32.600858 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:35:32.600858 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:35:32.600858 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:35:32.600858 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:35:32.600858 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:35:32.600858 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:35:32.600858 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:35:32.600858 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:35:32.600858 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:35:32.600858 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:35:32.607413 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:35:32.607413 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:35:32.607413 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:35:32.607413 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:35:32.607413 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:35:32.607413 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:35:32.607413 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:35:32.607413 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:35:32.607413 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 22:35:32.607413 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:35:32.607413 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 615/1212] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:35:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:35:32.608031 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96269258-d98e-4659-ac82-61d21847cc24 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:32.732062 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96269258-d98e-4659-ac82-61d21847cc24 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:32.771026 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc244874-8d61-4a19-b57b-d9cd77bc9987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:32.772010 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc244874-8d61-4a19-b57b-d9cd77bc9987 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:32.772489 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc244874-8d61-4a19-b57b-d9cd77bc9987 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:32.772982 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc244874-8d61-4a19-b57b-d9cd77bc9987 None admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:32.773957 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc244874-8d61-4a19-b57b-d9cd77bc9987 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:35:32.775816 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc244874-8d61-4a19-b57b-d9cd77bc9987 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:32.777485 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc244874-8d61-4a19-b57b-d9cd77bc9987 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:32.797123 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 598/1213] 10.222.0.47 () {56 vars in 1143 bytes} [Mon Aug 29 22:35:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:35:32.803112 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34463e02-eb6b-48c3-8356-b7fb2585cb56 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:32.926350 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34463e02-eb6b-48c3-8356-b7fb2585cb56 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:32.964980 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d3904-a41e-4d9d-83a3-f6613037734a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:32.965723 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d3904-a41e-4d9d-83a3-f6613037734a None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:32.966072 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d3904-a41e-4d9d-83a3-f6613037734a None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:32.966433 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d3904-a41e-4d9d-83a3-f6613037734a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:32.999623 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:35:33.048267 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d3904-a41e-4d9d-83a3-f6613037734a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:33.049773 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d3904-a41e-4d9d-83a3-f6613037734a None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:33.184934 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 616/1214] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Aug 29 22:35:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 22:35:33.190869 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc244874-8d61-4a19-b57b-d9cd77bc9987 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:33.213532 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:35:33.310967 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc244874-8d61-4a19-b57b-d9cd77bc9987 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:33.354889 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cbc92d-8e24-4c52-8405-e0c9864e7626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:33.356323 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cbc92d-8e24-4c52-8405-e0c9864e7626 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:33.356635 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cbc92d-8e24-4c52-8405-e0c9864e7626 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:33.356967 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cbc92d-8e24-4c52-8405-e0c9864e7626 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:33.368350 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cbc92d-8e24-4c52-8405-e0c9864e7626 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:33.370508 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cbc92d-8e24-4c52-8405-e0c9864e7626 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:33.386870 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-19cbc92d-8e24-4c52-8405-e0c9864e7626 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:35:33.386870 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:35:33.386870 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:35:33.386870 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:35:33.386870 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:35:33.386870 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:35:33.386870 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:35:33.386870 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:35:33.386870 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:35:33.386870 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:35:33.386870 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:35:33.386870 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:35:33.386870 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:35:33.386870 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:35:33.386870 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:35:33.386870 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:35:33.388063 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:35:33.388063 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:35:33.388063 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:35:33.388063 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:35:33.388063 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:35:33.388063 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:35:33.388063 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:35:33.388063 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:35:33.388063 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:35:33.388063 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:35:33.388063 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:35:33.388063 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:35:33.388063 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:35:33.388063 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:35:33.388063 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:35:33.388063 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:35:33.388063 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:35:33.389098 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:35:33.389098 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:35:33.389098 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:35:33.389098 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 599/1215] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:35:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:35:33.394955 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d3904-a41e-4d9d-83a3-f6613037734a None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:33.468853 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:35:33.516198 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d3904-a41e-4d9d-83a3-f6613037734a None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:33.558661 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee4b80a-0eed-44d1-8509-4b1f9a22f01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:33.559201 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4b80a-0eed-44d1-8509-4b1f9a22f01a None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:33.559493 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4b80a-0eed-44d1-8509-4b1f9a22f01a None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:33.559785 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4b80a-0eed-44d1-8509-4b1f9a22f01a None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:33.560479 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee4b80a-0eed-44d1-8509-4b1f9a22f01a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:35:33.560818 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee4b80a-0eed-44d1-8509-4b1f9a22f01a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:33.562368 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee4b80a-0eed-44d1-8509-4b1f9a22f01a None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:33.577465 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 617/1216] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:35:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:35:33.583150 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cbc92d-8e24-4c52-8405-e0c9864e7626 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:33.663178 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:35:33.701011 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cbc92d-8e24-4c52-8405-e0c9864e7626 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:33.740232 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6783c75-d047-48e0-bc01-bd802b64660d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:33.740893 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6783c75-d047-48e0-bc01-bd802b64660d None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:33.741192 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6783c75-d047-48e0-bc01-bd802b64660d None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:33.741503 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6783c75-d047-48e0-bc01-bd802b64660d None admin] PATH_INFO: `/v3/projects/service` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:33.749725 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6783c75-d047-48e0-bc01-bd802b64660d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:33.751174 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6783c75-d047-48e0-bc01-bd802b64660d None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:33.763867 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-e6783c75-d047-48e0-bc01-bd802b64660d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:35:33.763867 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:35:33.763867 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:35:33.763867 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:35:33.763867 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:35:33.763867 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:35:33.763867 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:35:33.763867 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:35:33.763867 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:35:33.763867 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:35:33.763867 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:35:33.763867 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:35:33.763867 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:35:33.763867 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:35:33.763867 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:35:33.765473 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:35:33.765473 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:35:33.765473 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:35:33.765473 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:35:33.765473 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:35:33.765473 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:35:33.765473 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:35:33.765473 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:35:33.765473 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:35:33.765473 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:35:33.765473 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:35:33.765473 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:35:33.765473 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:35:33.765473 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:35:33.765473 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:35:33.765473 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:35:33.765473 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:35:33.766768 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:35:33.766768 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:35:33.766768 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:35:33.766768 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:35:33.766768 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:35:33.766768 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:35:33.766768 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:35:33.766768 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:35:33.766768 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 600/1217] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Aug 29 22:35:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:35:33.770987 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee4b80a-0eed-44d1-8509-4b1f9a22f01a None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:33.902097 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee4b80a-0eed-44d1-8509-4b1f9a22f01a None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:33.931959 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:35:33.946127 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1414bac9-ba5f-49fc-9b51-06c3487ac8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:33.946772 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414bac9-ba5f-49fc-9b51-06c3487ac8c0 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:33.947569 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414bac9-ba5f-49fc-9b51-06c3487ac8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:33.947855 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414bac9-ba5f-49fc-9b51-06c3487ac8c0 None admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:33.948534 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1414bac9-ba5f-49fc-9b51-06c3487ac8c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:35:33.948842 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1414bac9-ba5f-49fc-9b51-06c3487ac8c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:33.951562 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1414bac9-ba5f-49fc-9b51-06c3487ac8c0 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:33.965110 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 618/1218] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Aug 29 22:35:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:35:33.971188 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6783c75-d047-48e0-bc01-bd802b64660d None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:34.091138 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6783c75-d047-48e0-bc01-bd802b64660d None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:34.122616 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:35:34.130859 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d7aea3-ca30-4358-ac7b-47cc75446b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:34.131625 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d7aea3-ca30-4358-ac7b-47cc75446b40 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:34.132011 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d7aea3-ca30-4358-ac7b-47cc75446b40 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:34.132405 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d7aea3-ca30-4358-ac7b-47cc75446b40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:34.133262 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d7aea3-ca30-4358-ac7b-47cc75446b40 None admin] RBAC: Adding query filter params (role.id=938d531e06764249874d708978e7a0e9, scope.project.id=ce09f0beb1a342febbb4a8b3c7cf60c2, user.id=296cbef772104e078971ba93aa2e022c) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:35:34.133725 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d7aea3-ca30-4358-ac7b-47cc75446b40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:34.135371 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d7aea3-ca30-4358-ac7b-47cc75446b40 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:34.142016 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 601/1219] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Aug 29 22:35:33 2022] GET /identity/v3/role_assignments?user.id=296cbef772104e078971ba93aa2e022c&scope.project.id=ce09f0beb1a342febbb4a8b3c7cf60c2&role.id=938d531e06764249874d708978e7a0e9 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:35:36.161628 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e5e7b7-9edf-4b02-a0eb-9fa2ee48b11c None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:36.162168 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e5e7b7-9edf-4b02-a0eb-9fa2ee48b11c None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:36.162168 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e5e7b7-9edf-4b02-a0eb-9fa2ee48b11c None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:36.163759 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 619/1220] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:35:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:35:36.170749 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac523cc1-5e93-4aba-b818-587983894727 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:36.170749 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac523cc1-5e93-4aba-b818-587983894727 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:36.170749 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac523cc1-5e93-4aba-b818-587983894727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:36.189505 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-ac523cc1-5e93-4aba-b818-587983894727 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:35:36.190712 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-ac523cc1-5e93-4aba-b818-587983894727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:35:36.266802 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 602/1221] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:35:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:35:36.585154 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e5e7b7-9edf-4b02-a0eb-9fa2ee48b11c None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:36.702450 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e5e7b7-9edf-4b02-a0eb-9fa2ee48b11c None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:36.743168 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e1385a-d93d-4b7e-8b26-9a0903ac6bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:36.743799 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e1385a-d93d-4b7e-8b26-9a0903ac6bf4 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:36.744205 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e1385a-d93d-4b7e-8b26-9a0903ac6bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:36.744358 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e1385a-d93d-4b7e-8b26-9a0903ac6bf4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:36.757983 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e1385a-d93d-4b7e-8b26-9a0903ac6bf4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:35:36.765154 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-58e1385a-d93d-4b7e-8b26-9a0903ac6bf4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:35:36.765154 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:35:36.765154 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:35:36.765154 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:35:36.765154 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:35:36.765154 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:35:36.765154 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:35:36.765154 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:35:36.765154 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:35:36.765154 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:35:36.765154 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:35:36.765154 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:35:36.765154 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:35:36.765154 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:35:36.765154 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:35:36.765154 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:35:36.766262 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:35:36.766262 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:35:36.766262 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:35:36.766262 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:35:36.766262 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:35:36.766262 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:35:36.766262 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:35:36.766262 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:35:36.766262 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:35:36.766262 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:35:36.766262 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:35:36.766262 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:35:36.766262 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:35:36.766262 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:35:36.766262 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:35:36.766262 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:35:36.767180 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:35:36.767180 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:35:36.767180 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:35:36.767180 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:35:36.767180 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:35:36.767180 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:35:36.767180 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:35:36.767180 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:35:36.767180 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:35:36.767180 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:35:36.767180 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:35:36.767180 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:35:36.767180 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 620/1222] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Aug 29 22:35:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:35:36.773128 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac523cc1-5e93-4aba-b818-587983894727 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:36.898567 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac523cc1-5e93-4aba-b818-587983894727 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:36.929927 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:35:36.948566 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f1bedb-cc9b-4588-8733-1d471462b6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:36.949726 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f1bedb-cc9b-4588-8733-1d471462b6f2 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:36.950065 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f1bedb-cc9b-4588-8733-1d471462b6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:36.950435 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f1bedb-cc9b-4588-8733-1d471462b6f2 None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:36.951221 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f1bedb-cc9b-4588-8733-1d471462b6f2 None admin] RBAC: Adding query filter params (name=service) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:35:36.951542 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f1bedb-cc9b-4588-8733-1d471462b6f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:36.953364 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f1bedb-cc9b-4588-8733-1d471462b6f2 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:36.964689 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 603/1223] 10.222.0.47 () {56 vars in 1103 bytes} [Mon Aug 29 22:35:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:35:36.970685 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e1385a-d93d-4b7e-8b26-9a0903ac6bf4 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:37.020669 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:35:37.086313 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e1385a-d93d-4b7e-8b26-9a0903ac6bf4 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:37.128512 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb767f9-659b-48ef-9490-f0a01b79721e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:37.129318 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb767f9-659b-48ef-9490-f0a01b79721e None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:37.129725 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb767f9-659b-48ef-9490-f0a01b79721e None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:37.130089 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb767f9-659b-48ef-9490-f0a01b79721e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:37.141233 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb767f9-659b-48ef-9490-f0a01b79721e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:37.142907 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb767f9-659b-48ef-9490-f0a01b79721e None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:37.160201 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-5bb767f9-659b-48ef-9490-f0a01b79721e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:35:37.160201 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:35:37.160201 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:35:37.160201 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:35:37.160201 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:35:37.160201 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:35:37.160201 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:35:37.160201 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:35:37.160201 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:35:37.160201 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:35:37.160201 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:35:37.160201 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:35:37.160201 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:35:37.160201 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:35:37.160201 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:35:37.160201 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:35:37.161421 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:35:37.161421 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:35:37.161421 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:35:37.161421 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:35:37.161421 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:35:37.161421 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:35:37.161421 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:35:37.161421 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:35:37.161421 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:35:37.161421 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:35:37.161421 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:35:37.161421 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:35:37.161421 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:35:37.161421 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:35:37.161421 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:35:37.161421 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:35:37.161421 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:35:37.163213 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:35:37.163213 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:35:37.163213 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:35:37.163213 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 621/1224] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:35:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:35:37.168472 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f1bedb-cc9b-4588-8733-1d471462b6f2 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:37.287221 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f1bedb-cc9b-4588-8733-1d471462b6f2 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:37.331062 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b0769b-40f0-4593-a0a5-b4e40544a067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:37.331721 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0769b-40f0-4593-a0a5-b4e40544a067 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:37.332086 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0769b-40f0-4593-a0a5-b4e40544a067 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:37.332459 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0769b-40f0-4593-a0a5-b4e40544a067 None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:37.333215 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b0769b-40f0-4593-a0a5-b4e40544a067 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:35:37.333596 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b0769b-40f0-4593-a0a5-b4e40544a067 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:37.335150 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b0769b-40f0-4593-a0a5-b4e40544a067 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:37.350831 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 604/1225] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:35:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:35:37.357861 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb767f9-659b-48ef-9490-f0a01b79721e None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:37.466787 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:35:37.474628 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb767f9-659b-48ef-9490-f0a01b79721e None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:37.515353 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84de83b-d206-48ea-9b3a-4c8e4cf06af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:37.516023 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84de83b-d206-48ea-9b3a-4c8e4cf06af7 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:37.516300 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84de83b-d206-48ea-9b3a-4c8e4cf06af7 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:37.516613 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84de83b-d206-48ea-9b3a-4c8e4cf06af7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:37.524650 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84de83b-d206-48ea-9b3a-4c8e4cf06af7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:37.527320 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84de83b-d206-48ea-9b3a-4c8e4cf06af7 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:37.540516 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-b84de83b-d206-48ea-9b3a-4c8e4cf06af7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 22:35:37.540516 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:35:37.540516 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:35:37.540516 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:35:37.540516 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:35:37.540516 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:35:37.540516 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:35:37.540516 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:35:37.540516 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:35:37.540516 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:35:37.540516 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:35:37.540516 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:35:37.540516 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:35:37.540516 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:35:37.540516 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:35:37.540516 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:35:37.541816 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:35:37.541816 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:35:37.541816 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:35:37.541816 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:35:37.541816 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:35:37.541816 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:35:37.541816 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:35:37.541816 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:35:37.541816 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:35:37.541816 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:35:37.541816 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:35:37.541816 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:35:37.541816 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:35:37.541816 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:35:37.541816 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:35:37.541816 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:35:37.541816 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:35:37.541816 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:35:37.542923 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:35:37.542923 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:35:37.542923 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:35:37.542923 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:35:37.542923 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:35:37.542923 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:35:37.542923 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:35:37.542923 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:35:37.542923 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 22:35:37.542923 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:35:37.542923 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 622/1226] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:35:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:35:37.547786 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b0769b-40f0-4593-a0a5-b4e40544a067 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:37.600209 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:35:37.664495 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b0769b-40f0-4593-a0a5-b4e40544a067 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:37.705917 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63556636-89e6-429f-a34a-1f6bed3fb358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:37.706532 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63556636-89e6-429f-a34a-1f6bed3fb358 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:37.706822 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63556636-89e6-429f-a34a-1f6bed3fb358 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:37.707099 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63556636-89e6-429f-a34a-1f6bed3fb358 None admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:37.707834 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63556636-89e6-429f-a34a-1f6bed3fb358 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:35:37.708139 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63556636-89e6-429f-a34a-1f6bed3fb358 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:37.709603 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63556636-89e6-429f-a34a-1f6bed3fb358 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:37.731483 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 605/1227] 10.222.0.47 () {56 vars in 1143 bytes} [Mon Aug 29 22:35:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:35:37.737572 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84de83b-d206-48ea-9b3a-4c8e4cf06af7 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:37.851387 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84de83b-d206-48ea-9b3a-4c8e4cf06af7 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:37.890233 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39a9b43-f52b-4b83-ba5d-3c01329edd1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:37.890954 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a9b43-f52b-4b83-ba5d-3c01329edd1b None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:37.891216 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a9b43-f52b-4b83-ba5d-3c01329edd1b None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:37.891526 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a9b43-f52b-4b83-ba5d-3c01329edd1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:37.905453 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39a9b43-f52b-4b83-ba5d-3c01329edd1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:37.906957 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39a9b43-f52b-4b83-ba5d-3c01329edd1b None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:37.923294 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-b39a9b43-f52b-4b83-ba5d-3c01329edd1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:35:37.923294 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:35:37.923294 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:35:37.923294 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:35:37.923294 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:35:37.923294 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:35:37.923294 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:35:37.923294 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:35:37.923294 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:35:37.923294 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:35:37.923294 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:35:37.923294 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:35:37.923294 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:35:37.923294 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:35:37.923294 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:35:37.923294 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:35:37.924554 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:35:37.924554 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:35:37.924554 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:35:37.924554 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:35:37.924554 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:35:37.924554 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:35:37.924554 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:35:37.924554 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:35:37.924554 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:35:37.924554 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:35:37.924554 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:35:37.924554 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:35:37.924554 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:35:37.924554 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:35:37.924554 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:35:37.924554 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:35:37.924554 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:35:37.926005 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:35:37.926005 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:35:37.926005 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:35:37.926005 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 623/1228] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:35:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:35:37.931210 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63556636-89e6-429f-a34a-1f6bed3fb358 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:38.046086 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63556636-89e6-429f-a34a-1f6bed3fb358 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:38.048439 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:35:38.093886 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f8dde3-8bd1-4984-9acf-ccc72727eed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:38.094537 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f8dde3-8bd1-4984-9acf-ccc72727eed6 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:38.094825 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f8dde3-8bd1-4984-9acf-ccc72727eed6 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:38.095275 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f8dde3-8bd1-4984-9acf-ccc72727eed6 None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:38.095805 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f8dde3-8bd1-4984-9acf-ccc72727eed6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:35:38.096106 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f8dde3-8bd1-4984-9acf-ccc72727eed6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:38.097561 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f8dde3-8bd1-4984-9acf-ccc72727eed6 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:38.117076 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 606/1229] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:35:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:35:38.118645 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39a9b43-f52b-4b83-ba5d-3c01329edd1b None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:38.130585 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:35:38.233268 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39a9b43-f52b-4b83-ba5d-3c01329edd1b None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:38.268952 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6234cfdb-0879-410f-84c2-6d797f4f2aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:38.269602 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234cfdb-0879-410f-84c2-6d797f4f2aaa None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:38.269880 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234cfdb-0879-410f-84c2-6d797f4f2aaa None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:38.270150 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234cfdb-0879-410f-84c2-6d797f4f2aaa None admin] PATH_INFO: `/v3/projects/service` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:38.277124 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6234cfdb-0879-410f-84c2-6d797f4f2aaa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:38.278600 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6234cfdb-0879-410f-84c2-6d797f4f2aaa None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:38.291962 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-6234cfdb-0879-410f-84c2-6d797f4f2aaa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:35:38.291962 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:35:38.291962 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:35:38.291962 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:35:38.291962 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:35:38.291962 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:35:38.291962 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:35:38.291962 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:35:38.291962 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:35:38.291962 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:35:38.291962 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:35:38.291962 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:35:38.291962 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:35:38.291962 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:35:38.291962 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:35:38.293146 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:35:38.293146 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:35:38.293146 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:35:38.293146 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:35:38.293146 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:35:38.293146 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:35:38.293146 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:35:38.293146 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:35:38.293146 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:35:38.293146 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:35:38.293146 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:35:38.293146 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:35:38.293146 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:35:38.293146 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:35:38.293146 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:35:38.293146 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:35:38.293146 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:35:38.294234 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:35:38.294234 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:35:38.294234 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:35:38.294234 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:35:38.294234 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:35:38.294234 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:35:38.294234 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:35:38.294234 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:35:38.294234 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 624/1230] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Aug 29 22:35:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:35:38.299061 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f8dde3-8bd1-4984-9acf-ccc72727eed6 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:38.411592 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f8dde3-8bd1-4984-9acf-ccc72727eed6 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:38.450866 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02310bc6-f01a-44c7-80c4-3d858200c6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:38.451770 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02310bc6-f01a-44c7-80c4-3d858200c6bd None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:38.452058 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02310bc6-f01a-44c7-80c4-3d858200c6bd None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:38.452352 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02310bc6-f01a-44c7-80c4-3d858200c6bd None admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:38.453150 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02310bc6-f01a-44c7-80c4-3d858200c6bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:35:38.453624 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02310bc6-f01a-44c7-80c4-3d858200c6bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:38.455313 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02310bc6-f01a-44c7-80c4-3d858200c6bd None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:38.468669 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 607/1231] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Aug 29 22:35:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:35:38.475008 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6234cfdb-0879-410f-84c2-6d797f4f2aaa None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:38.551008 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:35:38.591722 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6234cfdb-0879-410f-84c2-6d797f4f2aaa None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:38.630083 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900d467e-d85f-4aa1-90f5-d67a21cd2b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:38.630792 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900d467e-d85f-4aa1-90f5-d67a21cd2b9e None admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:38.631077 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900d467e-d85f-4aa1-90f5-d67a21cd2b9e None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:38.631356 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900d467e-d85f-4aa1-90f5-d67a21cd2b9e None admin] PATH_INFO: `/v3/projects/ce09f0beb1a342febbb4a8b3c7cf60c2/users/296cbef772104e078971ba93aa2e022c/roles/938d531e06764249874d708978e7a0e9` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:38.646994 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900d467e-d85f-4aa1-90f5-d67a21cd2b9e None admin] RBAC: Authorizing `identity:create_grant(project_id=ce09f0beb1a342febbb4a8b3c7cf60c2, user_id=296cbef772104e078971ba93aa2e022c, role_id=938d531e06764249874d708978e7a0e9)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:38.648492 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900d467e-d85f-4aa1-90f5-d67a21cd2b9e None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:38.662035 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 625/1232] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Aug 29 22:35:38 2022] PUT /identity/v3/projects/ce09f0beb1a342febbb4a8b3c7cf60c2/users/296cbef772104e078971ba93aa2e022c/roles/938d531e06764249874d708978e7a0e9 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:35:40.661012 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162bed61-405c-4a07-ac30-2eca74203393 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:40.661865 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162bed61-405c-4a07-ac30-2eca74203393 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:40.661865 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162bed61-405c-4a07-ac30-2eca74203393 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:40.662931 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 608/1233] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:35:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:35:40.668911 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6051d7ad-3a88-4e7b-9166-4ea5cf868c87 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:40.669615 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6051d7ad-3a88-4e7b-9166-4ea5cf868c87 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:40.669615 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6051d7ad-3a88-4e7b-9166-4ea5cf868c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:40.689863 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-6051d7ad-3a88-4e7b-9166-4ea5cf868c87 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:35:40.691263 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-6051d7ad-3a88-4e7b-9166-4ea5cf868c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:35:40.768915 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 626/1234] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:35:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:35:41.045117 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162bed61-405c-4a07-ac30-2eca74203393 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:41.076519 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:35:41.173302 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162bed61-405c-4a07-ac30-2eca74203393 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:41.214087 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f22f1df-e9d6-493e-91a2-eff5f0cf29f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:41.214718 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22f1df-e9d6-493e-91a2-eff5f0cf29f1 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:41.214990 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22f1df-e9d6-493e-91a2-eff5f0cf29f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:41.215258 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22f1df-e9d6-493e-91a2-eff5f0cf29f1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:41.225181 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f22f1df-e9d6-493e-91a2-eff5f0cf29f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:35:41.230028 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-3f22f1df-e9d6-493e-91a2-eff5f0cf29f1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:35:41.230028 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:35:41.230028 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:35:41.230028 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:35:41.230028 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:35:41.230028 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:35:41.230028 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:35:41.230028 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:35:41.230028 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:35:41.230028 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:35:41.230028 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:35:41.230028 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:35:41.230028 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:35:41.230028 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:35:41.230028 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:35:41.230028 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:35:41.231134 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:35:41.231134 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:35:41.231134 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:35:41.231134 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:35:41.231134 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:35:41.231134 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:35:41.231134 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:35:41.231134 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:35:41.231134 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:35:41.231134 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:35:41.231134 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:35:41.231134 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:35:41.231134 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:35:41.231134 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:35:41.231134 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:35:41.231134 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:35:41.232049 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:35:41.232049 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:35:41.232049 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:35:41.232049 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:35:41.232049 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:35:41.232049 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:35:41.232049 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:35:41.232049 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:35:41.232049 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:35:41.232049 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:35:41.232049 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 22:35:41.232049 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:35:41.232049 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 609/1235] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Aug 29 22:35:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:35:41.237759 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6051d7ad-3a88-4e7b-9166-4ea5cf868c87 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:41.296421 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:35:41.359843 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6051d7ad-3a88-4e7b-9166-4ea5cf868c87 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:41.398604 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8037de34-f7e2-4e12-b181-bb9547710d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:41.399573 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037de34-f7e2-4e12-b181-bb9547710d2f None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:41.399880 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037de34-f7e2-4e12-b181-bb9547710d2f None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:41.400164 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037de34-f7e2-4e12-b181-bb9547710d2f None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:41.400951 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8037de34-f7e2-4e12-b181-bb9547710d2f None admin] RBAC: Adding query filter params (name=service) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:35:41.401218 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8037de34-f7e2-4e12-b181-bb9547710d2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:41.402756 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8037de34-f7e2-4e12-b181-bb9547710d2f None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:41.413609 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 627/1236] 10.222.0.47 () {56 vars in 1103 bytes} [Mon Aug 29 22:35:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:35:41.418824 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f22f1df-e9d6-493e-91a2-eff5f0cf29f1 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:41.520159 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:35:41.539298 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f22f1df-e9d6-493e-91a2-eff5f0cf29f1 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:41.575844 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae691af-64a7-40dd-b870-753d3d1e71a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:41.576590 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae691af-64a7-40dd-b870-753d3d1e71a4 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:41.576877 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae691af-64a7-40dd-b870-753d3d1e71a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:41.577154 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae691af-64a7-40dd-b870-753d3d1e71a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:41.589569 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae691af-64a7-40dd-b870-753d3d1e71a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:41.591072 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae691af-64a7-40dd-b870-753d3d1e71a4 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:41.606437 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-1ae691af-64a7-40dd-b870-753d3d1e71a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:35:41.606437 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:35:41.606437 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:35:41.606437 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:35:41.606437 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:35:41.606437 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:35:41.606437 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:35:41.606437 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:35:41.606437 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:35:41.606437 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:35:41.606437 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:35:41.606437 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:35:41.606437 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:35:41.606437 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:35:41.606437 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:35:41.606437 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:35:41.607679 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:35:41.607679 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:35:41.607679 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:35:41.607679 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:35:41.607679 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:35:41.607679 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:35:41.607679 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:35:41.607679 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:35:41.607679 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:35:41.607679 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:35:41.607679 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:35:41.607679 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:35:41.607679 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:35:41.607679 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:35:41.607679 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:35:41.607679 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:35:41.607679 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:35:41.608572 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:35:41.608572 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:35:41.608572 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:35:41.608572 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 610/1237] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:35:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:35:41.613790 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8037de34-f7e2-4e12-b181-bb9547710d2f None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:41.722677 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8037de34-f7e2-4e12-b181-bb9547710d2f None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:41.731886 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:35:41.760013 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e138f015-1002-435d-8594-7bb61a2410b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:41.761228 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138f015-1002-435d-8594-7bb61a2410b4 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:41.761535 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138f015-1002-435d-8594-7bb61a2410b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:41.761811 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138f015-1002-435d-8594-7bb61a2410b4 None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:41.762463 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e138f015-1002-435d-8594-7bb61a2410b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:35:41.762765 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e138f015-1002-435d-8594-7bb61a2410b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:41.764214 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e138f015-1002-435d-8594-7bb61a2410b4 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:41.777044 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 628/1238] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:35:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:35:41.783630 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae691af-64a7-40dd-b870-753d3d1e71a4 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:41.891967 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae691af-64a7-40dd-b870-753d3d1e71a4 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:41.935708 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e3e92-6d47-4002-b6d1-d8e5fc60a8b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:41.936357 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e3e92-6d47-4002-b6d1-d8e5fc60a8b1 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:41.936623 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e3e92-6d47-4002-b6d1-d8e5fc60a8b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:41.936919 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e3e92-6d47-4002-b6d1-d8e5fc60a8b1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:41.940410 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:35:41.946612 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37e3e92-6d47-4002-b6d1-d8e5fc60a8b1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:41.949097 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37e3e92-6d47-4002-b6d1-d8e5fc60a8b1 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:41.960699 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-c37e3e92-6d47-4002-b6d1-d8e5fc60a8b1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 22:35:41.960699 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:35:41.960699 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:35:41.960699 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:35:41.960699 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:35:41.960699 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:35:41.960699 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:35:41.960699 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:35:41.960699 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:35:41.960699 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:35:41.960699 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:35:41.960699 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:35:41.960699 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:35:41.960699 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:35:41.960699 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:35:41.960699 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:35:41.961909 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:35:41.961909 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:35:41.961909 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:35:41.961909 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:35:41.961909 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:35:41.961909 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:35:41.961909 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:35:41.961909 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:35:41.961909 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:35:41.961909 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:35:41.961909 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:35:41.961909 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:35:41.961909 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:35:41.961909 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:35:41.961909 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:35:41.961909 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:35:41.961909 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:35:41.961909 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:35:41.963274 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:35:41.963274 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:35:41.963274 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:35:41.963274 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:35:41.963274 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:35:41.963274 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:35:41.963274 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:35:41.963274 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:35:41.963274 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 22:35:41.963274 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:35:41.965771 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 611/1239] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:35:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:35:41.967900 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e138f015-1002-435d-8594-7bb61a2410b4 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:42.104807 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e138f015-1002-435d-8594-7bb61a2410b4 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:42.153843 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239f675-16b5-4db6-8c0b-ecd22d904b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:42.154381 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239f675-16b5-4db6-8c0b-ecd22d904b44 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:42.154675 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239f675-16b5-4db6-8c0b-ecd22d904b44 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:42.154970 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239f675-16b5-4db6-8c0b-ecd22d904b44 None admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:42.155754 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d239f675-16b5-4db6-8c0b-ecd22d904b44 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:35:42.156076 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d239f675-16b5-4db6-8c0b-ecd22d904b44 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:42.157610 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d239f675-16b5-4db6-8c0b-ecd22d904b44 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:42.177728 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 629/1240] 10.222.0.47 () {56 vars in 1143 bytes} [Mon Aug 29 22:35:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:35:42.186155 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e3e92-6d47-4002-b6d1-d8e5fc60a8b1 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:42.302876 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e3e92-6d47-4002-b6d1-d8e5fc60a8b1 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:42.342492 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2dd1cb-538b-4e11-a955-d4ec7e5897c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:42.343139 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2dd1cb-538b-4e11-a955-d4ec7e5897c8 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:42.343463 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2dd1cb-538b-4e11-a955-d4ec7e5897c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:42.343742 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2dd1cb-538b-4e11-a955-d4ec7e5897c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:42.413363 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:35:42.422032 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2dd1cb-538b-4e11-a955-d4ec7e5897c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:42.423623 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2dd1cb-538b-4e11-a955-d4ec7e5897c8 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:42.535205 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 612/1241] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Aug 29 22:35:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 22:35:42.542413 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239f675-16b5-4db6-8c0b-ecd22d904b44 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:42.573544 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:35:42.660184 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239f675-16b5-4db6-8c0b-ecd22d904b44 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:42.698209 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0a0aba-ee8c-4790-866d-a7b110d60b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:42.698748 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a0aba-ee8c-4790-866d-a7b110d60b37 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:42.699020 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a0aba-ee8c-4790-866d-a7b110d60b37 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:42.699285 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a0aba-ee8c-4790-866d-a7b110d60b37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:42.710960 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0a0aba-ee8c-4790-866d-a7b110d60b37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:42.712630 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0a0aba-ee8c-4790-866d-a7b110d60b37 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:42.733006 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-cc0a0aba-ee8c-4790-866d-a7b110d60b37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:35:42.733006 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:35:42.733006 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:35:42.733006 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:35:42.733006 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:35:42.733006 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:35:42.733006 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:35:42.733006 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:35:42.733006 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:35:42.733006 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:35:42.733006 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:35:42.733006 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:35:42.733006 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:35:42.733006 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:35:42.733006 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:35:42.733006 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:35:42.739304 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:35:42.739304 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:35:42.739304 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:35:42.739304 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:35:42.739304 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:35:42.739304 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:35:42.739304 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:35:42.739304 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:35:42.739304 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:35:42.739304 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:35:42.739304 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:35:42.739304 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:35:42.739304 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:35:42.739304 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:35:42.739304 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:35:42.739304 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:35:42.739304 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:35:42.740365 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:35:42.740365 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:35:42.740365 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:35:42.740365 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 630/1242] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:35:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:35:42.740605 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2dd1cb-538b-4e11-a955-d4ec7e5897c8 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:42.844147 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:35:42.851226 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2dd1cb-538b-4e11-a955-d4ec7e5897c8 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:42.890823 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d8e50-9734-4ccd-95e5-ad7881f6568b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:42.891611 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d8e50-9734-4ccd-95e5-ad7881f6568b None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:42.891957 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d8e50-9734-4ccd-95e5-ad7881f6568b None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:42.892259 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d8e50-9734-4ccd-95e5-ad7881f6568b None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:42.892911 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10d8e50-9734-4ccd-95e5-ad7881f6568b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:35:42.893218 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10d8e50-9734-4ccd-95e5-ad7881f6568b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:42.894630 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10d8e50-9734-4ccd-95e5-ad7881f6568b None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:42.909373 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 613/1243] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:35:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:35:42.915541 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0a0aba-ee8c-4790-866d-a7b110d60b37 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:43.011560 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:35:43.037733 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0a0aba-ee8c-4790-866d-a7b110d60b37 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:43.085490 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b96a5-aa16-4df1-90a6-71e0d86090f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:43.086209 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b96a5-aa16-4df1-90a6-71e0d86090f1 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:43.086510 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b96a5-aa16-4df1-90a6-71e0d86090f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:43.086858 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b96a5-aa16-4df1-90a6-71e0d86090f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:43.096034 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984b96a5-aa16-4df1-90a6-71e0d86090f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:43.097739 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984b96a5-aa16-4df1-90a6-71e0d86090f1 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:43.111528 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-984b96a5-aa16-4df1-90a6-71e0d86090f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:35:43.111528 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:35:43.111528 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:35:43.111528 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:35:43.111528 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:35:43.111528 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:35:43.111528 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:35:43.111528 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:35:43.111528 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:35:43.111528 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:35:43.111528 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:35:43.111528 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:35:43.111528 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:35:43.111528 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:35:43.111528 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:35:43.112628 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:35:43.112628 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:35:43.112628 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:35:43.112628 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:35:43.112628 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:35:43.112628 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:35:43.112628 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:35:43.112628 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:35:43.112628 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:35:43.112628 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:35:43.112628 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:35:43.112628 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:35:43.112628 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:35:43.112628 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:35:43.112628 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:35:43.112628 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:35:43.112628 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:35:43.113906 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:35:43.113906 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:35:43.113906 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:35:43.113906 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:35:43.113906 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:35:43.113906 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:35:43.113906 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:35:43.113906 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:35:43.113906 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 631/1244] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Aug 29 22:35:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:35:43.121072 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d8e50-9734-4ccd-95e5-ad7881f6568b None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:43.251440 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d8e50-9734-4ccd-95e5-ad7881f6568b None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:43.289953 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51bd3a4-8569-4db3-a13f-d90bba71b96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:43.290569 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51bd3a4-8569-4db3-a13f-d90bba71b96f None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:43.290918 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51bd3a4-8569-4db3-a13f-d90bba71b96f None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:43.291510 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51bd3a4-8569-4db3-a13f-d90bba71b96f None admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:43.292206 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51bd3a4-8569-4db3-a13f-d90bba71b96f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:35:43.292525 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51bd3a4-8569-4db3-a13f-d90bba71b96f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:43.294173 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51bd3a4-8569-4db3-a13f-d90bba71b96f None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:43.309523 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 614/1245] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Aug 29 22:35:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:35:43.315611 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b96a5-aa16-4df1-90a6-71e0d86090f1 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:43.433113 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b96a5-aa16-4df1-90a6-71e0d86090f1 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:43.474446 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d875f9dd-f8a9-4913-81bf-15e7754b5af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:43.475100 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875f9dd-f8a9-4913-81bf-15e7754b5af7 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:43.475383 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875f9dd-f8a9-4913-81bf-15e7754b5af7 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:43.475656 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875f9dd-f8a9-4913-81bf-15e7754b5af7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:43.476386 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d875f9dd-f8a9-4913-81bf-15e7754b5af7 None admin] RBAC: Adding query filter params (role.id=938d531e06764249874d708978e7a0e9, scope.project.id=ce09f0beb1a342febbb4a8b3c7cf60c2, user.id=296cbef772104e078971ba93aa2e022c) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:35:43.476717 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d875f9dd-f8a9-4913-81bf-15e7754b5af7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:43.478223 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d875f9dd-f8a9-4913-81bf-15e7754b5af7 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:43.484326 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 632/1246] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Aug 29 22:35:43 2022] GET /identity/v3/role_assignments?user.id=296cbef772104e078971ba93aa2e022c&scope.project.id=ce09f0beb1a342febbb4a8b3c7cf60c2&role.id=938d531e06764249874d708978e7a0e9 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:35:45.661500 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e307590-100c-4f6a-b167-f7502e568c1c None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:45.662070 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e307590-100c-4f6a-b167-f7502e568c1c None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:45.662070 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e307590-100c-4f6a-b167-f7502e568c1c None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:45.663620 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 615/1247] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:35:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:35:45.670406 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2dfb1-1435-4ef2-9985-aef68ebb50a3 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:45.670998 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2dfb1-1435-4ef2-9985-aef68ebb50a3 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:45.670998 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2dfb1-1435-4ef2-9985-aef68ebb50a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:45.677851 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:35:45.691880 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-11b2dfb1-1435-4ef2-9985-aef68ebb50a3 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:35:45.693081 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-11b2dfb1-1435-4ef2-9985-aef68ebb50a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:35:45.777383 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 633/1248] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:35:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:35:46.054892 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e307590-100c-4f6a-b167-f7502e568c1c None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:46.079224 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:35:46.186700 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e307590-100c-4f6a-b167-f7502e568c1c None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:46.230881 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b06e4-84f6-44d0-bc41-f90588036dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:46.231595 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b06e4-84f6-44d0-bc41-f90588036dc4 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:46.231970 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b06e4-84f6-44d0-bc41-f90588036dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:46.232243 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b06e4-84f6-44d0-bc41-f90588036dc4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:46.244021 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24b06e4-84f6-44d0-bc41-f90588036dc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:35:46.250241 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-c24b06e4-84f6-44d0-bc41-f90588036dc4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:35:46.250241 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:35:46.250241 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:35:46.250241 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:35:46.250241 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:35:46.250241 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:35:46.250241 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:35:46.250241 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:35:46.250241 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:35:46.250241 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:35:46.250241 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:35:46.250241 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:35:46.250241 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:35:46.250241 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:35:46.250241 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:35:46.250241 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:35:46.251243 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:35:46.251243 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:35:46.251243 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:35:46.251243 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:35:46.251243 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:35:46.251243 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:35:46.251243 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:35:46.251243 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:35:46.251243 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:35:46.251243 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:35:46.251243 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:35:46.251243 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:35:46.251243 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:35:46.251243 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:35:46.251243 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:35:46.251243 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:35:46.252684 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:35:46.252684 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:35:46.252684 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:35:46.252684 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:35:46.252684 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:35:46.252684 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:35:46.252684 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:35:46.252684 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:35:46.252684 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:35:46.252684 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:35:46.252684 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:35:46.252684 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:35:46.252684 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 616/1249] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Aug 29 22:35:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:35:46.257747 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b2dfb1-1435-4ef2-9985-aef68ebb50a3 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:46.368589 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b2dfb1-1435-4ef2-9985-aef68ebb50a3 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:46.400577 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:35:46.406664 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a49a42-c1a5-44d3-9bc6-dd178ac863a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:46.407447 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a49a42-c1a5-44d3-9bc6-dd178ac863a0 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:46.407927 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a49a42-c1a5-44d3-9bc6-dd178ac863a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:46.408248 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a49a42-c1a5-44d3-9bc6-dd178ac863a0 None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:46.409079 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a49a42-c1a5-44d3-9bc6-dd178ac863a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:35:46.409478 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a49a42-c1a5-44d3-9bc6-dd178ac863a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:46.410963 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a49a42-c1a5-44d3-9bc6-dd178ac863a0 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:46.426652 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 634/1250] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Aug 29 22:35:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:35:46.427962 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b06e4-84f6-44d0-bc41-f90588036dc4 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:46.522837 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:35:46.551811 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b06e4-84f6-44d0-bc41-f90588036dc4 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:46.588840 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900d56a5-1a28-4094-9ec3-bf4b2535a239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:46.589502 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900d56a5-1a28-4094-9ec3-bf4b2535a239 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:46.589785 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900d56a5-1a28-4094-9ec3-bf4b2535a239 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:46.590061 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900d56a5-1a28-4094-9ec3-bf4b2535a239 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:46.600067 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900d56a5-1a28-4094-9ec3-bf4b2535a239 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:46.601551 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900d56a5-1a28-4094-9ec3-bf4b2535a239 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:46.618027 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-900d56a5-1a28-4094-9ec3-bf4b2535a239 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:35:46.618027 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:35:46.618027 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:35:46.618027 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:35:46.618027 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:35:46.618027 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:35:46.618027 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:35:46.618027 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:35:46.618027 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:35:46.618027 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:35:46.618027 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:35:46.618027 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:35:46.618027 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:35:46.618027 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:35:46.618027 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:35:46.618027 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:35:46.619210 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:35:46.619210 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:35:46.619210 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:35:46.619210 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:35:46.619210 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:35:46.619210 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:35:46.619210 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:35:46.619210 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:35:46.619210 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:35:46.619210 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:35:46.619210 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:35:46.619210 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:35:46.619210 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:35:46.619210 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:35:46.619210 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:35:46.619210 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:35:46.619210 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:35:46.621305 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:35:46.621305 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:35:46.621305 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:35:46.621305 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 617/1251] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:35:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:35:46.626070 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a49a42-c1a5-44d3-9bc6-dd178ac863a0 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:46.745634 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a49a42-c1a5-44d3-9bc6-dd178ac863a0 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:46.789102 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776591f1-1d0b-4c70-b0a4-301ef7a01568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:46.789102 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776591f1-1d0b-4c70-b0a4-301ef7a01568 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:46.789102 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776591f1-1d0b-4c70-b0a4-301ef7a01568 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:46.789102 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776591f1-1d0b-4c70-b0a4-301ef7a01568 None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:46.789696 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776591f1-1d0b-4c70-b0a4-301ef7a01568 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:35:46.789696 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776591f1-1d0b-4c70-b0a4-301ef7a01568 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:46.790568 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776591f1-1d0b-4c70-b0a4-301ef7a01568 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:46.804659 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 635/1252] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:35:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:35:46.811593 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900d56a5-1a28-4094-9ec3-bf4b2535a239 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:46.924585 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900d56a5-1a28-4094-9ec3-bf4b2535a239 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:46.953782 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:35:46.962882 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb14a9a-0c71-4b8c-8025-6bc01b5f494f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:46.964231 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb14a9a-0c71-4b8c-8025-6bc01b5f494f None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:46.964573 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb14a9a-0c71-4b8c-8025-6bc01b5f494f None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:46.964862 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb14a9a-0c71-4b8c-8025-6bc01b5f494f None admin] PATH_INFO: `/v3/users/placement` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:46.972877 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb14a9a-0c71-4b8c-8025-6bc01b5f494f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:46.974593 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb14a9a-0c71-4b8c-8025-6bc01b5f494f None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:46.987386 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-5eb14a9a-0c71-4b8c-8025-6bc01b5f494f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 22:35:46.987386 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:35:46.987386 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:35:46.987386 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:35:46.987386 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:35:46.987386 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:35:46.987386 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:35:46.987386 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:35:46.987386 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:35:46.987386 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:35:46.987386 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:35:46.987386 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:35:46.987386 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:35:46.987386 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:35:46.987386 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:35:46.987386 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:35:46.988558 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:35:46.988558 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:35:46.988558 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:35:46.988558 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:35:46.988558 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:35:46.988558 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:35:46.988558 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:35:46.988558 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:35:46.988558 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:35:46.988558 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:35:46.988558 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:35:46.988558 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:35:46.988558 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:35:46.988558 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:35:46.988558 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:35:46.988558 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:35:46.988558 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:35:46.988558 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:35:46.989702 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:35:46.989702 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:35:46.989702 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:35:46.989702 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:35:46.989702 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:35:46.989702 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:35:46.989702 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:35:46.989702 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:35:46.989702 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 22:35:46.989702 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:35:46.989702 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 618/1253] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:35:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:35:46.994691 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776591f1-1d0b-4c70-b0a4-301ef7a01568 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:47.057118 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:35:47.119495 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776591f1-1d0b-4c70-b0a4-301ef7a01568 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:47.160645 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f7bbf2-59d4-4682-b5e1-822cebdeeaa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:47.161244 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7bbf2-59d4-4682-b5e1-822cebdeeaa2 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:47.161549 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7bbf2-59d4-4682-b5e1-822cebdeeaa2 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:47.161816 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7bbf2-59d4-4682-b5e1-822cebdeeaa2 None admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:47.162656 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f7bbf2-59d4-4682-b5e1-822cebdeeaa2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:35:47.162987 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f7bbf2-59d4-4682-b5e1-822cebdeeaa2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:47.164912 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f7bbf2-59d4-4682-b5e1-822cebdeeaa2 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:47.186817 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 636/1254] 10.222.0.47 () {56 vars in 1143 bytes} [Mon Aug 29 22:35:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:35:47.193321 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb14a9a-0c71-4b8c-8025-6bc01b5f494f None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:47.311192 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb14a9a-0c71-4b8c-8025-6bc01b5f494f None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:47.350826 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7f9e46-e037-452b-97cb-759dc547e02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:47.351502 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7f9e46-e037-452b-97cb-759dc547e02d None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:47.351783 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7f9e46-e037-452b-97cb-759dc547e02d None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:47.352055 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7f9e46-e037-452b-97cb-759dc547e02d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:47.414800 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:35:47.429443 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7f9e46-e037-452b-97cb-759dc547e02d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:47.430923 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7f9e46-e037-452b-97cb-759dc547e02d None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:47.543695 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 619/1255] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Aug 29 22:35:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 22:35:47.549642 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f7bbf2-59d4-4682-b5e1-822cebdeeaa2 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:47.658281 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f7bbf2-59d4-4682-b5e1-822cebdeeaa2 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:47.673218 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:35:47.695392 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5579ff-87d6-4d04-8045-396319645058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:47.696036 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5579ff-87d6-4d04-8045-396319645058 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:47.696317 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5579ff-87d6-4d04-8045-396319645058 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:47.696591 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5579ff-87d6-4d04-8045-396319645058 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:47.708121 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5579ff-87d6-4d04-8045-396319645058 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:47.709635 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5579ff-87d6-4d04-8045-396319645058 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:47.726056 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-fd5579ff-87d6-4d04-8045-396319645058 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:35:47.726056 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:35:47.726056 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:35:47.726056 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:35:47.726056 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:35:47.726056 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:35:47.726056 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:35:47.726056 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:35:47.726056 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:35:47.726056 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:35:47.726056 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:35:47.726056 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:35:47.726056 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:35:47.726056 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:35:47.726056 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:35:47.726056 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:35:47.727251 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:35:47.727251 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:35:47.727251 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:35:47.727251 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:35:47.727251 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:35:47.727251 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:35:47.727251 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:35:47.727251 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:35:47.727251 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:35:47.727251 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:35:47.727251 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:35:47.727251 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:35:47.727251 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:35:47.727251 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:35:47.727251 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:35:47.727251 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:35:47.727251 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:35:47.728325 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:35:47.728325 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:35:47.728325 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:35:47.729787 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 637/1256] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:35:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:35:47.734008 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7f9e46-e037-452b-97cb-759dc547e02d None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:47.829825 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:35:47.842938 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7f9e46-e037-452b-97cb-759dc547e02d None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:47.877787 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4474a5-9988-47aa-af88-c2066ed8dda2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:47.878395 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4474a5-9988-47aa-af88-c2066ed8dda2 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:47.878672 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4474a5-9988-47aa-af88-c2066ed8dda2 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:47.878938 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4474a5-9988-47aa-af88-c2066ed8dda2 None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:47.879579 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4474a5-9988-47aa-af88-c2066ed8dda2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:35:47.879875 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4474a5-9988-47aa-af88-c2066ed8dda2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:47.881227 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4474a5-9988-47aa-af88-c2066ed8dda2 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:47.893206 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 620/1257] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:35:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:35:47.899052 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5579ff-87d6-4d04-8045-396319645058 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:48.007676 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5579ff-87d6-4d04-8045-396319645058 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:48.043644 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9e217f-f535-4929-a013-1792c67411fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:48.044526 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e217f-f535-4929-a013-1792c67411fc None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:48.044806 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e217f-f535-4929-a013-1792c67411fc None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:48.045082 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e217f-f535-4929-a013-1792c67411fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:48.052085 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9e217f-f535-4929-a013-1792c67411fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:48.053556 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9e217f-f535-4929-a013-1792c67411fc None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:48.065012 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-0c9e217f-f535-4929-a013-1792c67411fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:35:48.065012 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:35:48.065012 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:35:48.065012 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:35:48.065012 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:35:48.065012 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:35:48.065012 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:35:48.065012 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:35:48.065012 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:35:48.065012 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:35:48.065012 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:35:48.065012 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:35:48.065012 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:35:48.065012 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:35:48.065012 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:35:48.066166 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:35:48.066166 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:35:48.066166 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:35:48.066166 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:35:48.066166 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:35:48.066166 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:35:48.066166 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:35:48.066166 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:35:48.066166 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:35:48.066166 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:35:48.066166 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:35:48.066166 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:35:48.066166 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:35:48.066166 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:35:48.066166 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:35:48.066166 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:35:48.066166 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:35:48.067420 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:35:48.067420 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:35:48.067420 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:35:48.067420 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:35:48.067420 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:35:48.067420 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:35:48.067420 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:35:48.067420 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:35:48.067420 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 638/1258] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Aug 29 22:35:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:35:48.072509 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4474a5-9988-47aa-af88-c2066ed8dda2 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:48.183497 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4474a5-9988-47aa-af88-c2066ed8dda2 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:48.216935 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ff75f-95e8-4223-af9b-7dfb78086fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:48.217566 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ff75f-95e8-4223-af9b-7dfb78086fc7 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:48.217849 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ff75f-95e8-4223-af9b-7dfb78086fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:48.218125 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ff75f-95e8-4223-af9b-7dfb78086fc7 None admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:48.218813 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ff75f-95e8-4223-af9b-7dfb78086fc7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:35:48.219119 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ff75f-95e8-4223-af9b-7dfb78086fc7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:48.220541 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ff75f-95e8-4223-af9b-7dfb78086fc7 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:48.232232 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 621/1259] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Aug 29 22:35:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:35:48.238320 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9e217f-f535-4929-a013-1792c67411fc None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:48.263935 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:35:48.339432 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9e217f-f535-4929-a013-1792c67411fc None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:48.372648 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849efbdd-f8f2-4975-88ab-30128e5a8541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:48.373236 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849efbdd-f8f2-4975-88ab-30128e5a8541 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:48.373540 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849efbdd-f8f2-4975-88ab-30128e5a8541 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:48.373810 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849efbdd-f8f2-4975-88ab-30128e5a8541 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:48.374533 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849efbdd-f8f2-4975-88ab-30128e5a8541 None admin] RBAC: Adding query filter params (role.id=d00eabaec96a4956aaec2c37a5819c25, scope.project.id=ce09f0beb1a342febbb4a8b3c7cf60c2, user.id=296cbef772104e078971ba93aa2e022c) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:35:48.374837 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849efbdd-f8f2-4975-88ab-30128e5a8541 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:48.376269 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849efbdd-f8f2-4975-88ab-30128e5a8541 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:48.381561 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 639/1260] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Aug 29 22:35:48 2022] GET /identity/v3/role_assignments?user.id=296cbef772104e078971ba93aa2e022c&scope.project.id=ce09f0beb1a342febbb4a8b3c7cf60c2&role.id=d00eabaec96a4956aaec2c37a5819c25 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:35:50.302010 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b081889b-9377-4319-8b00-67ed6f4e2a14 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:50.302563 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b081889b-9377-4319-8b00-67ed6f4e2a14 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:50.302563 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b081889b-9377-4319-8b00-67ed6f4e2a14 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:50.303904 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 622/1261] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:35:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:35:50.309488 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd1cb6-f70b-42e5-89af-5b0f77a56990 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:50.309892 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd1cb6-f70b-42e5-89af-5b0f77a56990 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:50.310032 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd1cb6-f70b-42e5-89af-5b0f77a56990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:50.331012 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-d6bd1cb6-f70b-42e5-89af-5b0f77a56990 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:35:50.332189 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-d6bd1cb6-f70b-42e5-89af-5b0f77a56990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:35:50.397198 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 640/1262] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:35:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:35:50.667172 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b081889b-9377-4319-8b00-67ed6f4e2a14 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:50.678197 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:35:50.770342 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b081889b-9377-4319-8b00-67ed6f4e2a14 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:50.803519 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2677bf1b-2b8a-4585-9191-deb932f1d421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:50.804136 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677bf1b-2b8a-4585-9191-deb932f1d421 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:50.804412 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677bf1b-2b8a-4585-9191-deb932f1d421 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:50.804681 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677bf1b-2b8a-4585-9191-deb932f1d421 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:50.815286 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2677bf1b-2b8a-4585-9191-deb932f1d421 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:35:50.820130 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-2677bf1b-2b8a-4585-9191-deb932f1d421 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:35:50.820130 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:35:50.820130 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:35:50.820130 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:35:50.820130 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:35:50.820130 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:35:50.820130 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:35:50.820130 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:35:50.820130 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:35:50.820130 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:35:50.820130 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:35:50.820130 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:35:50.820130 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:35:50.820130 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:35:50.820130 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:35:50.820130 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:35:50.821216 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:35:50.821216 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:35:50.821216 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:35:50.821216 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:35:50.821216 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:35:50.821216 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:35:50.821216 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:35:50.821216 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:35:50.821216 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:35:50.821216 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:35:50.821216 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:35:50.821216 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:35:50.821216 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:35:50.821216 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:35:50.821216 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:35:50.821216 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:35:50.822131 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:35:50.822131 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:35:50.822131 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:35:50.822131 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:35:50.822131 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:35:50.822131 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:35:50.822131 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:35:50.822131 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:35:50.822131 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:35:50.822131 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:35:50.822131 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:35:50.822131 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:35:50.822131 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 623/1263] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Aug 29 22:35:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:35:50.827823 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bd1cb6-f70b-42e5-89af-5b0f77a56990 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:50.846352 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:35:50.933067 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bd1cb6-f70b-42e5-89af-5b0f77a56990 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:50.967295 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ead59-08ef-454f-ae9f-a402833db53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:50.967892 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ead59-08ef-454f-ae9f-a402833db53c None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:50.968172 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ead59-08ef-454f-ae9f-a402833db53c None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:50.968449 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ead59-08ef-454f-ae9f-a402833db53c None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:50.969109 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1ead59-08ef-454f-ae9f-a402833db53c None admin] RBAC: Adding query filter params (name=admin) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:35:50.969443 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1ead59-08ef-454f-ae9f-a402833db53c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:50.970806 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1ead59-08ef-454f-ae9f-a402833db53c None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:50.978861 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 641/1264] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Aug 29 22:35:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:35:50.984745 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2677bf1b-2b8a-4585-9191-deb932f1d421 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:51.051517 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:35:51.090655 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2677bf1b-2b8a-4585-9191-deb932f1d421 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:51.131469 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05cb5ea-afe7-4a65-9532-0c32f85a5afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:51.132056 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05cb5ea-afe7-4a65-9532-0c32f85a5afa None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:51.132357 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05cb5ea-afe7-4a65-9532-0c32f85a5afa None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:51.132626 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05cb5ea-afe7-4a65-9532-0c32f85a5afa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:51.144225 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05cb5ea-afe7-4a65-9532-0c32f85a5afa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:51.145783 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05cb5ea-afe7-4a65-9532-0c32f85a5afa None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:51.160898 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-a05cb5ea-afe7-4a65-9532-0c32f85a5afa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:35:51.160898 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:35:51.160898 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:35:51.160898 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:35:51.160898 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:35:51.160898 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:35:51.160898 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:35:51.160898 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:35:51.160898 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:35:51.160898 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:35:51.160898 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:35:51.160898 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:35:51.160898 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:35:51.160898 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:35:51.160898 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:35:51.160898 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:35:51.162064 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:35:51.162064 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:35:51.162064 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:35:51.162064 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:35:51.162064 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:35:51.162064 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:35:51.162064 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:35:51.162064 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:35:51.162064 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:35:51.162064 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:35:51.162064 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:35:51.162064 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:35:51.162064 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:35:51.162064 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:35:51.162064 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:35:51.162064 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:35:51.162064 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:35:51.163115 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:35:51.163115 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:35:51.163115 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:35:51.163115 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 624/1265] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:35:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:35:51.168676 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ead59-08ef-454f-ae9f-a402833db53c None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:51.253562 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:35:51.272581 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ead59-08ef-454f-ae9f-a402833db53c None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:51.306984 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66fc39b-59b3-47b4-bbe2-5811a9f855d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:51.308268 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66fc39b-59b3-47b4-bbe2-5811a9f855d2 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:51.308545 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66fc39b-59b3-47b4-bbe2-5811a9f855d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:51.308989 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66fc39b-59b3-47b4-bbe2-5811a9f855d2 None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:51.309477 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66fc39b-59b3-47b4-bbe2-5811a9f855d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:35:51.309773 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66fc39b-59b3-47b4-bbe2-5811a9f855d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:51.311122 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66fc39b-59b3-47b4-bbe2-5811a9f855d2 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:51.322759 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 642/1266] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:35:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:35:51.329510 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05cb5ea-afe7-4a65-9532-0c32f85a5afa None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:51.429853 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05cb5ea-afe7-4a65-9532-0c32f85a5afa None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:51.449035 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:35:51.463348 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd122d46-29b3-45e4-9e34-77b1e60180e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:51.464619 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd122d46-29b3-45e4-9e34-77b1e60180e3 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:51.464897 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd122d46-29b3-45e4-9e34-77b1e60180e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:51.465173 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd122d46-29b3-45e4-9e34-77b1e60180e3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:51.472604 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd122d46-29b3-45e4-9e34-77b1e60180e3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:51.474066 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd122d46-29b3-45e4-9e34-77b1e60180e3 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:51.485975 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-cd122d46-29b3-45e4-9e34-77b1e60180e3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 22:35:51.485975 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:35:51.485975 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:35:51.485975 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:35:51.485975 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:35:51.485975 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:35:51.485975 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:35:51.485975 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:35:51.485975 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:35:51.485975 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:35:51.485975 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:35:51.485975 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:35:51.485975 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:35:51.485975 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:35:51.485975 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:35:51.485975 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:35:51.487089 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:35:51.487089 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:35:51.487089 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:35:51.487089 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:35:51.487089 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:35:51.487089 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:35:51.487089 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:35:51.487089 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:35:51.487089 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:35:51.487089 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:35:51.487089 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:35:51.487089 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:35:51.487089 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:35:51.487089 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:35:51.487089 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:35:51.487089 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:35:51.487089 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:35:51.487089 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:35:51.488411 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:35:51.488411 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:35:51.488411 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:35:51.488411 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:35:51.488411 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:35:51.488411 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:35:51.488411 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:35:51.488411 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:35:51.488411 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 22:35:51.488411 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:35:51.488411 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 625/1267] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:35:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:35:51.492862 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66fc39b-59b3-47b4-bbe2-5811a9f855d2 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:51.597294 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66fc39b-59b3-47b4-bbe2-5811a9f855d2 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:51.630419 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb00fad-8dd4-4982-a8c4-47ecebfda069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:51.631020 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb00fad-8dd4-4982-a8c4-47ecebfda069 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:51.631301 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb00fad-8dd4-4982-a8c4-47ecebfda069 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:51.631576 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb00fad-8dd4-4982-a8c4-47ecebfda069 None admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:51.632305 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb00fad-8dd4-4982-a8c4-47ecebfda069 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:35:51.632611 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb00fad-8dd4-4982-a8c4-47ecebfda069 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:51.634073 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb00fad-8dd4-4982-a8c4-47ecebfda069 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:51.642556 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:35:51.651742 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 643/1268] 10.222.0.47 () {56 vars in 1143 bytes} [Mon Aug 29 22:35:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:35:51.657636 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd122d46-29b3-45e4-9e34-77b1e60180e3 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:51.757517 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd122d46-29b3-45e4-9e34-77b1e60180e3 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:51.791435 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e271162-1f22-42fe-9c4a-34121f712e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:51.792103 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e271162-1f22-42fe-9c4a-34121f712e9a None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:51.792384 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e271162-1f22-42fe-9c4a-34121f712e9a None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:51.792663 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e271162-1f22-42fe-9c4a-34121f712e9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:51.803189 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e271162-1f22-42fe-9c4a-34121f712e9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:51.804635 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e271162-1f22-42fe-9c4a-34121f712e9a None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:51.818887 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-9e271162-1f22-42fe-9c4a-34121f712e9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:35:51.818887 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:35:51.818887 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:35:51.818887 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:35:51.818887 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:35:51.818887 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:35:51.818887 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:35:51.818887 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:35:51.818887 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:35:51.818887 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:35:51.818887 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:35:51.818887 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:35:51.818887 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:35:51.818887 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:35:51.818887 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:35:51.818887 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:35:51.820083 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:35:51.820083 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:35:51.820083 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:35:51.820083 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:35:51.820083 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:35:51.820083 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:35:51.820083 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:35:51.820083 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:35:51.820083 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:35:51.820083 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:35:51.820083 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:35:51.820083 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:35:51.820083 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:35:51.820083 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:35:51.820083 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:35:51.820083 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:35:51.820083 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:35:51.821282 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:35:51.821282 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:35:51.821282 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:35:51.821282 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 626/1269] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:35:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:35:51.826582 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb00fad-8dd4-4982-a8c4-47ecebfda069 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:51.924943 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb00fad-8dd4-4982-a8c4-47ecebfda069 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:51.958366 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c445889a-7b60-4386-a491-bc3055644acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:51.958964 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c445889a-7b60-4386-a491-bc3055644acc None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:51.959245 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c445889a-7b60-4386-a491-bc3055644acc None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:51.959526 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c445889a-7b60-4386-a491-bc3055644acc None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:51.960161 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c445889a-7b60-4386-a491-bc3055644acc None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:35:51.960462 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c445889a-7b60-4386-a491-bc3055644acc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:51.961874 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c445889a-7b60-4386-a491-bc3055644acc None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:51.973696 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 644/1270] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:35:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:35:51.979564 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e271162-1f22-42fe-9c4a-34121f712e9a None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:52.011676 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:35:52.086188 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e271162-1f22-42fe-9c4a-34121f712e9a None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:52.120981 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5120dd57-9338-43c7-b77c-dd9b802ee349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:52.121631 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5120dd57-9338-43c7-b77c-dd9b802ee349 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:52.121906 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5120dd57-9338-43c7-b77c-dd9b802ee349 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:52.122174 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5120dd57-9338-43c7-b77c-dd9b802ee349 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:52.128674 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5120dd57-9338-43c7-b77c-dd9b802ee349 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:52.130131 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5120dd57-9338-43c7-b77c-dd9b802ee349 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:52.141747 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-5120dd57-9338-43c7-b77c-dd9b802ee349 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:35:52.141747 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:35:52.141747 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:35:52.141747 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:35:52.141747 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:35:52.141747 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:35:52.141747 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:35:52.141747 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:35:52.141747 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:35:52.141747 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:35:52.141747 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:35:52.141747 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:35:52.141747 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:35:52.141747 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:35:52.141747 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:35:52.142814 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:35:52.142814 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:35:52.142814 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:35:52.142814 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:35:52.142814 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:35:52.142814 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:35:52.142814 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:35:52.142814 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:35:52.142814 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:35:52.142814 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:35:52.142814 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:35:52.142814 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:35:52.142814 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:35:52.142814 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:35:52.142814 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:35:52.142814 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:35:52.142814 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:35:52.144442 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:35:52.144442 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:35:52.144442 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:35:52.144442 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:35:52.144442 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:35:52.144442 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:35:52.144442 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:35:52.144442 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:35:52.144442 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 627/1271] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Aug 29 22:35:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:35:52.148744 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c445889a-7b60-4386-a491-bc3055644acc None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:52.208351 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:35:52.250243 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c445889a-7b60-4386-a491-bc3055644acc None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:52.283508 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65623fbc-bbe0-42fe-8c31-2ac6bef0330e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:52.284105 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65623fbc-bbe0-42fe-8c31-2ac6bef0330e None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:52.284384 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65623fbc-bbe0-42fe-8c31-2ac6bef0330e None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:52.284652 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65623fbc-bbe0-42fe-8c31-2ac6bef0330e None admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:52.285356 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65623fbc-bbe0-42fe-8c31-2ac6bef0330e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:35:52.285665 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65623fbc-bbe0-42fe-8c31-2ac6bef0330e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:52.287083 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65623fbc-bbe0-42fe-8c31-2ac6bef0330e None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:52.299360 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 645/1272] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Aug 29 22:35:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:35:52.305378 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5120dd57-9338-43c7-b77c-dd9b802ee349 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:52.396154 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:35:52.405006 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5120dd57-9338-43c7-b77c-dd9b802ee349 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:52.438611 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a146b1e-f04c-4c48-a68c-d26b37ad926e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:52.439253 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a146b1e-f04c-4c48-a68c-d26b37ad926e None admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:52.439530 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a146b1e-f04c-4c48-a68c-d26b37ad926e None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:52.439801 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a146b1e-f04c-4c48-a68c-d26b37ad926e None admin] PATH_INFO: `/v3/projects/ce09f0beb1a342febbb4a8b3c7cf60c2/users/296cbef772104e078971ba93aa2e022c/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:52.441658 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a146b1e-f04c-4c48-a68c-d26b37ad926e None admin] RBAC: Authorizing `identity:create_grant(project_id=ce09f0beb1a342febbb4a8b3c7cf60c2, user_id=296cbef772104e078971ba93aa2e022c, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:52.443071 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a146b1e-f04c-4c48-a68c-d26b37ad926e None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:52.456330 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 628/1273] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Aug 29 22:35:52 2022] PUT /identity/v3/projects/ce09f0beb1a342febbb4a8b3c7cf60c2/users/296cbef772104e078971ba93aa2e022c/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:35:54.382536 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f11f6fc-bc6f-41e4-88c6-6b1abf050942 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:54.383091 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f11f6fc-bc6f-41e4-88c6-6b1abf050942 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:54.383091 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f11f6fc-bc6f-41e4-88c6-6b1abf050942 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:54.384405 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 646/1274] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:35:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:35:54.391689 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0313d3-98aa-4492-8205-e36f63bec15d None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:54.392199 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0313d3-98aa-4492-8205-e36f63bec15d None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:54.392299 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0313d3-98aa-4492-8205-e36f63bec15d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:54.410969 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-aa0313d3-98aa-4492-8205-e36f63bec15d None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:35:54.412184 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-aa0313d3-98aa-4492-8205-e36f63bec15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:35:54.486278 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 629/1275] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:35:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:35:54.782926 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f11f6fc-bc6f-41e4-88c6-6b1abf050942 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:54.887915 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f11f6fc-bc6f-41e4-88c6-6b1abf050942 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:54.904908 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:35:54.930859 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e983488a-56cd-4918-a2fb-4d54b727cebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:54.931473 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e983488a-56cd-4918-a2fb-4d54b727cebc None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:54.931744 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e983488a-56cd-4918-a2fb-4d54b727cebc None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:54.932006 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e983488a-56cd-4918-a2fb-4d54b727cebc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:54.942924 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e983488a-56cd-4918-a2fb-4d54b727cebc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 22:35:54.947844 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-e983488a-56cd-4918-a2fb-4d54b727cebc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:35:54.947844 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:35:54.947844 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:35:54.947844 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:35:54.947844 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:35:54.947844 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:35:54.947844 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:35:54.947844 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:35:54.947844 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:35:54.947844 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:35:54.947844 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:35:54.947844 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:35:54.947844 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 22:35:54.947844 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 22:35:54.947844 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 22:35:54.947844 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 22:35:54.949018 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 22:35:54.949018 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 22:35:54.949018 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 22:35:54.949018 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 22:35:54.949018 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:35:54.949018 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:35:54.949018 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:35:54.949018 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:35:54.949018 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:35:54.949018 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:35:54.949018 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:35:54.949018 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:35:54.949018 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:35:54.949018 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:35:54.949018 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:35:54.949018 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:35:54.949917 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:35:54.949917 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:35:54.949917 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:35:54.949917 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:35:54.949917 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 22:35:54.949917 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 22:35:54.949917 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 22:35:54.949917 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 22:35:54.949917 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 22:35:54.949917 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 22:35:54.949917 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 22:35:54.949917 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:35:54.949917 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 647/1276] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Aug 29 22:35:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:35:54.956118 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0313d3-98aa-4492-8205-e36f63bec15d None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:55.036648 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:35:55.055486 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0313d3-98aa-4492-8205-e36f63bec15d None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:55.094041 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac3300-584c-4d74-88f8-a6c7de90219c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:55.094736 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac3300-584c-4d74-88f8-a6c7de90219c None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:55.095089 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac3300-584c-4d74-88f8-a6c7de90219c None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:55.095378 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac3300-584c-4d74-88f8-a6c7de90219c None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:55.096226 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ac3300-584c-4d74-88f8-a6c7de90219c None admin] RBAC: Adding query filter params (name=admin) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:35:55.096600 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ac3300-584c-4d74-88f8-a6c7de90219c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:55.098244 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ac3300-584c-4d74-88f8-a6c7de90219c None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:55.108804 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 630/1277] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Aug 29 22:35:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:35:55.115652 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e983488a-56cd-4918-a2fb-4d54b727cebc None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:55.218018 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e983488a-56cd-4918-a2fb-4d54b727cebc None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:55.251682 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e0b81-9506-4f84-9ce6-6de2063e2da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:55.252308 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e0b81-9506-4f84-9ce6-6de2063e2da8 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:55.252589 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e0b81-9506-4f84-9ce6-6de2063e2da8 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:55.252863 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e0b81-9506-4f84-9ce6-6de2063e2da8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:55.262923 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316e0b81-9506-4f84-9ce6-6de2063e2da8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:55.264368 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316e0b81-9506-4f84-9ce6-6de2063e2da8 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:55.279548 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-316e0b81-9506-4f84-9ce6-6de2063e2da8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:35:55.279548 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:35:55.279548 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:35:55.279548 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:35:55.279548 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:35:55.279548 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:35:55.279548 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:35:55.279548 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:35:55.279548 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:35:55.279548 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:35:55.279548 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:35:55.279548 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:35:55.279548 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:35:55.279548 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:35:55.279548 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:35:55.279548 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:35:55.280772 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:35:55.280772 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:35:55.280772 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:35:55.280772 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:35:55.280772 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:35:55.280772 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:35:55.280772 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:35:55.280772 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:35:55.280772 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:35:55.280772 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:35:55.280772 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:35:55.280772 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:35:55.280772 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:35:55.280772 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:35:55.280772 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:35:55.280772 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:35:55.280772 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:35:55.281912 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:35:55.281912 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:35:55.281912 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:35:55.281912 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 648/1278] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:35:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 22:35:55.286567 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac3300-584c-4d74-88f8-a6c7de90219c None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:55.386428 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac3300-584c-4d74-88f8-a6c7de90219c None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:55.420421 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f8c0b1-11c8-4c06-a93f-4a02eb859d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:55.421039 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8c0b1-11c8-4c06-a93f-4a02eb859d28 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:55.421289 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8c0b1-11c8-4c06-a93f-4a02eb859d28 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:55.421591 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8c0b1-11c8-4c06-a93f-4a02eb859d28 None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:55.422227 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f8c0b1-11c8-4c06-a93f-4a02eb859d28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:35:55.422527 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f8c0b1-11c8-4c06-a93f-4a02eb859d28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:55.423887 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f8c0b1-11c8-4c06-a93f-4a02eb859d28 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:55.435336 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 631/1279] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:35:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:35:55.441022 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e0b81-9506-4f84-9ce6-6de2063e2da8 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:55.471854 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:35:55.541116 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e0b81-9506-4f84-9ce6-6de2063e2da8 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:55.574737 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88922214-37e8-4a30-9fd9-3b29bc51545f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:55.575358 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88922214-37e8-4a30-9fd9-3b29bc51545f None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:55.575638 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88922214-37e8-4a30-9fd9-3b29bc51545f None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:55.575907 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88922214-37e8-4a30-9fd9-3b29bc51545f None admin] PATH_INFO: `/v3/users/placement` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:55.583202 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88922214-37e8-4a30-9fd9-3b29bc51545f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:55.584659 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88922214-37e8-4a30-9fd9-3b29bc51545f None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:55.596368 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-88922214-37e8-4a30-9fd9-3b29bc51545f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 22:35:55.596368 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:35:55.596368 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:35:55.596368 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:35:55.596368 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:35:55.596368 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:35:55.596368 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:35:55.596368 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:35:55.596368 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:35:55.596368 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:35:55.596368 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:35:55.596368 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:35:55.596368 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 22:35:55.596368 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 22:35:55.596368 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 22:35:55.596368 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 22:35:55.597560 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:35:55.597560 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:35:55.597560 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 22:35:55.597560 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:35:55.597560 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 22:35:55.597560 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 22:35:55.597560 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:35:55.597560 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:35:55.597560 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:35:55.597560 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:35:55.597560 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:35:55.597560 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:35:55.597560 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:35:55.597560 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:35:55.597560 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:35:55.597560 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:35:55.597560 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:35:55.597560 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:35:55.598922 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:35:55.598922 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:35:55.598922 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 22:35:55.598922 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 22:35:55.598922 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 22:35:55.598922 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 22:35:55.598922 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 22:35:55.598922 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 22:35:55.598922 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 22:35:55.598922 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:35:55.598922 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 649/1280] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:35:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:35:55.603317 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f8c0b1-11c8-4c06-a93f-4a02eb859d28 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:55.607250 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:35:55.702536 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f8c0b1-11c8-4c06-a93f-4a02eb859d28 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:55.735818 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d045c6fd-1a26-4482-8aa7-b1c7a23e39e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:55.736417 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045c6fd-1a26-4482-8aa7-b1c7a23e39e5 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:55.736696 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045c6fd-1a26-4482-8aa7-b1c7a23e39e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:55.736966 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045c6fd-1a26-4482-8aa7-b1c7a23e39e5 None admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:55.737720 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d045c6fd-1a26-4482-8aa7-b1c7a23e39e5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:35:55.738019 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d045c6fd-1a26-4482-8aa7-b1c7a23e39e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:55.739434 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d045c6fd-1a26-4482-8aa7-b1c7a23e39e5 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:55.755984 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 632/1281] 10.222.0.47 () {56 vars in 1143 bytes} [Mon Aug 29 22:35:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:35:55.762347 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88922214-37e8-4a30-9fd9-3b29bc51545f None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:55.853518 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:35:55.863420 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88922214-37e8-4a30-9fd9-3b29bc51545f None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:55.896702 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b58c65-e055-4041-9cb2-8e88856edd25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:55.897288 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b58c65-e055-4041-9cb2-8e88856edd25 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:55.897592 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b58c65-e055-4041-9cb2-8e88856edd25 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:55.897858 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b58c65-e055-4041-9cb2-8e88856edd25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:55.964651 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b58c65-e055-4041-9cb2-8e88856edd25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:55.966106 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b58c65-e055-4041-9cb2-8e88856edd25 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:56.054318 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:35:56.066770 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 650/1282] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Aug 29 22:35:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 22:35:56.072638 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d045c6fd-1a26-4482-8aa7-b1c7a23e39e5 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:56.132819 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:35:56.171957 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d045c6fd-1a26-4482-8aa7-b1c7a23e39e5 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:56.205945 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c33b95b-670f-4674-bcef-a35902407aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:56.206563 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c33b95b-670f-4674-bcef-a35902407aa0 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:56.206840 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c33b95b-670f-4674-bcef-a35902407aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:56.207109 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c33b95b-670f-4674-bcef-a35902407aa0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:56.217193 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c33b95b-670f-4674-bcef-a35902407aa0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:56.218653 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c33b95b-670f-4674-bcef-a35902407aa0 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:56.234113 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-5c33b95b-670f-4674-bcef-a35902407aa0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:35:56.234113 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:35:56.234113 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:35:56.234113 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:35:56.234113 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:35:56.234113 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:35:56.234113 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:35:56.234113 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:35:56.234113 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:35:56.234113 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:35:56.234113 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:35:56.234113 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:35:56.234113 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 22:35:56.234113 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 22:35:56.234113 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 22:35:56.234113 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 22:35:56.235244 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:35:56.235244 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:35:56.235244 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:35:56.235244 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:35:56.235244 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:35:56.235244 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:35:56.235244 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:35:56.235244 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:35:56.235244 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:35:56.235244 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:35:56.235244 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:35:56.235244 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:35:56.235244 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:35:56.235244 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:35:56.235244 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:35:56.235244 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:35:56.235244 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 22:35:56.236493 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 22:35:56.236493 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 22:35:56.236493 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:35:56.236493 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 633/1283] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:35:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:35:56.240906 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b58c65-e055-4041-9cb2-8e88856edd25 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:56.355422 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b58c65-e055-4041-9cb2-8e88856edd25 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:56.389288 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1e104d-bf67-4e9d-bd37-0110152d60f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:56.389845 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e104d-bf67-4e9d-bd37-0110152d60f7 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:56.390119 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e104d-bf67-4e9d-bd37-0110152d60f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:56.390383 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e104d-bf67-4e9d-bd37-0110152d60f7 None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:56.391006 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1e104d-bf67-4e9d-bd37-0110152d60f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:35:56.391298 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1e104d-bf67-4e9d-bd37-0110152d60f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:56.392651 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1e104d-bf67-4e9d-bd37-0110152d60f7 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:56.403805 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 651/1284] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Aug 29 22:35:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:35:56.409664 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c33b95b-670f-4674-bcef-a35902407aa0 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:56.508638 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c33b95b-670f-4674-bcef-a35902407aa0 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:56.521835 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:35:56.541883 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0899e40c-493c-480f-aab8-30f6971f32a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:56.543132 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899e40c-493c-480f-aab8-30f6971f32a8 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:56.543489 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899e40c-493c-480f-aab8-30f6971f32a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:56.543775 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899e40c-493c-480f-aab8-30f6971f32a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:56.550422 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0899e40c-493c-480f-aab8-30f6971f32a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:56.551853 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0899e40c-493c-480f-aab8-30f6971f32a8 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:56.563634 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-0899e40c-493c-480f-aab8-30f6971f32a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:35:56.563634 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:35:56.563634 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:35:56.563634 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:35:56.563634 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:35:56.563634 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:35:56.563634 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:35:56.563634 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:35:56.563634 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:35:56.563634 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:35:56.563634 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:35:56.563634 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:35:56.563634 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 22:35:56.563634 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 22:35:56.563634 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 22:35:56.564679 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 22:35:56.564679 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:35:56.564679 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:35:56.564679 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:35:56.564679 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:35:56.564679 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:35:56.564679 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:35:56.564679 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:35:56.564679 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Aug 29 22:35:56.564679 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:35:56.564679 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:35:56.564679 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:35:56.564679 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:35:56.564679 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:35:56.564679 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:35:56.564679 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:35:56.564679 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:35:56.566056 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 22:35:56.566056 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 22:35:56.566056 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 22:35:56.566056 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 22:35:56.566056 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 22:35:56.566056 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 22:35:56.566056 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 22:35:56.566056 dv-cinder-854270-4-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Aug 29 22:35:56.566056 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 634/1285] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Aug 29 22:35:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:35:56.570606 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1e104d-bf67-4e9d-bd37-0110152d60f7 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:56.622802 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:35:56.673714 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1e104d-bf67-4e9d-bd37-0110152d60f7 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:56.706023 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bcc385-f9db-46ae-881d-899f0e946cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:56.706613 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcc385-f9db-46ae-881d-899f0e946cb1 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:56.706885 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcc385-f9db-46ae-881d-899f0e946cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:56.707151 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcc385-f9db-46ae-881d-899f0e946cb1 None admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:56.707829 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bcc385-f9db-46ae-881d-899f0e946cb1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:35:56.708126 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bcc385-f9db-46ae-881d-899f0e946cb1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:56.709571 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bcc385-f9db-46ae-881d-899f0e946cb1 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:56.721799 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 652/1286] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Aug 29 22:35:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:35:56.727859 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0899e40c-493c-480f-aab8-30f6971f32a8 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:56.826359 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0899e40c-493c-480f-aab8-30f6971f32a8 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:56.860365 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f86efc9-5441-4b3f-9927-006feb91cf24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:56.860969 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f86efc9-5441-4b3f-9927-006feb91cf24 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:56.861246 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f86efc9-5441-4b3f-9927-006feb91cf24 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:56.861551 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f86efc9-5441-4b3f-9927-006feb91cf24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:56.862262 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f86efc9-5441-4b3f-9927-006feb91cf24 None admin] RBAC: Adding query filter params (role.id=d00eabaec96a4956aaec2c37a5819c25, scope.project.id=ce09f0beb1a342febbb4a8b3c7cf60c2, user.id=296cbef772104e078971ba93aa2e022c) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:35:56.862567 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f86efc9-5441-4b3f-9927-006feb91cf24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:56.863981 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f86efc9-5441-4b3f-9927-006feb91cf24 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:56.869703 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 635/1287] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Aug 29 22:35:56 2022] GET /identity/v3/role_assignments?user.id=296cbef772104e078971ba93aa2e022c&scope.project.id=ce09f0beb1a342febbb4a8b3c7cf60c2&role.id=d00eabaec96a4956aaec2c37a5819c25 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:35:58.783885 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ba83b-2603-4890-b6e2-27baa2bd324c None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:58.784440 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ba83b-2603-4890-b6e2-27baa2bd324c None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:58.784440 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ba83b-2603-4890-b6e2-27baa2bd324c None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:58.785778 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 653/1288] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:35:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:35:58.791034 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b266295-1257-4677-9e02-51651ec8f11c None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:58.791441 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b266295-1257-4677-9e02-51651ec8f11c None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:58.791586 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b266295-1257-4677-9e02-51651ec8f11c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:58.810617 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-9b266295-1257-4677-9e02-51651ec8f11c None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:35:58.811808 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-9b266295-1257-4677-9e02-51651ec8f11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:35:58.841050 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:35:58.879150 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 636/1289] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:35:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:35:59.158208 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844ba83b-2603-4890-b6e2-27baa2bd324c None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:59.258734 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844ba83b-2603-4890-b6e2-27baa2bd324c None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:59.271427 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:35:59.296287 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e65991-0c68-446c-8134-75ed14513303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:59.296912 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e65991-0c68-446c-8134-75ed14513303 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:59.297192 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e65991-0c68-446c-8134-75ed14513303 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:59.297499 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e65991-0c68-446c-8134-75ed14513303 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:59.298082 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e65991-0c68-446c-8134-75ed14513303 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:59.299447 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e65991-0c68-446c-8134-75ed14513303 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:59.311008 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-e5e65991-0c68-446c-8134-75ed14513303 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 22:35:59.311008 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:35:59.311008 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:35:59.311008 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:35:59.311008 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:35:59.311008 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:35:59.311008 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:35:59.311008 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:35:59.311008 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 22:35:59.311008 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:35:59.311008 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:35:59.311008 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:35:59.311008 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:35:59.311008 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:35:59.311008 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:35:59.311008 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:35:59.311008 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:35:59.312231 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:35:59.312231 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:35:59.312231 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:35:59.312231 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:35:59.312231 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:35:59.312231 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:35:59.312231 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:35:59.312231 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:35:59.312231 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:35:59.312231 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:35:59.312231 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:35:59.312231 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:35:59.312231 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:35:59.312231 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:35:59.312231 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:35:59.312231 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:35:59.313105 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:35:59.313105 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:35:59.313105 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:35:59.313105 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:35:59.313105 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:35:59.313105 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:35:59.313105 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:35:59.313105 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:35:59.313105 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:35:59.313105 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:35:59.313105 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:35:59.313105 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:35:59.313105 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 22:35:59.313105 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:35:59.313105 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 654/1290] 10.222.0.47 () {56 vars in 1117 bytes} [Mon Aug 29 22:35:59 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:35:59.318088 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b266295-1257-4677-9e02-51651ec8f11c None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:59.417234 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b266295-1257-4677-9e02-51651ec8f11c None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:59.450667 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146a00d7-7b75-44fc-b666-7c473dacc02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:59.451270 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a00d7-7b75-44fc-b666-7c473dacc02d None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:59.451552 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a00d7-7b75-44fc-b666-7c473dacc02d None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:59.451828 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a00d7-7b75-44fc-b666-7c473dacc02d None admin] PATH_INFO: `/v3/services` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:59.452453 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146a00d7-7b75-44fc-b666-7c473dacc02d None admin] RBAC: Adding query filter params (name=placement) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:35:59.452755 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146a00d7-7b75-44fc-b666-7c473dacc02d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:59.454157 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146a00d7-7b75-44fc-b666-7c473dacc02d None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:59.458891 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 637/1291] 10.222.0.47 () {56 vars in 1116 bytes} [Mon Aug 29 22:35:59 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:35:59.465712 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e65991-0c68-446c-8134-75ed14513303 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:35:59.565171 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e65991-0c68-446c-8134-75ed14513303 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:35:59.599602 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c9968-b99d-4bec-bc11-30b6be4bd71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:35:59.600197 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c9968-b99d-4bec-bc11-30b6be4bd71c None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:35:59.600476 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c9968-b99d-4bec-bc11-30b6be4bd71c None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:35:59.600748 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c9968-b99d-4bec-bc11-30b6be4bd71c None admin] PATH_INFO: `/v3/services` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:35:59.601400 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0c9968-b99d-4bec-bc11-30b6be4bd71c None admin] RBAC: Adding query filter params (type=placement) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:35:59.601704 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0c9968-b99d-4bec-bc11-30b6be4bd71c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:35:59.603060 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0c9968-b99d-4bec-bc11-30b6be4bd71c None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:35:59.607422 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 655/1292] 10.222.0.47 () {56 vars in 1116 bytes} [Mon Aug 29 22:35:59 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:36:01.522488 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9251f58d-6367-42a1-b03b-b9eac8c38805 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:36:01.523045 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9251f58d-6367-42a1-b03b-b9eac8c38805 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:36:01.523045 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9251f58d-6367-42a1-b03b-b9eac8c38805 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:36:01.524377 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 638/1293] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:36:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:36:01.529724 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad386a1b-2899-48c6-a924-1eafd9f88abb None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:36:01.530173 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad386a1b-2899-48c6-a924-1eafd9f88abb None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:36:01.530274 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad386a1b-2899-48c6-a924-1eafd9f88abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:36:01.550108 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-ad386a1b-2899-48c6-a924-1eafd9f88abb None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:36:01.551322 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-ad386a1b-2899-48c6-a924-1eafd9f88abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:36:01.585250 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:36:01.624150 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 656/1294] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:36:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:36:01.895952 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9251f58d-6367-42a1-b03b-b9eac8c38805 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:36:01.928896 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:36:02.009478 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9251f58d-6367-42a1-b03b-b9eac8c38805 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:36:02.044351 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c853f-9c30-4434-8cff-42f3c36b933b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:36:02.044956 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c853f-9c30-4434-8cff-42f3c36b933b None admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:36:02.045240 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c853f-9c30-4434-8cff-42f3c36b933b None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:36:02.045546 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c853f-9c30-4434-8cff-42f3c36b933b None admin] PATH_INFO: `/v3/services` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:36:02.046194 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092c853f-9c30-4434-8cff-42f3c36b933b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:36:02.047549 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092c853f-9c30-4434-8cff-42f3c36b933b None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:36:02.062255 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 639/1295] 10.222.0.47 () {60 vars in 1141 bytes} [Mon Aug 29 22:36:01 2022] POST /identity/v3/services => generated 246 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:36:03.996832 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac60d42-f834-4be6-a18d-99351b6d6fec None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:36:03.997521 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac60d42-f834-4be6-a18d-99351b6d6fec None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:36:03.997668 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac60d42-f834-4be6-a18d-99351b6d6fec None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:36:03.999110 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 657/1296] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:36:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:36:04.004649 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df35b2-d541-4641-b3a5-2ba562b12126 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:36:04.005094 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df35b2-d541-4641-b3a5-2ba562b12126 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:36:04.005185 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df35b2-d541-4641-b3a5-2ba562b12126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:36:04.024886 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-c9df35b2-d541-4641-b3a5-2ba562b12126 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:36:04.026162 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-c9df35b2-d541-4641-b3a5-2ba562b12126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:36:04.106388 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 640/1297] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:36:04 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:36:04.380157 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac60d42-f834-4be6-a18d-99351b6d6fec None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:36:04.481167 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac60d42-f834-4be6-a18d-99351b6d6fec None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:36:04.515291 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029f0d29-eb65-498d-b6a5-3f5c42e53929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:36:04.515911 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f0d29-eb65-498d-b6a5-3f5c42e53929 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:36:04.516191 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f0d29-eb65-498d-b6a5-3f5c42e53929 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:36:04.516463 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f0d29-eb65-498d-b6a5-3f5c42e53929 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:36:04.517040 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029f0d29-eb65-498d-b6a5-3f5c42e53929 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:36:04.518459 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029f0d29-eb65-498d-b6a5-3f5c42e53929 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:36:04.528620 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-029f0d29-eb65-498d-b6a5-3f5c42e53929 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 22:36:04.528620 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:36:04.528620 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:36:04.528620 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:36:04.528620 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:36:04.528620 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:36:04.528620 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:36:04.528620 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:36:04.528620 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 22:36:04.528620 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:36:04.528620 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:36:04.528620 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:36:04.528620 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:36:04.528620 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:36:04.528620 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:36:04.528620 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:36:04.528620 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:36:04.529879 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:36:04.529879 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:36:04.529879 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:36:04.529879 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:36:04.529879 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:36:04.529879 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:36:04.529879 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:36:04.529879 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:36:04.529879 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:36:04.529879 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:36:04.529879 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:36:04.529879 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:36:04.529879 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:36:04.529879 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:36:04.529879 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:36:04.529879 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:36:04.530944 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:36:04.530944 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:36:04.530944 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:36:04.530944 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:36:04.530944 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:36:04.530944 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:36:04.530944 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:36:04.530944 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:36:04.530944 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:36:04.530944 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:36:04.530944 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:36:04.530944 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:36:04.530944 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 22:36:04.530944 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:36:04.533510 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 658/1298] 10.222.0.47 () {56 vars in 1117 bytes} [Mon Aug 29 22:36:04 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:36:04.535887 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9df35b2-d541-4641-b3a5-2ba562b12126 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:36:04.554884 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:36:04.636276 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9df35b2-d541-4641-b3a5-2ba562b12126 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:36:04.669872 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3108dd3a-3f8c-4f85-8957-a14e4b31d3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:36:04.670468 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3108dd3a-3f8c-4f85-8957-a14e4b31d3bd None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:36:04.670747 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3108dd3a-3f8c-4f85-8957-a14e4b31d3bd None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:36:04.671020 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3108dd3a-3f8c-4f85-8957-a14e4b31d3bd None admin] PATH_INFO: `/v3/services` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:36:04.671647 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3108dd3a-3f8c-4f85-8957-a14e4b31d3bd None admin] RBAC: Adding query filter params (name=placement) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:36:04.671948 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3108dd3a-3f8c-4f85-8957-a14e4b31d3bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:36:04.673311 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3108dd3a-3f8c-4f85-8957-a14e4b31d3bd None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:36:04.678395 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 641/1299] 10.222.0.47 () {56 vars in 1116 bytes} [Mon Aug 29 22:36:04 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:36:04.685101 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029f0d29-eb65-498d-b6a5-3f5c42e53929 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:36:04.718555 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:36:04.787900 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029f0d29-eb65-498d-b6a5-3f5c42e53929 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:36:04.821922 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220e00d6-8e5e-4e4e-9476-1327c473788f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:36:04.822518 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e00d6-8e5e-4e4e-9476-1327c473788f None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:36:04.822798 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e00d6-8e5e-4e4e-9476-1327c473788f None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:36:04.823068 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e00d6-8e5e-4e4e-9476-1327c473788f None admin] PATH_INFO: `/v3/endpoints` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:36:04.823762 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220e00d6-8e5e-4e4e-9476-1327c473788f None admin] RBAC: Adding query filter params (interface=public, service_id=c34f4ce1b6ae46af82e81fd526d4a93f, region_id=RegionOne) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:36:04.824194 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220e00d6-8e5e-4e4e-9476-1327c473788f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:36:04.825583 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220e00d6-8e5e-4e4e-9476-1327c473788f None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:36:04.830531 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 659/1300] 10.222.0.47 () {56 vars in 1251 bytes} [Mon Aug 29 22:36:04 2022] GET /identity/v3/endpoints?service_id=c34f4ce1b6ae46af82e81fd526d4a93f&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:36:04.836157 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3108dd3a-3f8c-4f85-8957-a14e4b31d3bd None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:36:04.918458 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:36:04.936892 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3108dd3a-3f8c-4f85-8957-a14e4b31d3bd None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:36:04.970884 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609a2c45-4f1a-4415-9217-8e79af9ee453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:36:04.971485 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a2c45-4f1a-4415-9217-8e79af9ee453 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:36:04.971762 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a2c45-4f1a-4415-9217-8e79af9ee453 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:36:04.972031 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a2c45-4f1a-4415-9217-8e79af9ee453 None admin] PATH_INFO: `/v3/services` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:36:04.972625 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609a2c45-4f1a-4415-9217-8e79af9ee453 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:36:04.974014 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609a2c45-4f1a-4415-9217-8e79af9ee453 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:36:04.981501 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 642/1301] 10.222.0.47 () {56 vars in 1087 bytes} [Mon Aug 29 22:36:04 2022] GET /identity/v3/services => generated 2191 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:36:06.926753 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e017c-1b78-49da-96c5-48ed6b5dc8fb None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:36:06.927311 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e017c-1b78-49da-96c5-48ed6b5dc8fb None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:36:06.927311 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e017c-1b78-49da-96c5-48ed6b5dc8fb None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:36:06.928619 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 660/1302] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:36:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:36:06.934363 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79fa1a2-e8bb-4ff9-8507-0a104911411b None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:36:06.934793 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79fa1a2-e8bb-4ff9-8507-0a104911411b None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:36:06.934886 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79fa1a2-e8bb-4ff9-8507-0a104911411b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:36:06.952631 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-d79fa1a2-e8bb-4ff9-8507-0a104911411b None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:36:06.953839 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-d79fa1a2-e8bb-4ff9-8507-0a104911411b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:36:07.019928 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 643/1303] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:36:06 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 22:36:07.290574 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e017c-1b78-49da-96c5-48ed6b5dc8fb None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:36:07.387822 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:36:07.397887 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e017c-1b78-49da-96c5-48ed6b5dc8fb None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:36:07.442233 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e0fcc-7ea6-44a3-ac7b-06ab35210204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:36:07.442853 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e0fcc-7ea6-44a3-ac7b-06ab35210204 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:36:07.443125 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e0fcc-7ea6-44a3-ac7b-06ab35210204 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:36:07.443390 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e0fcc-7ea6-44a3-ac7b-06ab35210204 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:36:07.443966 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67e0fcc-7ea6-44a3-ac7b-06ab35210204 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:36:07.445311 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67e0fcc-7ea6-44a3-ac7b-06ab35210204 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:36:07.453946 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-c67e0fcc-7ea6-44a3-ac7b-06ab35210204 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 22:36:07.453946 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:36:07.453946 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 22:36:07.453946 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 22:36:07.453946 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 22:36:07.453946 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 22:36:07.453946 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 22:36:07.453946 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:36:07.453946 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 22:36:07.453946 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:36:07.453946 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 22:36:07.453946 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:36:07.453946 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 22:36:07.453946 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 22:36:07.453946 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 22:36:07.453946 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 22:36:07.453946 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 22:36:07.455125 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 22:36:07.455125 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 22:36:07.455125 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 22:36:07.455125 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 22:36:07.455125 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 22:36:07.455125 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 22:36:07.455125 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 22:36:07.455125 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 22:36:07.455125 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 22:36:07.455125 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 22:36:07.455125 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 22:36:07.455125 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 22:36:07.455125 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 22:36:07.455125 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 22:36:07.455125 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 22:36:07.455125 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 22:36:07.456365 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 22:36:07.456365 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Aug 29 22:36:07.456365 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 22:36:07.456365 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Aug 29 22:36:07.456365 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 22:36:07.456365 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 22:36:07.456365 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 22:36:07.456365 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Aug 29 22:36:07.456365 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 22:36:07.456365 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Aug 29 22:36:07.456365 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 22:36:07.456365 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 22:36:07.456365 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 22:36:07.456365 dv-cinder-854270-4-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Aug 29 22:36:07.456365 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 661/1304] 10.222.0.47 () {56 vars in 1117 bytes} [Mon Aug 29 22:36:07 2022] GET /identity/v3/services/placement => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 22:36:07.461979 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79fa1a2-e8bb-4ff9-8507-0a104911411b None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:36:07.537738 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:36:07.560577 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79fa1a2-e8bb-4ff9-8507-0a104911411b None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:36:07.594535 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d9683a-2216-484f-9827-1ea1e30e5709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:36:07.595143 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9683a-2216-484f-9827-1ea1e30e5709 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:36:07.595423 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9683a-2216-484f-9827-1ea1e30e5709 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:36:07.595693 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9683a-2216-484f-9827-1ea1e30e5709 None admin] PATH_INFO: `/v3/services` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:36:07.596319 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d9683a-2216-484f-9827-1ea1e30e5709 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:36:07.596617 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d9683a-2216-484f-9827-1ea1e30e5709 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:36:07.598040 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d9683a-2216-484f-9827-1ea1e30e5709 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:36:07.603287 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 644/1305] 10.222.0.47 () {56 vars in 1116 bytes} [Mon Aug 29 22:36:07 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:36:07.609461 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e0fcc-7ea6-44a3-ac7b-06ab35210204 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:36:07.709214 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e0fcc-7ea6-44a3-ac7b-06ab35210204 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:36:07.743264 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fe0d18-2a88-4df0-9e90-309100db1967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:36:07.743874 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe0d18-2a88-4df0-9e90-309100db1967 None admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:36:07.744154 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe0d18-2a88-4df0-9e90-309100db1967 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:36:07.744424 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe0d18-2a88-4df0-9e90-309100db1967 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:36:07.745083 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fe0d18-2a88-4df0-9e90-309100db1967 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:36:07.746521 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fe0d18-2a88-4df0-9e90-309100db1967 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:36:07.767043 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 662/1306] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:36:07 2022] POST /identity/v3/endpoints => generated 331 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:36:17.600235 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=30 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:36:17.761891 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:12.697216 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a372dc3-55e2-4e42-b34c-0fc19bfab2d4 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:12.697700 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a372dc3-55e2-4e42-b34c-0fc19bfab2d4 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:12.697798 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a372dc3-55e2-4e42-b34c-0fc19bfab2d4 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:12.699204 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 645/1307] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:37:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:37:12.704321 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505554c1-0f69-41f2-9c18-d639e7da01ab None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:12.704955 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505554c1-0f69-41f2-9c18-d639e7da01ab None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:12.704955 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505554c1-0f69-41f2-9c18-d639e7da01ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:12.796131 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-505554c1-0f69-41f2-9c18-d639e7da01ab None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:37:12.798791 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-505554c1-0f69-41f2-9c18-d639e7da01ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:12.983651 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 663/1308] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:37:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:37:13.280879 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d01aa-dcc8-4265-841a-32b8ef95a69e None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:13.281223 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d01aa-dcc8-4265-841a-32b8ef95a69e None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:13.281469 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d01aa-dcc8-4265-841a-32b8ef95a69e None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:13.282966 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 646/1309] 10.222.0.47 () {54 vars in 965 bytes} [Mon Aug 29 22:37:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:37:13.288965 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43677cf-6603-4f10-a30f-d6f0ab498bbd None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:13.289358 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43677cf-6603-4f10-a30f-d6f0ab498bbd None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:13.289756 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43677cf-6603-4f10-a30f-d6f0ab498bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:13.379434 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-a43677cf-6603-4f10-a30f-d6f0ab498bbd None None] MFA Rules not processed for user `27abbf7b40e54fc091ebfe10aa6da90d`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:37:13.380767 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-a43677cf-6603-4f10-a30f-d6f0ab498bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:13.406167 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:13.472605 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 664/1310] 10.222.0.47 () {58 vars in 1062 bytes} [Mon Aug 29 22:37:13 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:37:13.481983 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3d01aa-dcc8-4265-841a-32b8ef95a69e None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:13.483795 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-6e3d01aa-dcc8-4265-841a-32b8ef95a69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:13.620669 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3d01aa-dcc8-4265-841a-32b8ef95a69e None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:13.700836 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce47760d-dfa2-4644-b8db-836325e1a20c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:13.701519 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce47760d-dfa2-4644-b8db-836325e1a20c service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:13.701747 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce47760d-dfa2-4644-b8db-836325e1a20c service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:13.702017 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce47760d-dfa2-4644-b8db-836325e1a20c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:13.703633 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-ce47760d-dfa2-4644-b8db-836325e1a20c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:13.761995 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:13.822204 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce47760d-dfa2-4644-b8db-836325e1a20c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:13.823711 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce47760d-dfa2-4644-b8db-836325e1a20c service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:13.846409 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 647/1311] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:37:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:37:16.064810 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdedba4-f02d-401d-8ee6-377a89485e7e None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:16.065531 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdedba4-f02d-401d-8ee6-377a89485e7e None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:16.065531 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdedba4-f02d-401d-8ee6-377a89485e7e None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:16.066927 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 665/1312] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:37:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:37:16.071998 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16921ed3-ebfc-4df1-b782-809cb4a465cf None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:16.072393 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16921ed3-ebfc-4df1-b782-809cb4a465cf None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:16.072543 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16921ed3-ebfc-4df1-b782-809cb4a465cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:16.166396 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-16921ed3-ebfc-4df1-b782-809cb4a465cf None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:37:16.167654 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-16921ed3-ebfc-4df1-b782-809cb4a465cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:16.264399 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 648/1313] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:37:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:37:16.559909 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdedba4-f02d-401d-8ee6-377a89485e7e None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:16.561519 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-4fdedba4-f02d-401d-8ee6-377a89485e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:16.671073 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdedba4-f02d-401d-8ee6-377a89485e7e None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:16.743342 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:16.745712 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a52ab6-2eb7-4fde-bcb6-0a7d947559c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:16.746325 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a52ab6-2eb7-4fde-bcb6-0a7d947559c5 service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:16.746783 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a52ab6-2eb7-4fde-bcb6-0a7d947559c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:16.747218 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a52ab6-2eb7-4fde-bcb6-0a7d947559c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:16.749051 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-92a52ab6-2eb7-4fde-bcb6-0a7d947559c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:16.860392 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a52ab6-2eb7-4fde-bcb6-0a7d947559c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:16.862433 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a52ab6-2eb7-4fde-bcb6-0a7d947559c5 service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:16.881271 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 666/1314] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:37:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:37:19.111309 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5bb1fe-cedf-4c54-8410-57650e00335c None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:19.111881 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5bb1fe-cedf-4c54-8410-57650e00335c None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:19.112215 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5bb1fe-cedf-4c54-8410-57650e00335c None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:19.113622 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 649/1315] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:37:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:37:19.119145 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf15d5-643b-4aaa-b24b-513dfac6a469 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:19.119548 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf15d5-643b-4aaa-b24b-513dfac6a469 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:19.119699 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf15d5-643b-4aaa-b24b-513dfac6a469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:19.185346 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-5ebf15d5-643b-4aaa-b24b-513dfac6a469 None None] MFA Rules not processed for user `d825c7992679472eaa3ad17d44674788`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:37:19.186570 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-5ebf15d5-643b-4aaa-b24b-513dfac6a469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:19.239455 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:19.285943 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 667/1316] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:37:19 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:37:19.575919 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5bb1fe-cedf-4c54-8410-57650e00335c None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:19.577511 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-7d5bb1fe-cedf-4c54-8410-57650e00335c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:19.587914 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:19.682359 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5bb1fe-cedf-4c54-8410-57650e00335c None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:19.756011 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8454bd-ab98-4877-8a32-f09e0d17764c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:19.756545 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8454bd-ab98-4877-8a32-f09e0d17764c service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:19.756827 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8454bd-ab98-4877-8a32-f09e0d17764c service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:19.757108 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8454bd-ab98-4877-8a32-f09e0d17764c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:19.758744 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-5b8454bd-ab98-4877-8a32-f09e0d17764c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:19.821756 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:19.872690 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8454bd-ab98-4877-8a32-f09e0d17764c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:19.874162 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8454bd-ab98-4877-8a32-f09e0d17764c service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:19.893094 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 650/1317] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:37:19 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:37:22.355066 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14209805-6330-480b-9801-e511eefd697a None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:22.355617 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14209805-6330-480b-9801-e511eefd697a None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:22.355617 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14209805-6330-480b-9801-e511eefd697a None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:22.356978 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 668/1318] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:37:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:37:22.362271 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2560a3fe-efe8-4606-99a6-087fbfd4f63c None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:22.362688 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2560a3fe-efe8-4606-99a6-087fbfd4f63c None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:22.362898 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2560a3fe-efe8-4606-99a6-087fbfd4f63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:22.430266 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-2560a3fe-efe8-4606-99a6-087fbfd4f63c None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:37:22.431411 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-2560a3fe-efe8-4606-99a6-087fbfd4f63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:22.528274 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 651/1319] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:37:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:37:22.829304 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b67a58-ab14-471f-be0d-f7c1f42389f5 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:22.829627 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b67a58-ab14-471f-be0d-f7c1f42389f5 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:22.830053 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b67a58-ab14-471f-be0d-f7c1f42389f5 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:22.831644 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 669/1320] 10.222.0.47 () {54 vars in 965 bytes} [Mon Aug 29 22:37:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:37:22.838270 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112810d-351d-4599-89ad-0c7159149b0c None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:22.838558 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112810d-351d-4599-89ad-0c7159149b0c None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:22.838832 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112810d-351d-4599-89ad-0c7159149b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:22.860353 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:22.915247 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-5112810d-351d-4599-89ad-0c7159149b0c None None] MFA Rules not processed for user `27abbf7b40e54fc091ebfe10aa6da90d`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:37:22.916482 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-5112810d-351d-4599-89ad-0c7159149b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:22.993885 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 652/1321] 10.222.0.47 () {58 vars in 1062 bytes} [Mon Aug 29 22:37:22 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:37:23.002979 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b67a58-ab14-471f-be0d-f7c1f42389f5 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:23.004497 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-33b67a58-ab14-471f-be0d-f7c1f42389f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:23.108645 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b67a58-ab14-471f-be0d-f7c1f42389f5 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:23.183482 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a13a522-eaf6-4cb9-9331-81cd3918f759 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:23.184080 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a13a522-eaf6-4cb9-9331-81cd3918f759 service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:23.184356 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a13a522-eaf6-4cb9-9331-81cd3918f759 service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:23.184623 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a13a522-eaf6-4cb9-9331-81cd3918f759 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:23.186239 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-9a13a522-eaf6-4cb9-9331-81cd3918f759 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:23.193117 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:23.295749 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a13a522-eaf6-4cb9-9331-81cd3918f759 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:23.297181 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a13a522-eaf6-4cb9-9331-81cd3918f759 service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:23.316193 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 670/1322] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:37:23 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:37:26.406665 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7d723-ad37-4a34-86d7-fd8462a5b27c None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:26.407285 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7d723-ad37-4a34-86d7-fd8462a5b27c None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:26.407285 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7d723-ad37-4a34-86d7-fd8462a5b27c None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:26.408625 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 653/1323] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:37:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:37:26.414078 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1583f-5577-4a56-8eb3-9a7628c3f6da None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:26.414535 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1583f-5577-4a56-8eb3-9a7628c3f6da None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:26.414637 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1583f-5577-4a56-8eb3-9a7628c3f6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:26.480883 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-53e1583f-5577-4a56-8eb3-9a7628c3f6da None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:37:26.482118 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-53e1583f-5577-4a56-8eb3-9a7628c3f6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:26.543254 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:26.588429 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 671/1324] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:37:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:37:26.877825 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b7d723-ad37-4a34-86d7-fd8462a5b27c None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:26.879477 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-07b7d723-ad37-4a34-86d7-fd8462a5b27c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:26.989946 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b7d723-ad37-4a34-86d7-fd8462a5b27c None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:27.002756 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:27.068288 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eec592-afc1-4c07-90f6-ffbcbf9fd613 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:27.068953 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eec592-afc1-4c07-90f6-ffbcbf9fd613 service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:27.069188 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eec592-afc1-4c07-90f6-ffbcbf9fd613 service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:27.069508 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eec592-afc1-4c07-90f6-ffbcbf9fd613 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:27.071147 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-f5eec592-afc1-4c07-90f6-ffbcbf9fd613 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:27.186183 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eec592-afc1-4c07-90f6-ffbcbf9fd613 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:27.187636 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eec592-afc1-4c07-90f6-ffbcbf9fd613 service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:27.207287 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 654/1325] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:37:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:37:29.204079 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddaf119-4fdf-4a69-96f5-a47984389b34 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:29.204607 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddaf119-4fdf-4a69-96f5-a47984389b34 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:29.204607 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddaf119-4fdf-4a69-96f5-a47984389b34 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:29.206009 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 672/1326] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:37:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:37:29.211281 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25061748-4e88-45d2-a44c-61f95ca0e89c None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:29.211731 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25061748-4e88-45d2-a44c-61f95ca0e89c None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:29.211828 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25061748-4e88-45d2-a44c-61f95ca0e89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:29.262024 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:29.281126 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-25061748-4e88-45d2-a44c-61f95ca0e89c None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:37:29.282397 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-25061748-4e88-45d2-a44c-61f95ca0e89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:29.384763 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 655/1327] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:37:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:37:29.672415 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddaf119-4fdf-4a69-96f5-a47984389b34 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:29.673969 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-3ddaf119-4fdf-4a69-96f5-a47984389b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:29.787478 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddaf119-4fdf-4a69-96f5-a47984389b34 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:29.861417 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bc861a-4b6c-4a03-9390-37fcc5af20c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:29.862735 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc861a-4b6c-4a03-9390-37fcc5af20c4 service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:29.863154 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc861a-4b6c-4a03-9390-37fcc5af20c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:29.863422 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc861a-4b6c-4a03-9390-37fcc5af20c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:29.865010 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-c5bc861a-4b6c-4a03-9390-37fcc5af20c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:29.881825 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:29.977692 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bc861a-4b6c-4a03-9390-37fcc5af20c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:29.979130 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bc861a-4b6c-4a03-9390-37fcc5af20c4 service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:29.998282 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 673/1328] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:37:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:37:31.996952 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1187c67-bbdd-45a7-b64f-4cef54f2b60d None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:31.997510 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1187c67-bbdd-45a7-b64f-4cef54f2b60d None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:31.997510 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1187c67-bbdd-45a7-b64f-4cef54f2b60d None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:31.998918 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 656/1329] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:37:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:37:32.004759 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7f162-552e-43cf-87ed-bd7a080b94fe None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:32.005206 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7f162-552e-43cf-87ed-bd7a080b94fe None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:32.005364 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7f162-552e-43cf-87ed-bd7a080b94fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:32.076939 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-36f7f162-552e-43cf-87ed-bd7a080b94fe None None] MFA Rules not processed for user `d825c7992679472eaa3ad17d44674788`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:37:32.078197 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-36f7f162-552e-43cf-87ed-bd7a080b94fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:32.146676 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:32.180522 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 674/1330] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:37:32 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:37:32.466133 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1187c67-bbdd-45a7-b64f-4cef54f2b60d None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:32.467699 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-b1187c67-bbdd-45a7-b64f-4cef54f2b60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:32.577695 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1187c67-bbdd-45a7-b64f-4cef54f2b60d None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:32.598045 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:32.653156 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f7ef0c-0f19-4434-be30-5e02d635e6c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:32.653743 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7ef0c-0f19-4434-be30-5e02d635e6c0 service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:32.654026 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7ef0c-0f19-4434-be30-5e02d635e6c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:32.654299 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7ef0c-0f19-4434-be30-5e02d635e6c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:32.655930 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-f4f7ef0c-0f19-4434-be30-5e02d635e6c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:32.765557 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f7ef0c-0f19-4434-be30-5e02d635e6c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:32.767040 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f7ef0c-0f19-4434-be30-5e02d635e6c0 service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:32.786453 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 657/1331] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:37:32 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:37:34.965668 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436dbbf-8ddc-4fdd-a86e-125933b1eea6 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:34.966236 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436dbbf-8ddc-4fdd-a86e-125933b1eea6 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:34.966236 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436dbbf-8ddc-4fdd-a86e-125933b1eea6 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:34.967568 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 675/1332] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:37:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:37:34.973513 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83fc00-61e4-447f-ac51-b69474d591b3 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:34.974105 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83fc00-61e4-447f-ac51-b69474d591b3 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:34.974105 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83fc00-61e4-447f-ac51-b69474d591b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:35.043046 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:35.046132 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-af83fc00-61e4-447f-ac51-b69474d591b3 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:37:35.048108 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-af83fc00-61e4-447f-ac51-b69474d591b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:35.149661 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 658/1333] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:37:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:37:35.435235 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1436dbbf-8ddc-4fdd-a86e-125933b1eea6 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:35.437564 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-1436dbbf-8ddc-4fdd-a86e-125933b1eea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:35.550910 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1436dbbf-8ddc-4fdd-a86e-125933b1eea6 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:35.628851 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d4382-6118-4bb4-bf95-6b097cba4d7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:35.629497 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d4382-6118-4bb4-bf95-6b097cba4d7b service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:35.629785 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d4382-6118-4bb4-bf95-6b097cba4d7b service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:35.630058 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d4382-6118-4bb4-bf95-6b097cba4d7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:35.631690 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-260d4382-6118-4bb4-bf95-6b097cba4d7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:35.661119 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:35.743271 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260d4382-6118-4bb4-bf95-6b097cba4d7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:35.744724 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260d4382-6118-4bb4-bf95-6b097cba4d7b service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:35.764577 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 676/1334] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:37:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:37:37.721536 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb4a0e-5099-421d-83e4-a64cc7eb1c3d None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:37.722727 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb4a0e-5099-421d-83e4-a64cc7eb1c3d None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:37.722888 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb4a0e-5099-421d-83e4-a64cc7eb1c3d None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:37.724335 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 659/1335] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:37:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:37:37.729621 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d5eea3-d170-45f0-85a6-fb3bcb38cd5f None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:37.730044 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d5eea3-d170-45f0-85a6-fb3bcb38cd5f None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:37.730172 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d5eea3-d170-45f0-85a6-fb3bcb38cd5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:37.795650 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-64d5eea3-d170-45f0-85a6-fb3bcb38cd5f None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:37:37.796867 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-64d5eea3-d170-45f0-85a6-fb3bcb38cd5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:37.871754 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:37.894961 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 677/1336] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:37:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:37:38.179564 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb4a0e-5099-421d-83e4-a64cc7eb1c3d None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:38.181107 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-1aeb4a0e-5099-421d-83e4-a64cc7eb1c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:38.285597 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb4a0e-5099-421d-83e4-a64cc7eb1c3d None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:38.315941 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:38.362550 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e3cdd4-ba74-420c-b04a-19ba738c7804 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:38.363161 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3cdd4-ba74-420c-b04a-19ba738c7804 service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:38.363442 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3cdd4-ba74-420c-b04a-19ba738c7804 service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:38.363714 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3cdd4-ba74-420c-b04a-19ba738c7804 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:38.365356 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-c4e3cdd4-ba74-420c-b04a-19ba738c7804 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:38.473934 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e3cdd4-ba74-420c-b04a-19ba738c7804 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:38.475281 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e3cdd4-ba74-420c-b04a-19ba738c7804 service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:38.493048 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 660/1337] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:37:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:37:40.728824 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d2c8d-97f0-4add-8e37-f417ed52c184 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:40.729401 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d2c8d-97f0-4add-8e37-f417ed52c184 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:40.729401 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d2c8d-97f0-4add-8e37-f417ed52c184 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:40.730721 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 678/1338] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:37:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:37:40.736063 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b18a4d-0422-4346-88ba-140143640384 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:40.736441 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b18a4d-0422-4346-88ba-140143640384 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:40.736615 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b18a4d-0422-4346-88ba-140143640384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:40.802817 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-43b18a4d-0422-4346-88ba-140143640384 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:37:40.804048 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-43b18a4d-0422-4346-88ba-140143640384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:40.812467 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:40.901438 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 661/1339] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:37:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:37:41.191822 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223d2c8d-97f0-4add-8e37-f417ed52c184 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:41.193493 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-223d2c8d-97f0-4add-8e37-f417ed52c184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:41.298097 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223d2c8d-97f0-4add-8e37-f417ed52c184 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:41.372593 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5e0b70-8cf7-486a-a63b-90074a1ec409 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:41.373205 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e0b70-8cf7-486a-a63b-90074a1ec409 service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:41.373514 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e0b70-8cf7-486a-a63b-90074a1ec409 service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:41.373783 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e0b70-8cf7-486a-a63b-90074a1ec409 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:41.375370 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-da5e0b70-8cf7-486a-a63b-90074a1ec409 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:41.411928 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:41.486183 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5e0b70-8cf7-486a-a63b-90074a1ec409 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:41.487622 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5e0b70-8cf7-486a-a63b-90074a1ec409 service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:41.505982 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 679/1340] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:37:41 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:37:45.529557 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b1b5b-a4f6-4d1c-94da-3318848f6d3d None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:45.530040 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b1b5b-a4f6-4d1c-94da-3318848f6d3d None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:45.530142 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b1b5b-a4f6-4d1c-94da-3318848f6d3d None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:45.531462 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 662/1341] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:37:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:37:45.537239 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d61393-0864-4ae5-92ea-5bd3c52350c8 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:45.537737 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d61393-0864-4ae5-92ea-5bd3c52350c8 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:45.537850 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d61393-0864-4ae5-92ea-5bd3c52350c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:45.607691 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-87d61393-0864-4ae5-92ea-5bd3c52350c8 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:37:45.608896 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-87d61393-0864-4ae5-92ea-5bd3c52350c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:45.696278 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:45.708912 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 680/1342] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:37:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:37:45.998635 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b1b5b-a4f6-4d1c-94da-3318848f6d3d None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:46.000259 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-906b1b5b-a4f6-4d1c-94da-3318848f6d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:46.109591 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b1b5b-a4f6-4d1c-94da-3318848f6d3d None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:46.150288 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:46.195457 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c4cd2-47ad-4026-b45c-5c5834276394 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:46.196067 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c4cd2-47ad-4026-b45c-5c5834276394 service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:46.196358 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c4cd2-47ad-4026-b45c-5c5834276394 service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:46.196632 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c4cd2-47ad-4026-b45c-5c5834276394 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:46.198268 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-871c4cd2-47ad-4026-b45c-5c5834276394 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:46.327703 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871c4cd2-47ad-4026-b45c-5c5834276394 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:46.329141 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871c4cd2-47ad-4026-b45c-5c5834276394 service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:46.348774 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 663/1343] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:37:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:37:48.925616 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe9e68-c7c4-4035-b7e4-5747d7d403e1 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:48.926607 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe9e68-c7c4-4035-b7e4-5747d7d403e1 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:48.926724 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe9e68-c7c4-4035-b7e4-5747d7d403e1 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:48.928321 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 681/1344] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:37:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:37:48.934401 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c519ebc5-3d6f-4aff-88d0-4d174e3e73d6 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:48.934925 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c519ebc5-3d6f-4aff-88d0-4d174e3e73d6 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:48.935029 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c519ebc5-3d6f-4aff-88d0-4d174e3e73d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:49.005040 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-c519ebc5-3d6f-4aff-88d0-4d174e3e73d6 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:37:49.006316 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-c519ebc5-3d6f-4aff-88d0-4d174e3e73d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:49.024698 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:49.111405 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 664/1345] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:37:48 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:37:49.395363 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe9e68-c7c4-4035-b7e4-5747d7d403e1 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:49.396958 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-dfbe9e68-c7c4-4035-b7e4-5747d7d403e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:49.501804 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe9e68-c7c4-4035-b7e4-5747d7d403e1 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:49.580665 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec78c378-4c36-4267-b191-12be2875b85d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:49.581284 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78c378-4c36-4267-b191-12be2875b85d service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:49.581595 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78c378-4c36-4267-b191-12be2875b85d service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:49.581863 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78c378-4c36-4267-b191-12be2875b85d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:49.584257 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-ec78c378-4c36-4267-b191-12be2875b85d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:49.631192 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:49.698715 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec78c378-4c36-4267-b191-12be2875b85d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:49.700170 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec78c378-4c36-4267-b191-12be2875b85d service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:49.718954 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 682/1346] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:37:49 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:37:53.827492 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91eca7-d94d-4533-b2c0-c44406772f19 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:53.828044 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91eca7-d94d-4533-b2c0-c44406772f19 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:53.828044 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91eca7-d94d-4533-b2c0-c44406772f19 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:53.829414 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 665/1347] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:37:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:37:53.835372 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591dccd-7a50-4314-a10e-500ad7d8e3c6 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:53.835862 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591dccd-7a50-4314-a10e-500ad7d8e3c6 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:53.835953 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591dccd-7a50-4314-a10e-500ad7d8e3c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:53.909719 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-c591dccd-7a50-4314-a10e-500ad7d8e3c6 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:37:53.911043 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-c591dccd-7a50-4314-a10e-500ad7d8e3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:54.016738 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:54.020044 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 683/1348] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:37:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:37:54.310811 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a91eca7-d94d-4533-b2c0-c44406772f19 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:37:54.312336 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-9a91eca7-d94d-4533-b2c0-c44406772f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:54.437290 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a91eca7-d94d-4533-b2c0-c44406772f19 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:37:54.492563 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:54.519888 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b478d8-427d-4beb-ab1c-4aebdea7a86f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:37:54.521059 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b478d8-427d-4beb-ab1c-4aebdea7a86f service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:54.521425 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b478d8-427d-4beb-ab1c-4aebdea7a86f service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:54.521824 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b478d8-427d-4beb-ab1c-4aebdea7a86f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:54.523465 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-e1b478d8-427d-4beb-ab1c-4aebdea7a86f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:54.645940 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b478d8-427d-4beb-ab1c-4aebdea7a86f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:37:54.647580 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b478d8-427d-4beb-ab1c-4aebdea7a86f service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:37:54.666345 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 666/1349] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:37:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:37:59.633472 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f39bd1e-4e1b-49b7-92de-916db76cc96d None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:59.634030 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f39bd1e-4e1b-49b7-92de-916db76cc96d None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:59.634030 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f39bd1e-4e1b-49b7-92de-916db76cc96d None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:59.636349 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 684/1350] 10.222.0.47 () {54 vars in 921 bytes} [Mon Aug 29 22:37:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:37:59.641506 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5b311-b81e-4c4e-b189-35d996c99d81 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:37:59.641951 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5b311-b81e-4c4e-b189-35d996c99d81 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:37:59.642051 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5b311-b81e-4c4e-b189-35d996c99d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:37:59.732952 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-d6e5b311-b81e-4c4e-b189-35d996c99d81 None None] MFA Rules not processed for user `296cbef772104e078971ba93aa2e022c`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:37:59.734206 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-d6e5b311-b81e-4c4e-b189-35d996c99d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:37:59.759644 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:59.930374 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 667/1351] 10.222.0.47 () {58 vars in 1018 bytes} [Mon Aug 29 22:37:59 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:38:04.232864 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a58af-ee56-46f3-aca2-94c3d834f192 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:04.233417 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a58af-ee56-46f3-aca2-94c3d834f192 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:04.233417 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a58af-ee56-46f3-aca2-94c3d834f192 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:04.234929 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 685/1352] 10.222.0.47 () {54 vars in 921 bytes} [Mon Aug 29 22:38:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:38:04.240534 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa3a736-5920-48c6-b4a7-fb16373d6165 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:04.241296 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa3a736-5920-48c6-b4a7-fb16373d6165 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:04.241296 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa3a736-5920-48c6-b4a7-fb16373d6165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:04.331730 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-3aa3a736-5920-48c6-b4a7-fb16373d6165 None None] MFA Rules not processed for user `296cbef772104e078971ba93aa2e022c`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:38:04.332951 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-3aa3a736-5920-48c6-b4a7-fb16373d6165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:04.408379 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:04.448991 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 668/1353] 10.222.0.47 () {58 vars in 1018 bytes} [Mon Aug 29 22:38:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:38:05.813684 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ce59e-da22-4583-8f52-997f2427ea91 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:05.814247 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ce59e-da22-4583-8f52-997f2427ea91 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:05.814338 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ce59e-da22-4583-8f52-997f2427ea91 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:05.815813 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 686/1354] 10.222.0.47 () {54 vars in 921 bytes} [Mon Aug 29 22:38:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:38:05.821678 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a055c8-6d6d-4e74-9d00-156d1752cab6 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:05.822129 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a055c8-6d6d-4e74-9d00-156d1752cab6 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:05.822246 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a055c8-6d6d-4e74-9d00-156d1752cab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:05.900485 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-12a055c8-6d6d-4e74-9d00-156d1752cab6 None None] MFA Rules not processed for user `296cbef772104e078971ba93aa2e022c`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:38:05.901726 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-12a055c8-6d6d-4e74-9d00-156d1752cab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:06.010460 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 669/1355] 10.222.0.47 () {58 vars in 1018 bytes} [Mon Aug 29 22:38:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:38:09.437732 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c133944-0ada-459c-b214-51e1179f0d50 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:09.438264 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c133944-0ada-459c-b214-51e1179f0d50 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:09.438348 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c133944-0ada-459c-b214-51e1179f0d50 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:09.439699 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 687/1356] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:38:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:38:09.445602 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3317672a-f3f0-4c01-822c-aec43497397d None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:09.446065 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3317672a-f3f0-4c01-822c-aec43497397d None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:09.446181 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3317672a-f3f0-4c01-822c-aec43497397d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:09.484609 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:09.532765 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-3317672a-f3f0-4c01-822c-aec43497397d None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:38:09.533993 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-3317672a-f3f0-4c01-822c-aec43497397d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:09.664283 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 670/1357] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:38:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:38:09.969875 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d6fa2-36d7-48a8-adf3-66a6010b7c39 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:09.970256 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d6fa2-36d7-48a8-adf3-66a6010b7c39 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:09.970445 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d6fa2-36d7-48a8-adf3-66a6010b7c39 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:09.971779 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 688/1358] 10.222.0.47 () {54 vars in 962 bytes} [Mon Aug 29 22:38:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:38:09.989840 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d736abc-91bb-49aa-8220-132692913289 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:09.989840 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d736abc-91bb-49aa-8220-132692913289 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:09.990783 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d736abc-91bb-49aa-8220-132692913289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:10.084874 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-8d736abc-91bb-49aa-8220-132692913289 None None] MFA Rules not processed for user `35441c061e514b1b9341e7694ec2c0bc`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:38:10.086180 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-8d736abc-91bb-49aa-8220-132692913289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:10.141586 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:10.218910 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 671/1359] 10.222.0.47 () {58 vars in 1059 bytes} [Mon Aug 29 22:38:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:38:10.227234 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7d6fa2-36d7-48a8-adf3-66a6010b7c39 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:10.228753 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-0a7d6fa2-36d7-48a8-adf3-66a6010b7c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:10.386583 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7d6fa2-36d7-48a8-adf3-66a6010b7c39 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:10.468272 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:10.512599 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff489dc-15e5-40e2-ada4-e1d23b4cc9c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35441c061e514b1b9341e7694ec2c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:10.513211 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff489dc-15e5-40e2-ada4-e1d23b4cc9c6 service nova] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:10.513522 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff489dc-15e5-40e2-ada4-e1d23b4cc9c6 service nova] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:10.513798 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff489dc-15e5-40e2-ada4-e1d23b4cc9c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:10.515387 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-dff489dc-15e5-40e2-ada4-e1d23b4cc9c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:10.611798 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff489dc-15e5-40e2-ada4-e1d23b4cc9c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:10.613444 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff489dc-15e5-40e2-ada4-e1d23b4cc9c6 service nova] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:10.633833 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 689/1360] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:38:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:38:12.816077 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c2f5a9-23b0-481f-8aaf-bd10ed63c6f1 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:12.816453 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c2f5a9-23b0-481f-8aaf-bd10ed63c6f1 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:12.816706 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c2f5a9-23b0-481f-8aaf-bd10ed63c6f1 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:12.821804 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 672/1361] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:38:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:38:12.824817 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e1344-8d4c-48c2-ac8f-c0ed0bad8817 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:12.825896 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e1344-8d4c-48c2-ac8f-c0ed0bad8817 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:12.826180 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e1344-8d4c-48c2-ac8f-c0ed0bad8817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:12.898601 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-0f9e1344-8d4c-48c2-ac8f-c0ed0bad8817 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:38:12.899793 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-0f9e1344-8d4c-48c2-ac8f-c0ed0bad8817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:12.941355 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:13.017150 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 690/1362] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:38:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:38:13.316823 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c2f5a9-23b0-481f-8aaf-bd10ed63c6f1 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:13.318363 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-84c2f5a9-23b0-481f-8aaf-bd10ed63c6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:13.484119 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c2f5a9-23b0-481f-8aaf-bd10ed63c6f1 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:13.495126 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:13.625210 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f160bfd-e7c9-47c0-9179-55b91f6e55fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35441c061e514b1b9341e7694ec2c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:13.625866 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f160bfd-e7c9-47c0-9179-55b91f6e55fd service nova] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:13.626146 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f160bfd-e7c9-47c0-9179-55b91f6e55fd service nova] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:13.626573 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f160bfd-e7c9-47c0-9179-55b91f6e55fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:13.628252 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-1f160bfd-e7c9-47c0-9179-55b91f6e55fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:13.733121 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f160bfd-e7c9-47c0-9179-55b91f6e55fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:13.734674 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f160bfd-e7c9-47c0-9179-55b91f6e55fd service nova] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:13.756955 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 673/1363] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:38:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:38:16.047967 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a81037-dffc-447f-a398-c20a56e2f173 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:16.048549 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a81037-dffc-447f-a398-c20a56e2f173 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:16.048549 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a81037-dffc-447f-a398-c20a56e2f173 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:16.049926 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 691/1364] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:38:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:38:16.055913 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db388dda-7c41-4c1a-bc5c-e8bb1116e7c4 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:16.056421 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db388dda-7c41-4c1a-bc5c-e8bb1116e7c4 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:16.057361 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db388dda-7c41-4c1a-bc5c-e8bb1116e7c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:16.074402 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:16.133809 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-db388dda-7c41-4c1a-bc5c-e8bb1116e7c4 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:38:16.135061 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-db388dda-7c41-4c1a-bc5c-e8bb1116e7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:16.241379 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 674/1365] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:38:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:38:16.532848 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7956e-afb3-4b8c-b402-399bdb5b39a3 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:16.533878 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7956e-afb3-4b8c-b402-399bdb5b39a3 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:16.534163 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7956e-afb3-4b8c-b402-399bdb5b39a3 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:16.535693 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 692/1366] 10.222.0.47 () {54 vars in 962 bytes} [Mon Aug 29 22:38:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:38:16.541863 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f46c34-3c9a-450a-940c-da512d9670d2 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:16.542218 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f46c34-3c9a-450a-940c-da512d9670d2 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:16.542568 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f46c34-3c9a-450a-940c-da512d9670d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:16.626263 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-48f46c34-3c9a-450a-940c-da512d9670d2 None None] MFA Rules not processed for user `35441c061e514b1b9341e7694ec2c0bc`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:38:16.627495 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-48f46c34-3c9a-450a-940c-da512d9670d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:16.666080 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:16.754443 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 675/1367] 10.222.0.47 () {58 vars in 1059 bytes} [Mon Aug 29 22:38:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:38:16.762487 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a7956e-afb3-4b8c-b402-399bdb5b39a3 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:16.763997 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-55a7956e-afb3-4b8c-b402-399bdb5b39a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:16.928392 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a7956e-afb3-4b8c-b402-399bdb5b39a3 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:16.954696 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:17.058678 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc74814-d5f8-4f6d-a7b4-2b3662e23452 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35441c061e514b1b9341e7694ec2c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:17.059359 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc74814-d5f8-4f6d-a7b4-2b3662e23452 service nova] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:17.059593 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc74814-d5f8-4f6d-a7b4-2b3662e23452 service nova] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:17.059811 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc74814-d5f8-4f6d-a7b4-2b3662e23452 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:17.061544 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-dfc74814-d5f8-4f6d-a7b4-2b3662e23452 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:17.159544 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc74814-d5f8-4f6d-a7b4-2b3662e23452 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:17.161587 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc74814-d5f8-4f6d-a7b4-2b3662e23452 service nova] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:17.184071 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 693/1368] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:38:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:38:17.797302 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb303bb1-7fc0-4645-9eb9-f1b31d5317d5 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:17.797949 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb303bb1-7fc0-4645-9eb9-f1b31d5317d5 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:17.797949 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb303bb1-7fc0-4645-9eb9-f1b31d5317d5 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:17.799424 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 676/1369] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:38:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:38:17.805228 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1004dac-6e27-48e1-a745-a3ab8e15fca7 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:17.805811 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1004dac-6e27-48e1-a745-a3ab8e15fca7 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:17.806091 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1004dac-6e27-48e1-a745-a3ab8e15fca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:17.840263 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:17.880162 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-e1004dac-6e27-48e1-a745-a3ab8e15fca7 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:38:17.881507 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-e1004dac-6e27-48e1-a745-a3ab8e15fca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:17.999698 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 694/1370] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:38:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:38:18.574624 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f7f8e7-d0dc-4f0b-a5c3-9f6bf25b6b33 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:18.575139 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f7f8e7-d0dc-4f0b-a5c3-9f6bf25b6b33 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:18.575423 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f7f8e7-d0dc-4f0b-a5c3-9f6bf25b6b33 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:18.576922 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 677/1371] 10.222.0.47 () {54 vars in 964 bytes} [Mon Aug 29 22:38:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:38:18.581845 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab3e1b-e580-41da-8566-8cd5344b46eb None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:18.582292 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab3e1b-e580-41da-8566-8cd5344b46eb None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:18.582394 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab3e1b-e580-41da-8566-8cd5344b46eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:18.666649 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-56ab3e1b-e580-41da-8566-8cd5344b46eb None None] MFA Rules not processed for user `d6a05d7ad37e4547bada8aabc0fcb64b`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:38:18.667885 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-56ab3e1b-e580-41da-8566-8cd5344b46eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:18.719612 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:18.753281 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 695/1372] 10.222.0.47 () {58 vars in 1061 bytes} [Mon Aug 29 22:38:18 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:38:18.761887 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f7f8e7-d0dc-4f0b-a5c3-9f6bf25b6b33 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:18.763410 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-90f7f8e7-d0dc-4f0b-a5c3-9f6bf25b6b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:18.883898 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f7f8e7-d0dc-4f0b-a5c3-9f6bf25b6b33 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:18.938539 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:19.002009 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a7b3c1-adc3-4756-b232-66f2539a018d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:19.002805 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7b3c1-adc3-4756-b232-66f2539a018d service cinder] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:19.002980 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7b3c1-adc3-4756-b232-66f2539a018d service cinder] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:19.003298 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7b3c1-adc3-4756-b232-66f2539a018d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:19.005155 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-e1a7b3c1-adc3-4756-b232-66f2539a018d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:19.155450 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a7b3c1-adc3-4756-b232-66f2539a018d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:19.157073 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a7b3c1-adc3-4756-b232-66f2539a018d service cinder] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:19.183728 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0889e-5666-4eda-859b-84932ebb5edb None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:19.184044 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0889e-5666-4eda-859b-84932ebb5edb None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:19.184342 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0889e-5666-4eda-859b-84932ebb5edb None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:19.189957 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 678/1374] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:38:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:38:19.190141 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 696/1374] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:38:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:38:19.190780 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a9950-456c-4e01-bc45-2a5d36bce655 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:19.191072 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a9950-456c-4e01-bc45-2a5d36bce655 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:19.191334 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a9950-456c-4e01-bc45-2a5d36bce655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:19.266318 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-ce6a9950-456c-4e01-bc45-2a5d36bce655 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:38:19.267956 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-ce6a9950-456c-4e01-bc45-2a5d36bce655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:19.290474 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:19.377107 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 679/1375] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:38:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:38:19.669694 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0889e-5666-4eda-859b-84932ebb5edb None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:19.671215 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-5cc0889e-5666-4eda-859b-84932ebb5edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:19.828164 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0889e-5666-4eda-859b-84932ebb5edb None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:19.888978 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:19.961801 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f6977d-7034-4eb0-a0db-9ffbef7d808e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35441c061e514b1b9341e7694ec2c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:19.962417 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6977d-7034-4eb0-a0db-9ffbef7d808e service nova] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:19.962701 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6977d-7034-4eb0-a0db-9ffbef7d808e service nova] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:19.962977 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6977d-7034-4eb0-a0db-9ffbef7d808e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:19.964641 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-97f6977d-7034-4eb0-a0db-9ffbef7d808e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:20.064198 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f6977d-7034-4eb0-a0db-9ffbef7d808e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:20.065836 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f6977d-7034-4eb0-a0db-9ffbef7d808e service nova] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:20.083933 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 697/1376] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:38:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:38:22.030793 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a481b-07c2-4111-abf9-1145140f6798 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:22.031374 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a481b-07c2-4111-abf9-1145140f6798 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:22.031374 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a481b-07c2-4111-abf9-1145140f6798 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:22.032616 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 680/1377] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:38:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:38:22.037900 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a29355-bb8d-494c-ad6a-a26ab4a83c48 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:22.038466 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a29355-bb8d-494c-ad6a-a26ab4a83c48 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:22.038617 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a29355-bb8d-494c-ad6a-a26ab4a83c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:22.106851 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-03a29355-bb8d-494c-ad6a-a26ab4a83c48 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:38:22.108093 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-03a29355-bb8d-494c-ad6a-a26ab4a83c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:22.121909 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:22.229765 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 698/1378] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:38:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:38:22.522465 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71a481b-07c2-4111-abf9-1145140f6798 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:22.524156 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-e71a481b-07c2-4111-abf9-1145140f6798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:22.679728 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71a481b-07c2-4111-abf9-1145140f6798 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:22.689682 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:22.832908 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a91a9b7-a4ec-4399-8300-e4bff2185d35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35441c061e514b1b9341e7694ec2c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:22.833719 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91a9b7-a4ec-4399-8300-e4bff2185d35 service nova] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:22.834149 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91a9b7-a4ec-4399-8300-e4bff2185d35 service nova] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:22.834576 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91a9b7-a4ec-4399-8300-e4bff2185d35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:22.837464 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-7a91a9b7-a4ec-4399-8300-e4bff2185d35 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:22.944642 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a91a9b7-a4ec-4399-8300-e4bff2185d35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:22.946181 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a91a9b7-a4ec-4399-8300-e4bff2185d35 service nova] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:22.966313 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 681/1379] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:38:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:38:24.935629 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db1c2cf-13d7-48be-b0b6-6630699b9b51 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:24.936233 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db1c2cf-13d7-48be-b0b6-6630699b9b51 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:24.936233 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db1c2cf-13d7-48be-b0b6-6630699b9b51 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:24.937742 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 699/1380] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:38:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:38:24.942826 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35ff8ba-6486-4f29-9932-ffad2d077a13 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:24.943247 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35ff8ba-6486-4f29-9932-ffad2d077a13 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:24.943378 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35ff8ba-6486-4f29-9932-ffad2d077a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:24.955373 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:25.015849 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-f35ff8ba-6486-4f29-9932-ffad2d077a13 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:38:25.017063 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-f35ff8ba-6486-4f29-9932-ffad2d077a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:25.124112 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 682/1381] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:38:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:38:25.424868 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db1c2cf-13d7-48be-b0b6-6630699b9b51 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:25.426414 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-5db1c2cf-13d7-48be-b0b6-6630699b9b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:25.582874 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:25.591473 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db1c2cf-13d7-48be-b0b6-6630699b9b51 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:25.726611 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38566521-410b-4e26-9b67-b5837e5d0eb5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35441c061e514b1b9341e7694ec2c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:25.727293 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38566521-410b-4e26-9b67-b5837e5d0eb5 service nova] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:25.727578 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38566521-410b-4e26-9b67-b5837e5d0eb5 service nova] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:25.727849 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38566521-410b-4e26-9b67-b5837e5d0eb5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:25.729493 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-38566521-410b-4e26-9b67-b5837e5d0eb5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:25.826762 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38566521-410b-4e26-9b67-b5837e5d0eb5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:25.828508 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38566521-410b-4e26-9b67-b5837e5d0eb5 service nova] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:25.841096 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:25.851964 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 700/1382] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:38:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:38:27.818845 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3dc3d-a90b-481a-894a-85fef2487392 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:27.819408 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3dc3d-a90b-481a-894a-85fef2487392 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:27.819408 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3dc3d-a90b-481a-894a-85fef2487392 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:27.821610 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 683/1383] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:38:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:38:27.828565 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea4eab-89cf-4a2f-b79a-710cace915c6 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:27.828998 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea4eab-89cf-4a2f-b79a-710cace915c6 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:27.829311 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea4eab-89cf-4a2f-b79a-710cace915c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:27.900577 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-28ea4eab-89cf-4a2f-b79a-710cace915c6 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:38:27.901860 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-28ea4eab-89cf-4a2f-b79a-710cace915c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:28.010269 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 701/1384] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:38:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:38:28.399516 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e3dc3d-a90b-481a-894a-85fef2487392 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:28.401072 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-b6e3dc3d-a90b-481a-894a-85fef2487392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:28.496461 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:28.560145 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e3dc3d-a90b-481a-894a-85fef2487392 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:28.680399 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90246d3c-904d-4725-854f-d406ac7b258d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35441c061e514b1b9341e7694ec2c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:28.681044 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90246d3c-904d-4725-854f-d406ac7b258d service nova] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:28.681352 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90246d3c-904d-4725-854f-d406ac7b258d service nova] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:28.681877 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90246d3c-904d-4725-854f-d406ac7b258d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:28.683498 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-90246d3c-904d-4725-854f-d406ac7b258d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:28.737224 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:28.779022 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90246d3c-904d-4725-854f-d406ac7b258d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:28.780559 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90246d3c-904d-4725-854f-d406ac7b258d service nova] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:28.799706 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 684/1385] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:38:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:38:30.713842 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e9331-f6f7-49d8-962b-917f124560b0 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:30.714411 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e9331-f6f7-49d8-962b-917f124560b0 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:30.714411 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e9331-f6f7-49d8-962b-917f124560b0 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:30.715741 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 702/1386] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:38:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:38:30.721062 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f5210-72a5-437d-811b-af093f47a965 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:30.721486 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f5210-72a5-437d-811b-af093f47a965 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:30.721667 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f5210-72a5-437d-811b-af093f47a965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:30.794508 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-9c9f5210-72a5-437d-811b-af093f47a965 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:38:30.795743 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-9c9f5210-72a5-437d-811b-af093f47a965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:30.894512 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 685/1387] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:38:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:38:31.185087 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e9331-f6f7-49d8-962b-917f124560b0 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:31.186648 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-e10e9331-f6f7-49d8-962b-917f124560b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:31.265400 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:31.343351 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e9331-f6f7-49d8-962b-917f124560b0 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:31.497551 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7e14e7-d9dd-4ba2-a4ee-c8525f745ccc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35441c061e514b1b9341e7694ec2c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:31.498161 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e14e7-d9dd-4ba2-a4ee-c8525f745ccc service nova] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:31.498436 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e14e7-d9dd-4ba2-a4ee-c8525f745ccc service nova] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:31.498707 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e14e7-d9dd-4ba2-a4ee-c8525f745ccc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:31.500287 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-2e7e14e7-d9dd-4ba2-a4ee-c8525f745ccc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:31.538683 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:31.596584 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7e14e7-d9dd-4ba2-a4ee-c8525f745ccc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:31.598807 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7e14e7-d9dd-4ba2-a4ee-c8525f745ccc service nova] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:31.623841 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 703/1388] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:38:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:38:33.588712 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c8e9c-c54a-47c8-a69b-7374abed920f None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:33.589249 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c8e9c-c54a-47c8-a69b-7374abed920f None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:33.589626 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c8e9c-c54a-47c8-a69b-7374abed920f None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:33.590997 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 686/1389] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:38:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:38:33.596311 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96cca0-6c1a-447f-af25-cc9fea0c20d3 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:33.596752 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96cca0-6c1a-447f-af25-cc9fea0c20d3 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:33.596871 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96cca0-6c1a-447f-af25-cc9fea0c20d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:33.664666 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-aa96cca0-6c1a-447f-af25-cc9fea0c20d3 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:38:33.665915 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-aa96cca0-6c1a-447f-af25-cc9fea0c20d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:33.766551 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 704/1390] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:38:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:38:34.062057 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c8e9c-c54a-47c8-a69b-7374abed920f None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:34.063584 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-828c8e9c-c54a-47c8-a69b-7374abed920f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:34.097875 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:34.218456 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c8e9c-c54a-47c8-a69b-7374abed920f None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:34.329100 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f6d37-5ba4-4d66-a1ba-bf1396aa800a None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:34.329498 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f6d37-5ba4-4d66-a1ba-bf1396aa800a None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:34.329840 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f6d37-5ba4-4d66-a1ba-bf1396aa800a None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:34.331302 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 705/1391] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:38:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:38:34.334499 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:34.337026 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f53419-7143-449a-b433-736e04a8d867 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:34.337309 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f53419-7143-449a-b433-736e04a8d867 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:34.337624 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f53419-7143-449a-b433-736e04a8d867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:34.342094 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f852c72-a8ac-43bf-b250-f2f5554bea91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35441c061e514b1b9341e7694ec2c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:34.342898 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f852c72-a8ac-43bf-b250-f2f5554bea91 service nova] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:34.343398 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f852c72-a8ac-43bf-b250-f2f5554bea91 service nova] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:34.343857 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f852c72-a8ac-43bf-b250-f2f5554bea91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:34.345776 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-6f852c72-a8ac-43bf-b250-f2f5554bea91 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:34.354746 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:34.407805 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-37f53419-7143-449a-b433-736e04a8d867 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:38:34.409019 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-37f53419-7143-449a-b433-736e04a8d867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:34.440337 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f852c72-a8ac-43bf-b250-f2f5554bea91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:34.442068 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f852c72-a8ac-43bf-b250-f2f5554bea91 service nova] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:34.464813 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 687/1392] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:38:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:38:34.513030 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 706/1393] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:38:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:38:34.818390 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e0213-0fbe-4664-b0ad-d438eeca81d0 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:34.819033 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e0213-0fbe-4664-b0ad-d438eeca81d0 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:34.819033 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e0213-0fbe-4664-b0ad-d438eeca81d0 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:34.820296 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 688/1394] 10.222.0.47 () {54 vars in 967 bytes} [Mon Aug 29 22:38:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:38:34.826425 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cbda88-4cc0-4abb-83ba-71498b458fca None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:34.826906 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cbda88-4cc0-4abb-83ba-71498b458fca None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:34.827003 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cbda88-4cc0-4abb-83ba-71498b458fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:34.905892 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-21cbda88-4cc0-4abb-83ba-71498b458fca None None] MFA Rules not processed for user `a5c4e692fd714354b96bd3ef4fcecdd0`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:38:34.907096 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-21cbda88-4cc0-4abb-83ba-71498b458fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:34.942726 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:34.987958 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 707/1395] 10.222.0.47 () {58 vars in 1064 bytes} [Mon Aug 29 22:38:34 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:38:34.995571 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31e0213-0fbe-4664-b0ad-d438eeca81d0 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:34.997153 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-f31e0213-0fbe-4664-b0ad-d438eeca81d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:35.109101 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31e0213-0fbe-4664-b0ad-d438eeca81d0 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:35.122681 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:35.185170 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4636fb5f-8c39-492a-b7b2-b422e9177d45 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5c4e692fd714354b96bd3ef4fcecdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:35.185816 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636fb5f-8c39-492a-b7b2-b422e9177d45 service glance] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:35.186095 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636fb5f-8c39-492a-b7b2-b422e9177d45 service glance] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:35.186365 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636fb5f-8c39-492a-b7b2-b422e9177d45 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:35.187957 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-4636fb5f-8c39-492a-b7b2-b422e9177d45 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:35.302500 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4636fb5f-8c39-492a-b7b2-b422e9177d45 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:35.303951 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4636fb5f-8c39-492a-b7b2-b422e9177d45 service glance] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:35.323218 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 689/1396] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:38:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:38:36.066318 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4f318-7d4e-420b-9d48-c6295e5ae18c None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:36.066804 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4f318-7d4e-420b-9d48-c6295e5ae18c None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:36.066892 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4f318-7d4e-420b-9d48-c6295e5ae18c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:36.140550 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-aab4f318-7d4e-420b-9d48-c6295e5ae18c None None] MFA Rules not processed for user `e49a4666712746d098ace9e1cb0bf07c`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:38:36.141918 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-aab4f318-7d4e-420b-9d48-c6295e5ae18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:36.231027 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 708/1397] 10.222.0.47 () {58 vars in 1009 bytes} [Mon Aug 29 22:38:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:38:36.273525 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d48e9-a0ca-4d15-a363-f00035e8d23c None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:36.274530 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d48e9-a0ca-4d15-a363-f00035e8d23c None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:36.274635 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d48e9-a0ca-4d15-a363-f00035e8d23c None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:36.276234 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 690/1398] 10.222.0.47 () {54 vars in 943 bytes} [Mon Aug 29 22:38:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:38:36.282605 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033511b0-0be0-4a1a-ab63-f43653f2e9be None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:36.282894 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033511b0-0be0-4a1a-ab63-f43653f2e9be None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:36.283195 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033511b0-0be0-4a1a-ab63-f43653f2e9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:36.346983 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:36.366324 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-033511b0-0be0-4a1a-ab63-f43653f2e9be None None] MFA Rules not processed for user `388d8dea2edf4fb888d42ca878c1434d`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:38:36.368215 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-033511b0-0be0-4a1a-ab63-f43653f2e9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:36.445001 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6a7a7-c794-47ab-963a-eb2ded814148 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:36.445286 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6a7a7-c794-47ab-963a-eb2ded814148 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:36.445589 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6a7a7-c794-47ab-963a-eb2ded814148 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:36.447019 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 691/1399] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:38:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:38:36.452139 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d201e1e8-c7bd-42fa-9c72-5d904f6e5247 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:36.452423 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d201e1e8-c7bd-42fa-9c72-5d904f6e5247 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:36.452696 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d201e1e8-c7bd-42fa-9c72-5d904f6e5247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:36.480972 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 709/1400] 10.222.0.47 () {58 vars in 1040 bytes} [Mon Aug 29 22:38:36 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:38:36.490494 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033511b0-0be0-4a1a-ab63-f43653f2e9be None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:36.500749 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033511b0-0be0-4a1a-ab63-f43653f2e9be None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:36.509271 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:36.524661 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-d201e1e8-c7bd-42fa-9c72-5d904f6e5247 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:38:36.526062 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-d201e1e8-c7bd-42fa-9c72-5d904f6e5247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:36.605590 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:36.611388 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcc6a8a-4284-4ea4-8922-eb49b7bc21b8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '388d8dea2edf4fb888d42ca878c1434d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:36.612002 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc6a8a-4284-4ea4-8922-eb49b7bc21b8 service swift] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:36.612282 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc6a8a-4284-4ea4-8922-eb49b7bc21b8 service swift] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:36.612585 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc6a8a-4284-4ea4-8922-eb49b7bc21b8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:36.614272 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-ffcc6a8a-4284-4ea4-8922-eb49b7bc21b8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:36.629269 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 692/1401] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:38:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:38:36.701840 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcc6a8a-4284-4ea4-8922-eb49b7bc21b8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:36.703457 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcc6a8a-4284-4ea4-8922-eb49b7bc21b8 service swift] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:36.711967 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 710/1402] 10.222.0.47 () {60 vars in 1384 bytes} [Mon Aug 29 22:38:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 22:38:36.927557 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d201e1e8-c7bd-42fa-9c72-5d904f6e5247 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:36.928787 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-d201e1e8-c7bd-42fa-9c72-5d904f6e5247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:37.077373 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d201e1e8-c7bd-42fa-9c72-5d904f6e5247 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:37.103822 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:37.235408 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c46e64-7268-4435-bcc2-11410a64b0d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35441c061e514b1b9341e7694ec2c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:37.236293 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c46e64-7268-4435-bcc2-11410a64b0d4 service nova] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:37.236573 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c46e64-7268-4435-bcc2-11410a64b0d4 service nova] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:37.236850 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c46e64-7268-4435-bcc2-11410a64b0d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:37.238544 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-b9c46e64-7268-4435-bcc2-11410a64b0d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:37.353980 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c46e64-7268-4435-bcc2-11410a64b0d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:37.356362 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c46e64-7268-4435-bcc2-11410a64b0d4 service nova] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:37.379183 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 693/1403] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:38:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:38:39.417401 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a750b6d-7144-457f-ae3e-45cb351ec38d None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:39.418014 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a750b6d-7144-457f-ae3e-45cb351ec38d None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:39.418014 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a750b6d-7144-457f-ae3e-45cb351ec38d None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:39.419282 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 711/1404] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:38:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:38:39.424685 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9e426-380f-4fd8-a151-3305b3da635f None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:39.425151 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9e426-380f-4fd8-a151-3305b3da635f None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:39.425260 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9e426-380f-4fd8-a151-3305b3da635f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:39.452837 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:39.514466 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-6cf9e426-380f-4fd8-a151-3305b3da635f None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:38:39.515698 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-6cf9e426-380f-4fd8-a151-3305b3da635f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:39.663660 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 694/1405] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:38:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:38:39.944336 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a750b6d-7144-457f-ae3e-45cb351ec38d None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:39.945965 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-8a750b6d-7144-457f-ae3e-45cb351ec38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:40.131128 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:40.144985 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a750b6d-7144-457f-ae3e-45cb351ec38d None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:40.280223 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72510836-48f0-45e2-9c55-bade46cf0ba1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35441c061e514b1b9341e7694ec2c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:40.280818 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72510836-48f0-45e2-9c55-bade46cf0ba1 service nova] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:40.285032 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72510836-48f0-45e2-9c55-bade46cf0ba1 service nova] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:40.285307 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72510836-48f0-45e2-9c55-bade46cf0ba1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:40.287065 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-72510836-48f0-45e2-9c55-bade46cf0ba1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:40.398595 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72510836-48f0-45e2-9c55-bade46cf0ba1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:40.400882 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72510836-48f0-45e2-9c55-bade46cf0ba1 service nova] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:40.411868 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:40.420880 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 712/1406] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:38:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:38:42.419451 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64326f69-f385-4bcb-b6a7-6d0015379645 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:42.419451 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64326f69-f385-4bcb-b6a7-6d0015379645 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:42.419451 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64326f69-f385-4bcb-b6a7-6d0015379645 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:42.420575 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 695/1407] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:38:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:38:42.425809 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d999f301-2819-452d-a4f2-e8648e090405 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:42.426272 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d999f301-2819-452d-a4f2-e8648e090405 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:42.426374 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d999f301-2819-452d-a4f2-e8648e090405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:42.499376 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-d999f301-2819-452d-a4f2-e8648e090405 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:38:42.500506 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-d999f301-2819-452d-a4f2-e8648e090405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:42.628137 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 713/1408] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:38:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:38:42.934397 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64326f69-f385-4bcb-b6a7-6d0015379645 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:38:42.936020 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-64326f69-f385-4bcb-b6a7-6d0015379645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:43.105519 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:43.171871 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64326f69-f385-4bcb-b6a7-6d0015379645 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:38:43.298941 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ff99b-60b6-4fc6-b7e7-733efc27025b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35441c061e514b1b9341e7694ec2c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:38:43.299933 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ff99b-60b6-4fc6-b7e7-733efc27025b service nova] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:43.300409 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ff99b-60b6-4fc6-b7e7-733efc27025b service nova] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:43.302477 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ff99b-60b6-4fc6-b7e7-733efc27025b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:43.303860 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-a31ff99b-60b6-4fc6-b7e7-733efc27025b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:43.407625 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:43.448084 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31ff99b-60b6-4fc6-b7e7-733efc27025b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:38:43.449750 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31ff99b-60b6-4fc6-b7e7-733efc27025b service nova] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:38:43.471070 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 696/1409] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:38:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:38:52.625929 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=67 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:53.468253 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=20 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:59.128142 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc2ea1-545a-4bd6-88ae-1f4112825693 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:59.128688 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc2ea1-545a-4bd6-88ae-1f4112825693 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:59.128688 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc2ea1-545a-4bd6-88ae-1f4112825693 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:59.130090 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 714/1410] 10.222.0.47 () {54 vars in 918 bytes} [Mon Aug 29 22:38:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:38:59.135254 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef2559-8dac-4bca-b047-a0053a008eb2 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:59.135704 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef2559-8dac-4bca-b047-a0053a008eb2 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:59.135879 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef2559-8dac-4bca-b047-a0053a008eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:59.227274 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-f5ef2559-8dac-4bca-b047-a0053a008eb2 None None] MFA Rules not processed for user `296cbef772104e078971ba93aa2e022c`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:38:59.228500 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-f5ef2559-8dac-4bca-b047-a0053a008eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:59.337930 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 697/1411] 10.222.0.47 () {58 vars in 1015 bytes} [Mon Aug 29 22:38:59 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:38:59.352439 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014af0be-cdfa-4e44-b46f-3cee4063a759 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:59.352731 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014af0be-cdfa-4e44-b46f-3cee4063a759 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:59.353009 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014af0be-cdfa-4e44-b46f-3cee4063a759 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:59.355172 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 715/1412] 10.222.0.47 () {54 vars in 918 bytes} [Mon Aug 29 22:38:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:38:59.360166 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16cbf08-b475-410c-a9bc-8cbefad3762f None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:38:59.360449 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16cbf08-b475-410c-a9bc-8cbefad3762f None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:38:59.360723 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16cbf08-b475-410c-a9bc-8cbefad3762f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:38:59.434493 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:59.438980 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-f16cbf08-b475-410c-a9bc-8cbefad3762f None None] MFA Rules not processed for user `35441c061e514b1b9341e7694ec2c0bc`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:38:59.440790 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-f16cbf08-b475-410c-a9bc-8cbefad3762f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:38:59.557343 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 698/1413] 10.222.0.47 () {58 vars in 1015 bytes} [Mon Aug 29 22:38:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:39:01.970774 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b052b-461a-4dd6-af38-e2cc7b6b0c9c None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:01.971464 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b052b-461a-4dd6-af38-e2cc7b6b0c9c None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:01.971464 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b052b-461a-4dd6-af38-e2cc7b6b0c9c None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:01.972539 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 716/1414] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 22:39:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:39:01.978003 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe395fa-b6df-4505-afb8-58926733c48e None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:01.978472 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe395fa-b6df-4505-afb8-58926733c48e None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:01.978563 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe395fa-b6df-4505-afb8-58926733c48e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:02.047011 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-ffe395fa-b6df-4505-afb8-58926733c48e None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:39:02.048236 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-ffe395fa-b6df-4505-afb8-58926733c48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:02.103826 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:02.147152 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 699/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 22:39:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:39:02.441880 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b052b-461a-4dd6-af38-e2cc7b6b0c9c None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:02.443214 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-103b052b-461a-4dd6-af38-e2cc7b6b0c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:02.710770 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b052b-461a-4dd6-af38-e2cc7b6b0c9c None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:02.783633 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:02.824761 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7866d3-7bda-41ce-8c0a-9a716ddc5537 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35441c061e514b1b9341e7694ec2c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:02.825393 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7866d3-7bda-41ce-8c0a-9a716ddc5537 service nova] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:02.825672 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7866d3-7bda-41ce-8c0a-9a716ddc5537 service nova] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:02.825941 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7866d3-7bda-41ce-8c0a-9a716ddc5537 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:02.827540 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-7e7866d3-7bda-41ce-8c0a-9a716ddc5537 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:02.915937 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7866d3-7bda-41ce-8c0a-9a716ddc5537 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:02.918111 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7866d3-7bda-41ce-8c0a-9a716ddc5537 service nova] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:02.936703 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 717/1416] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:39:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:39:03.871376 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d00418-c7a6-4861-b284-5da4a60aa52e None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:03.871950 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d00418-c7a6-4861-b284-5da4a60aa52e None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:03.871950 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d00418-c7a6-4861-b284-5da4a60aa52e None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:03.873287 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 700/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 22:39:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:39:03.878211 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af19f3-831b-4458-98e4-ee8638fd0e6c None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:03.878601 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af19f3-831b-4458-98e4-ee8638fd0e6c None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:03.878757 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af19f3-831b-4458-98e4-ee8638fd0e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:03.955195 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-95af19f3-831b-4458-98e4-ee8638fd0e6c None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:39:03.956421 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-95af19f3-831b-4458-98e4-ee8638fd0e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:03.984577 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:04.055522 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 718/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 22:39:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:39:04.206917 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d00418-c7a6-4861-b284-5da4a60aa52e None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:04.208391 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-d0d00418-c7a6-4861-b284-5da4a60aa52e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:04.357739 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d00418-c7a6-4861-b284-5da4a60aa52e None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:04.397983 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:04.473181 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6253d76e-d3c0-48cd-9877-f86495213651 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35441c061e514b1b9341e7694ec2c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:04.473734 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253d76e-d3c0-48cd-9877-f86495213651 service nova] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:04.474012 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253d76e-d3c0-48cd-9877-f86495213651 service nova] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:04.474283 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253d76e-d3c0-48cd-9877-f86495213651 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:04.475898 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-6253d76e-d3c0-48cd-9877-f86495213651 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:04.566662 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6253d76e-d3c0-48cd-9877-f86495213651 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:04.568278 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6253d76e-d3c0-48cd-9877-f86495213651 service nova] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:04.587660 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 701/1419] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:39:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:39:05.486244 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0c227-5e74-45db-bb34-c227df17e977 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:05.486806 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0c227-5e74-45db-bb34-c227df17e977 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:05.486806 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0c227-5e74-45db-bb34-c227df17e977 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:05.488172 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 719/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 22:39:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:39:05.493210 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f15e965-b90c-4a76-a621-1b33a7970a00 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:05.493608 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f15e965-b90c-4a76-a621-1b33a7970a00 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:05.493806 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f15e965-b90c-4a76-a621-1b33a7970a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:05.548614 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:05.570752 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-2f15e965-b90c-4a76-a621-1b33a7970a00 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:39:05.571994 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-2f15e965-b90c-4a76-a621-1b33a7970a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:05.668666 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 702/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 22:39:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:39:05.823931 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc0c227-5e74-45db-bb34-c227df17e977 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:05.825423 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-3cc0c227-5e74-45db-bb34-c227df17e977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:05.973739 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc0c227-5e74-45db-bb34-c227df17e977 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:05.987709 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:06.091553 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae631c9-7e52-4a01-a923-3c71cfa7169a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35441c061e514b1b9341e7694ec2c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:06.092069 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae631c9-7e52-4a01-a923-3c71cfa7169a service nova] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:06.092349 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae631c9-7e52-4a01-a923-3c71cfa7169a service nova] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:06.092614 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae631c9-7e52-4a01-a923-3c71cfa7169a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:06.094304 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-5ae631c9-7e52-4a01-a923-3c71cfa7169a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:06.183488 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae631c9-7e52-4a01-a923-3c71cfa7169a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:06.185083 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae631c9-7e52-4a01-a923-3c71cfa7169a service nova] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:06.203282 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 720/1422] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:39:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:39:07.079551 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2722f692-32a8-467c-90ff-857fe3230269 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:07.080126 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2722f692-32a8-467c-90ff-857fe3230269 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:07.080126 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2722f692-32a8-467c-90ff-857fe3230269 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:07.081750 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 703/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 22:39:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:39:07.086700 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74714c24-2f6d-4212-bc86-286779a7d4be None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:07.087123 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74714c24-2f6d-4212-bc86-286779a7d4be None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:07.087243 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74714c24-2f6d-4212-bc86-286779a7d4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:07.107437 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:07.164607 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-74714c24-2f6d-4212-bc86-286779a7d4be None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:39:07.165866 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-74714c24-2f6d-4212-bc86-286779a7d4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:07.264169 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 721/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 22:39:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:39:07.416157 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2722f692-32a8-467c-90ff-857fe3230269 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:07.418378 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-2722f692-32a8-467c-90ff-857fe3230269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:07.528229 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:07.565555 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2722f692-32a8-467c-90ff-857fe3230269 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:07.679335 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b7a99-7783-4917-bf27-060980400ab2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35441c061e514b1b9341e7694ec2c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:07.679863 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b7a99-7783-4917-bf27-060980400ab2 service nova] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:07.680147 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b7a99-7783-4917-bf27-060980400ab2 service nova] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:07.680423 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b7a99-7783-4917-bf27-060980400ab2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:07.682071 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-f15b7a99-7783-4917-bf27-060980400ab2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:07.758868 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:07.772976 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15b7a99-7783-4917-bf27-060980400ab2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:07.774647 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15b7a99-7783-4917-bf27-060980400ab2 service nova] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:07.794179 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 704/1425] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:39:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:39:08.665088 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba16997-36f4-4f69-bc97-8642fc391a64 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:08.665707 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba16997-36f4-4f69-bc97-8642fc391a64 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:08.665707 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba16997-36f4-4f69-bc97-8642fc391a64 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:08.667002 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 722/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 22:39:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:39:08.673146 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7accd29-2956-40d2-a9ea-14b0dfa77061 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:08.673642 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7accd29-2956-40d2-a9ea-14b0dfa77061 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:08.673738 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7accd29-2956-40d2-a9ea-14b0dfa77061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:08.749466 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-d7accd29-2956-40d2-a9ea-14b0dfa77061 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:39:08.750678 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-d7accd29-2956-40d2-a9ea-14b0dfa77061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:08.846446 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 705/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 22:39:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:39:09.001698 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba16997-36f4-4f69-bc97-8642fc391a64 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:09.003133 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-7ba16997-36f4-4f69-bc97-8642fc391a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:09.090678 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:09.153781 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba16997-36f4-4f69-bc97-8642fc391a64 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:09.267254 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4548fdee-b7a1-4d08-a3ce-1db3bbbcb3bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35441c061e514b1b9341e7694ec2c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:09.267765 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4548fdee-b7a1-4d08-a3ce-1db3bbbcb3bc service nova] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:09.268037 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4548fdee-b7a1-4d08-a3ce-1db3bbbcb3bc service nova] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:09.268297 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4548fdee-b7a1-4d08-a3ce-1db3bbbcb3bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:09.269907 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-4548fdee-b7a1-4d08-a3ce-1db3bbbcb3bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:09.318056 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:09.359840 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4548fdee-b7a1-4d08-a3ce-1db3bbbcb3bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:09.361485 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4548fdee-b7a1-4d08-a3ce-1db3bbbcb3bc service nova] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:09.382410 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 723/1428] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:39:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:39:10.195570 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20b83a-3327-4161-a0a5-254ee6d59f87 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:10.196171 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20b83a-3327-4161-a0a5-254ee6d59f87 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:10.196171 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20b83a-3327-4161-a0a5-254ee6d59f87 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:10.197512 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 706/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 22:39:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:39:10.202678 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46055043-8564-4d8c-9ca6-2893d67a654f None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:10.203127 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46055043-8564-4d8c-9ca6-2893d67a654f None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:10.203235 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46055043-8564-4d8c-9ca6-2893d67a654f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:10.280629 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-46055043-8564-4d8c-9ca6-2893d67a654f None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:39:10.281973 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-46055043-8564-4d8c-9ca6-2893d67a654f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:10.381256 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 724/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 22:39:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:39:10.533728 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c20b83a-3327-4161-a0a5-254ee6d59f87 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:10.535236 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-0c20b83a-3327-4161-a0a5-254ee6d59f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:10.586388 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:10.687097 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c20b83a-3327-4161-a0a5-254ee6d59f87 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:10.802781 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70efc42-423c-445f-9b9f-49b8d0806a69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35441c061e514b1b9341e7694ec2c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:10.803310 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70efc42-423c-445f-9b9f-49b8d0806a69 service nova] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:10.803589 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70efc42-423c-445f-9b9f-49b8d0806a69 service nova] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:10.803860 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70efc42-423c-445f-9b9f-49b8d0806a69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:10.805524 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-a70efc42-423c-445f-9b9f-49b8d0806a69 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:10.812843 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:10.896861 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70efc42-423c-445f-9b9f-49b8d0806a69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:10.898498 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70efc42-423c-445f-9b9f-49b8d0806a69 service nova] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:10.917000 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 707/1431] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:39:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:39:11.744539 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98554d-6225-4b0b-afdd-ab1b67aa87d2 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:11.745087 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98554d-6225-4b0b-afdd-ab1b67aa87d2 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:11.745087 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98554d-6225-4b0b-afdd-ab1b67aa87d2 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:11.746709 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 725/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 22:39:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:39:11.752366 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478468e-df4c-4ee4-bd43-88d94620d237 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:11.752913 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478468e-df4c-4ee4-bd43-88d94620d237 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:11.753024 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478468e-df4c-4ee4-bd43-88d94620d237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:11.832535 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-3478468e-df4c-4ee4-bd43-88d94620d237 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:39:11.833812 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-3478468e-df4c-4ee4-bd43-88d94620d237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:11.902521 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:11.931792 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 708/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 22:39:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:39:12.088198 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e98554d-6225-4b0b-afdd-ab1b67aa87d2 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:12.090407 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-5e98554d-6225-4b0b-afdd-ab1b67aa87d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:12.108123 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:12.236147 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e98554d-6225-4b0b-afdd-ab1b67aa87d2 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:12.325498 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:12.351678 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf930ec-4794-49ca-a681-a4e5d47bc41e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35441c061e514b1b9341e7694ec2c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:12.352241 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf930ec-4794-49ca-a681-a4e5d47bc41e service nova] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:12.352521 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf930ec-4794-49ca-a681-a4e5d47bc41e service nova] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:12.352819 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf930ec-4794-49ca-a681-a4e5d47bc41e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:12.354490 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-4bf930ec-4794-49ca-a681-a4e5d47bc41e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:12.446411 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf930ec-4794-49ca-a681-a4e5d47bc41e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:12.448055 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf930ec-4794-49ca-a681-a4e5d47bc41e service nova] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:12.467258 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 726/1434] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:39:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:39:13.274981 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc834c6e-1b8b-4ab0-990e-7b3833a08aa0 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:13.275528 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc834c6e-1b8b-4ab0-990e-7b3833a08aa0 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:13.275528 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc834c6e-1b8b-4ab0-990e-7b3833a08aa0 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:13.276795 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 709/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 22:39:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:39:13.282456 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e4a045-ed27-4e61-8675-32caec35c664 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:13.282881 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e4a045-ed27-4e61-8675-32caec35c664 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:13.282992 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e4a045-ed27-4e61-8675-32caec35c664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:13.364549 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-e5e4a045-ed27-4e61-8675-32caec35c664 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:39:13.365807 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-e5e4a045-ed27-4e61-8675-32caec35c664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:13.409908 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:13.468521 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 727/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 22:39:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:39:13.618902 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc834c6e-1b8b-4ab0-990e-7b3833a08aa0 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:13.620434 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-dc834c6e-1b8b-4ab0-990e-7b3833a08aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:13.768504 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc834c6e-1b8b-4ab0-990e-7b3833a08aa0 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:13.825407 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:13.886580 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053bc141-c066-43cf-86d9-2c1bde6836b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35441c061e514b1b9341e7694ec2c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:13.887744 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053bc141-c066-43cf-86d9-2c1bde6836b1 service nova] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:13.888017 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053bc141-c066-43cf-86d9-2c1bde6836b1 service nova] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:13.888291 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053bc141-c066-43cf-86d9-2c1bde6836b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:13.889933 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-053bc141-c066-43cf-86d9-2c1bde6836b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:13.978922 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053bc141-c066-43cf-86d9-2c1bde6836b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:13.981095 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053bc141-c066-43cf-86d9-2c1bde6836b1 service nova] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:13.999775 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 710/1437] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:39:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:39:14.825523 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24ede0-331a-4f4a-9422-96e9d8cc2efb None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:14.826082 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24ede0-331a-4f4a-9422-96e9d8cc2efb None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:14.826082 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24ede0-331a-4f4a-9422-96e9d8cc2efb None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:14.827433 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 728/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 22:39:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:39:14.832460 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7353693a-549c-4659-9e4b-efe633049437 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:14.832900 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7353693a-549c-4659-9e4b-efe633049437 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:14.833153 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7353693a-549c-4659-9e4b-efe633049437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:14.909530 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-7353693a-549c-4659-9e4b-efe633049437 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:39:14.910773 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-7353693a-549c-4659-9e4b-efe633049437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:14.912818 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:15.007017 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 711/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 22:39:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:39:15.162353 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb24ede0-331a-4f4a-9422-96e9d8cc2efb None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:15.163823 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-fb24ede0-331a-4f4a-9422-96e9d8cc2efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:15.310700 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb24ede0-331a-4f4a-9422-96e9d8cc2efb None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:15.337984 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:15.427418 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b0c6fc-8418-49bb-b6c0-8415143d500f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35441c061e514b1b9341e7694ec2c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:15.427938 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0c6fc-8418-49bb-b6c0-8415143d500f service nova] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:15.428222 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0c6fc-8418-49bb-b6c0-8415143d500f service nova] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:15.428499 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0c6fc-8418-49bb-b6c0-8415143d500f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:15.430172 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-29b0c6fc-8418-49bb-b6c0-8415143d500f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:15.522605 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b0c6fc-8418-49bb-b6c0-8415143d500f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:15.524187 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b0c6fc-8418-49bb-b6c0-8415143d500f service nova] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:15.542606 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 729/1440] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:39:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:39:17.376522 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0a09f-3c4c-4f58-9b2d-b54585113284 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:17.377095 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0a09f-3c4c-4f58-9b2d-b54585113284 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:17.377095 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0a09f-3c4c-4f58-9b2d-b54585113284 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:17.378510 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 712/1441] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 22:39:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:39:17.383649 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b1de91-49ce-40f0-8b81-0ba1ec6c65b0 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:17.384091 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b1de91-49ce-40f0-8b81-0ba1ec6c65b0 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:17.384204 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b1de91-49ce-40f0-8b81-0ba1ec6c65b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:17.425416 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:17.453666 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-06b1de91-49ce-40f0-8b81-0ba1ec6c65b0 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:39:17.454872 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-06b1de91-49ce-40f0-8b81-0ba1ec6c65b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:17.550140 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 730/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 22:39:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:39:17.839069 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd0a09f-3c4c-4f58-9b2d-b54585113284 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:17.840661 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-dbd0a09f-3c4c-4f58-9b2d-b54585113284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:17.944860 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd0a09f-3c4c-4f58-9b2d-b54585113284 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:17.976445 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:18.019287 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a4817c-6575-4332-9e67-f3961806a4ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:18.019892 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4817c-6575-4332-9e67-f3961806a4ce service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:18.020169 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4817c-6575-4332-9e67-f3961806a4ce service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:18.020438 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4817c-6575-4332-9e67-f3961806a4ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:18.022073 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-02a4817c-6575-4332-9e67-f3961806a4ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:18.135955 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a4817c-6575-4332-9e67-f3961806a4ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:18.137555 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a4817c-6575-4332-9e67-f3961806a4ce service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:18.156183 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 713/1443] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:39:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:39:20.256363 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec838de6-ee38-4e86-9543-a8ecf161510d None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:20.256828 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec838de6-ee38-4e86-9543-a8ecf161510d None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:20.256828 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec838de6-ee38-4e86-9543-a8ecf161510d None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:20.258210 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 731/1444] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 22:39:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:39:20.263894 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77881aea-2bf4-4db4-85c6-7467ab642428 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:20.264314 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77881aea-2bf4-4db4-85c6-7467ab642428 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:20.264492 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77881aea-2bf4-4db4-85c6-7467ab642428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:20.332353 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-77881aea-2bf4-4db4-85c6-7467ab642428 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:39:20.333598 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-77881aea-2bf4-4db4-85c6-7467ab642428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:20.347047 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:20.431726 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 714/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 22:39:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:39:20.720708 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec838de6-ee38-4e86-9543-a8ecf161510d None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:20.722294 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-ec838de6-ee38-4e86-9543-a8ecf161510d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:20.827719 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec838de6-ee38-4e86-9543-a8ecf161510d None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:20.839822 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:20.901776 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f21b736-2502-4c12-8830-3e70b4d74f94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:20.902375 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21b736-2502-4c12-8830-3e70b4d74f94 service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:20.902651 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21b736-2502-4c12-8830-3e70b4d74f94 service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:20.903016 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21b736-2502-4c12-8830-3e70b4d74f94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:20.904569 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-8f21b736-2502-4c12-8830-3e70b4d74f94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:21.012696 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f21b736-2502-4c12-8830-3e70b4d74f94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:21.014128 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f21b736-2502-4c12-8830-3e70b4d74f94 service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:21.033132 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 732/1446] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:39:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:39:23.282226 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228817b-38cc-46c8-9b03-f26e5fdf521e None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:23.282789 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228817b-38cc-46c8-9b03-f26e5fdf521e None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:23.282789 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228817b-38cc-46c8-9b03-f26e5fdf521e None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:23.284533 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 715/1447] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 22:39:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:39:23.289833 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86173ff9-5b70-4162-85bd-4d0db8f73cea None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:23.290222 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86173ff9-5b70-4162-85bd-4d0db8f73cea None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:23.290376 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86173ff9-5b70-4162-85bd-4d0db8f73cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:23.340139 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:23.359951 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-86173ff9-5b70-4162-85bd-4d0db8f73cea None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:39:23.361174 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-86173ff9-5b70-4162-85bd-4d0db8f73cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:23.456864 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 733/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 22:39:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:39:23.740699 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0228817b-38cc-46c8-9b03-f26e5fdf521e None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:23.742300 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-0228817b-38cc-46c8-9b03-f26e5fdf521e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:23.848360 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0228817b-38cc-46c8-9b03-f26e5fdf521e None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:23.891266 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:23.926767 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c23a74-990d-4967-8eb3-f251fece01e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:23.927377 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c23a74-990d-4967-8eb3-f251fece01e5 service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:23.927656 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c23a74-990d-4967-8eb3-f251fece01e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:23.927935 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c23a74-990d-4967-8eb3-f251fece01e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:23.929570 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-f1c23a74-990d-4967-8eb3-f251fece01e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:24.038157 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c23a74-990d-4967-8eb3-f251fece01e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:24.039507 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c23a74-990d-4967-8eb3-f251fece01e5 service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:24.057541 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 716/1449] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:39:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:39:26.194248 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb0ae0-e789-4787-a6db-c10d7215858f None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:26.194862 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb0ae0-e789-4787-a6db-c10d7215858f None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:26.194862 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb0ae0-e789-4787-a6db-c10d7215858f None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:26.196160 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 734/1450] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 22:39:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:39:26.201917 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab8c59-d8f3-4ec1-b22e-ab29d3b422bb None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:26.202318 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab8c59-d8f3-4ec1-b22e-ab29d3b422bb None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:26.202467 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab8c59-d8f3-4ec1-b22e-ab29d3b422bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:26.274646 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-8dab8c59-d8f3-4ec1-b22e-ab29d3b422bb None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:39:26.276030 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-8dab8c59-d8f3-4ec1-b22e-ab29d3b422bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:26.299743 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:26.378979 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 717/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 22:39:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:39:26.666141 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cb0ae0-e789-4787-a6db-c10d7215858f None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:26.668445 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-e1cb0ae0-e789-4787-a6db-c10d7215858f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:26.778056 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cb0ae0-e789-4787-a6db-c10d7215858f None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:26.797761 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:26.852716 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326bb53f-09f3-434b-a513-ab201676bca5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:26.853318 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326bb53f-09f3-434b-a513-ab201676bca5 service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:26.853627 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326bb53f-09f3-434b-a513-ab201676bca5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:26.853901 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326bb53f-09f3-434b-a513-ab201676bca5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:26.855777 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-326bb53f-09f3-434b-a513-ab201676bca5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:26.964899 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326bb53f-09f3-434b-a513-ab201676bca5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:26.966279 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326bb53f-09f3-434b-a513-ab201676bca5 service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:26.985138 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 735/1452] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:39:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:39:28.979305 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657083e-306d-4351-b7b7-f4b3c81ecd2f None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:28.979892 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657083e-306d-4351-b7b7-f4b3c81ecd2f None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:28.980006 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657083e-306d-4351-b7b7-f4b3c81ecd2f None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:28.981293 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 718/1453] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 22:39:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:39:28.986677 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f51e9-81fe-4454-b0f2-21d5874ec808 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:28.987118 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f51e9-81fe-4454-b0f2-21d5874ec808 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:28.987212 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f51e9-81fe-4454-b0f2-21d5874ec808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:29.051546 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:29.054865 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-c67f51e9-81fe-4454-b0f2-21d5874ec808 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:39:29.056471 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-c67f51e9-81fe-4454-b0f2-21d5874ec808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:29.157309 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 736/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 22:39:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:39:29.451214 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3657083e-306d-4351-b7b7-f4b3c81ecd2f None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:29.452737 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-3657083e-306d-4351-b7b7-f4b3c81ecd2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:29.556790 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3657083e-306d-4351-b7b7-f4b3c81ecd2f None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:29.605274 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:29.631126 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8f001b-5d66-43be-b73b-bd77da57c8b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:29.631739 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f001b-5d66-43be-b73b-bd77da57c8b0 service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:29.632019 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f001b-5d66-43be-b73b-bd77da57c8b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:29.632289 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f001b-5d66-43be-b73b-bd77da57c8b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:29.633927 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-dc8f001b-5d66-43be-b73b-bd77da57c8b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:29.742967 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8f001b-5d66-43be-b73b-bd77da57c8b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:29.745095 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8f001b-5d66-43be-b73b-bd77da57c8b0 service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:29.763162 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 719/1455] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:39:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:39:31.765788 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94380d-29c7-4617-9e25-5a7fe1fc144a None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:31.766359 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94380d-29c7-4617-9e25-5a7fe1fc144a None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:31.766359 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94380d-29c7-4617-9e25-5a7fe1fc144a None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:31.767756 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 737/1456] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 22:39:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:39:31.773103 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f63639-68b2-4109-9ac5-f6e89cac8be5 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:31.773568 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f63639-68b2-4109-9ac5-f6e89cac8be5 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:31.773666 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f63639-68b2-4109-9ac5-f6e89cac8be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:31.840229 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-88f63639-68b2-4109-9ac5-f6e89cac8be5 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:39:31.841470 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-88f63639-68b2-4109-9ac5-f6e89cac8be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:31.872388 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:31.940421 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 720/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 22:39:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:39:32.234794 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae94380d-29c7-4617-9e25-5a7fe1fc144a None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:32.236361 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-ae94380d-29c7-4617-9e25-5a7fe1fc144a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:32.345075 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae94380d-29c7-4617-9e25-5a7fe1fc144a None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:32.373252 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:32.418512 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c2771c-5d30-44bc-b4c2-6e4b3d6a8b5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:32.419109 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2771c-5d30-44bc-b4c2-6e4b3d6a8b5d service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:32.419407 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2771c-5d30-44bc-b4c2-6e4b3d6a8b5d service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:32.419667 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2771c-5d30-44bc-b4c2-6e4b3d6a8b5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:32.421243 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-82c2771c-5d30-44bc-b4c2-6e4b3d6a8b5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:32.529810 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c2771c-5d30-44bc-b4c2-6e4b3d6a8b5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:32.531156 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c2771c-5d30-44bc-b4c2-6e4b3d6a8b5d service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:32.549539 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 738/1458] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:39:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:39:34.506052 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f7f9b-6b29-4aeb-a382-b5bbaee32416 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:34.506562 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f7f9b-6b29-4aeb-a382-b5bbaee32416 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:34.506562 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f7f9b-6b29-4aeb-a382-b5bbaee32416 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:34.508585 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 721/1459] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 22:39:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:39:34.515101 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b931ecbd-d2de-4110-b8f3-5af1fd08f645 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:34.515572 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b931ecbd-d2de-4110-b8f3-5af1fd08f645 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:34.515670 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b931ecbd-d2de-4110-b8f3-5af1fd08f645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:34.581302 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-b931ecbd-d2de-4110-b8f3-5af1fd08f645 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:39:34.582554 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-b931ecbd-d2de-4110-b8f3-5af1fd08f645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:34.592592 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:34.686054 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 739/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 22:39:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:39:34.972395 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f7f9b-6b29-4aeb-a382-b5bbaee32416 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:34.973979 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-8d3f7f9b-6b29-4aeb-a382-b5bbaee32416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:35.080966 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f7f9b-6b29-4aeb-a382-b5bbaee32416 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:35.136346 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:35.155450 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5410c2-ea51-4f0c-8610-1655b5a6e140 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:35.156055 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5410c2-ea51-4f0c-8610-1655b5a6e140 service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:35.156330 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5410c2-ea51-4f0c-8610-1655b5a6e140 service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:35.156599 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5410c2-ea51-4f0c-8610-1655b5a6e140 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:35.158217 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-aa5410c2-ea51-4f0c-8610-1655b5a6e140 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:35.266648 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5410c2-ea51-4f0c-8610-1655b5a6e140 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:35.268000 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5410c2-ea51-4f0c-8610-1655b5a6e140 service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:35.287003 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 722/1461] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:39:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:39:37.266022 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849ff78-78b4-48cd-96c2-1394e16cc919 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:37.266598 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849ff78-78b4-48cd-96c2-1394e16cc919 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:37.266598 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849ff78-78b4-48cd-96c2-1394e16cc919 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:37.267927 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 740/1462] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 22:39:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:39:37.273511 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf9038-201a-4976-8c20-4951a7f67ec6 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:37.273981 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf9038-201a-4976-8c20-4951a7f67ec6 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:37.274078 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf9038-201a-4976-8c20-4951a7f67ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:37.342091 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-a7bf9038-201a-4976-8c20-4951a7f67ec6 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:39:37.343327 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-a7bf9038-201a-4976-8c20-4951a7f67ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:37.382390 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:37.441180 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 723/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 22:39:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:39:37.726723 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d849ff78-78b4-48cd-96c2-1394e16cc919 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:37.728240 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-d849ff78-78b4-48cd-96c2-1394e16cc919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:37.831799 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d849ff78-78b4-48cd-96c2-1394e16cc919 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:37.872765 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:37.913246 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca708c-60b0-4a96-aa73-d1f811a61395 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:37.913892 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca708c-60b0-4a96-aa73-d1f811a61395 service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:37.914171 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca708c-60b0-4a96-aa73-d1f811a61395 service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:37.914439 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca708c-60b0-4a96-aa73-d1f811a61395 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:37.916079 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-beca708c-60b0-4a96-aa73-d1f811a61395 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:38.034159 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beca708c-60b0-4a96-aa73-d1f811a61395 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:38.035555 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beca708c-60b0-4a96-aa73-d1f811a61395 service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:38.055022 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 741/1464] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:39:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:39:39.992055 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b4673-e093-49b8-a094-b58f889b9530 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:39.992811 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b4673-e093-49b8-a094-b58f889b9530 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:39.992811 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b4673-e093-49b8-a094-b58f889b9530 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:39.994009 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 724/1465] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 22:39:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:39:39.999395 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce84858-bcba-4a71-b155-4a31f291df28 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:39.999870 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce84858-bcba-4a71-b155-4a31f291df28 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:39.999979 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce84858-bcba-4a71-b155-4a31f291df28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:40.067347 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-bce84858-bcba-4a71-b155-4a31f291df28 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:39:40.069604 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-bce84858-bcba-4a71-b155-4a31f291df28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:40.088247 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:40.167550 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 742/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 22:39:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:39:40.448965 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27b4673-e093-49b8-a094-b58f889b9530 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:40.450557 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-c27b4673-e093-49b8-a094-b58f889b9530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:40.555799 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27b4673-e093-49b8-a094-b58f889b9530 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:40.625124 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:40.633428 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49b5776-2858-4e32-aaec-ee11eb9f8637 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:40.634069 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b5776-2858-4e32-aaec-ee11eb9f8637 service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:40.634348 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b5776-2858-4e32-aaec-ee11eb9f8637 service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:40.634618 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b5776-2858-4e32-aaec-ee11eb9f8637 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:40.636223 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-e49b5776-2858-4e32-aaec-ee11eb9f8637 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:40.747163 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49b5776-2858-4e32-aaec-ee11eb9f8637 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:40.748643 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49b5776-2858-4e32-aaec-ee11eb9f8637 service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:40.767581 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 725/1467] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:39:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:39:42.689367 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5fe343-66c7-4e12-b719-4f0d273ffebb None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:42.689934 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5fe343-66c7-4e12-b719-4f0d273ffebb None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:42.689934 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5fe343-66c7-4e12-b719-4f0d273ffebb None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:42.691295 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 743/1468] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 22:39:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:39:42.697403 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf8bc1-ff2b-444b-9aba-222a5541f5a3 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:42.697851 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf8bc1-ff2b-444b-9aba-222a5541f5a3 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:42.697965 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf8bc1-ff2b-444b-9aba-222a5541f5a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:42.765032 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-2ebf8bc1-ff2b-444b-9aba-222a5541f5a3 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:39:42.766302 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-2ebf8bc1-ff2b-444b-9aba-222a5541f5a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:42.815009 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:42.867554 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 726/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 22:39:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:39:43.173762 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5fe343-66c7-4e12-b719-4f0d273ffebb None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:39:43.176671 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-9a5fe343-66c7-4e12-b719-4f0d273ffebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:43.292162 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5fe343-66c7-4e12-b719-4f0d273ffebb None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:39:43.344431 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:43.374069 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d0e72f-5a40-4ab3-aeeb-bd65a81d6d9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:39:43.374679 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0e72f-5a40-4ab3-aeeb-bd65a81d6d9d service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:39:43.374960 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0e72f-5a40-4ab3-aeeb-bd65a81d6d9d service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:39:43.375233 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0e72f-5a40-4ab3-aeeb-bd65a81d6d9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:39:43.376840 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-21d0e72f-5a40-4ab3-aeeb-bd65a81d6d9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:39:43.489362 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d0e72f-5a40-4ab3-aeeb-bd65a81d6d9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:39:43.490845 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d0e72f-5a40-4ab3-aeeb-bd65a81d6d9d service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:39:43.509029 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 744/1470] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:39:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:39:52.865728 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=22 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:39:53.506768 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=66 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:40:03.077320 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a641ca8-bbcd-4ffa-aeb7-73d9d4dfd7b7 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:40:03.077920 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a641ca8-bbcd-4ffa-aeb7-73d9d4dfd7b7 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:40:03.077920 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a641ca8-bbcd-4ffa-aeb7-73d9d4dfd7b7 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:40:03.079252 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 727/1471] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:40:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:40:03.084453 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3601d8-402f-455a-b3f4-d1ec336a2467 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:40:03.084862 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3601d8-402f-455a-b3f4-d1ec336a2467 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:40:03.085007 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3601d8-402f-455a-b3f4-d1ec336a2467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:40:03.151698 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-ff3601d8-402f-455a-b3f4-d1ec336a2467 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:40:03.152936 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-ff3601d8-402f-455a-b3f4-d1ec336a2467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:40:03.250866 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 745/1472] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:40:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:40:03.556681 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e43925e-0505-4201-8bb8-da652ba64ff1 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:40:03.556969 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e43925e-0505-4201-8bb8-da652ba64ff1 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:40:03.557242 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e43925e-0505-4201-8bb8-da652ba64ff1 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:40:03.558647 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 728/1473] 10.222.0.47 () {54 vars in 967 bytes} [Mon Aug 29 22:40:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:40:03.563953 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd1316-c579-4d21-b898-17f9e00bc714 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:40:03.564244 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd1316-c579-4d21-b898-17f9e00bc714 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:40:03.564524 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd1316-c579-4d21-b898-17f9e00bc714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:40:03.641475 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-3cbd1316-c579-4d21-b898-17f9e00bc714 None None] MFA Rules not processed for user `a5c4e692fd714354b96bd3ef4fcecdd0`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:40:03.642703 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-3cbd1316-c579-4d21-b898-17f9e00bc714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:40:03.663556 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:40:03.719998 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 746/1474] 10.222.0.47 () {58 vars in 1064 bytes} [Mon Aug 29 22:40:03 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:40:03.727594 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e43925e-0505-4201-8bb8-da652ba64ff1 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:40:03.729151 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-2e43925e-0505-4201-8bb8-da652ba64ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:40:03.834739 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e43925e-0505-4201-8bb8-da652ba64ff1 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:40:03.908841 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a8aec3-1706-435f-93ac-545b35eb1860 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5c4e692fd714354b96bd3ef4fcecdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:40:03.909472 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a8aec3-1706-435f-93ac-545b35eb1860 service glance] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:40:03.909752 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a8aec3-1706-435f-93ac-545b35eb1860 service glance] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:40:03.910021 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a8aec3-1706-435f-93ac-545b35eb1860 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:40:03.911625 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-24a8aec3-1706-435f-93ac-545b35eb1860 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:40:03.965662 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:40:04.021232 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a8aec3-1706-435f-93ac-545b35eb1860 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:40:04.022705 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a8aec3-1706-435f-93ac-545b35eb1860 service glance] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:40:04.041054 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 729/1475] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:40:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:40:06.028401 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b916c447-e153-48f3-9b13-b53903cbd130 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:40:06.028973 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b916c447-e153-48f3-9b13-b53903cbd130 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:40:06.028973 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b916c447-e153-48f3-9b13-b53903cbd130 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:40:06.030402 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 747/1476] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:40:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:40:06.035786 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7df904-abe6-499f-960f-1750f74639a9 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:40:06.036200 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7df904-abe6-499f-960f-1750f74639a9 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:40:06.036345 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7df904-abe6-499f-960f-1750f74639a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:40:06.108034 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-cb7df904-abe6-499f-960f-1750f74639a9 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:40:06.109269 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-cb7df904-abe6-499f-960f-1750f74639a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:40:06.207499 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 730/1477] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:40:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:40:06.484778 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b916c447-e153-48f3-9b13-b53903cbd130 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:40:06.486348 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-b916c447-e153-48f3-9b13-b53903cbd130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:40:06.613791 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b916c447-e153-48f3-9b13-b53903cbd130 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:40:06.663251 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:40:06.709017 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b46faf-bf89-4c41-be1c-ddfc0df07bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:40:06.709646 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b46faf-bf89-4c41-be1c-ddfc0df07bb4 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:40:06.709926 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b46faf-bf89-4c41-be1c-ddfc0df07bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:40:06.710195 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b46faf-bf89-4c41-be1c-ddfc0df07bb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:40:06.710824 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b46faf-bf89-4c41-be1c-ddfc0df07bb4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:40:06.712551 dv-cinder-854270-4-smb devstack@keystone.service[88339]: WARNING py.warnings [None req-f7b46faf-bf89-4c41-be1c-ddfc0df07bb4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 22:40:06.712551 dv-cinder-854270-4-smb devstack@keystone.service[88339]: warnings.warn(msg) Aug 29 22:40:06.712551 dv-cinder-854270-4-smb devstack@keystone.service[88339]: Aug 29 22:40:06.713733 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b46faf-bf89-4c41-be1c-ddfc0df07bb4 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:40:06.732360 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 748/1478] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Aug 29 22:40:06 2022] GET /identity/v3/projects => generated 2553 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:40:08.679889 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2871a4-838d-4d8e-a705-9096a872a481 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:40:08.680451 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2871a4-838d-4d8e-a705-9096a872a481 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:40:08.680451 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2871a4-838d-4d8e-a705-9096a872a481 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:40:08.681839 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 731/1479] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:40:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:40:08.687684 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3e45e-4331-4541-8005-7f5d72b72b0a None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:40:08.688135 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3e45e-4331-4541-8005-7f5d72b72b0a None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:40:08.688240 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3e45e-4331-4541-8005-7f5d72b72b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:40:08.755707 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-eef3e45e-4331-4541-8005-7f5d72b72b0a None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:40:08.756916 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-eef3e45e-4331-4541-8005-7f5d72b72b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:40:08.852466 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 749/1480] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:40:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:40:09.148461 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2871a4-838d-4d8e-a705-9096a872a481 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:40:09.150053 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-5e2871a4-838d-4d8e-a705-9096a872a481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:40:09.159887 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:40:09.297845 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2871a4-838d-4d8e-a705-9096a872a481 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:40:09.381362 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:40:09.418210 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a657aee-7afb-4c52-bd3f-60d10d2f40a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35441c061e514b1b9341e7694ec2c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:40:09.418836 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a657aee-7afb-4c52-bd3f-60d10d2f40a3 service nova] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:40:09.419114 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a657aee-7afb-4c52-bd3f-60d10d2f40a3 service nova] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:40:09.419387 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a657aee-7afb-4c52-bd3f-60d10d2f40a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:40:09.421062 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-2a657aee-7afb-4c52-bd3f-60d10d2f40a3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:40:09.513584 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a657aee-7afb-4c52-bd3f-60d10d2f40a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:40:09.515204 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a657aee-7afb-4c52-bd3f-60d10d2f40a3 service nova] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:40:09.534171 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 732/1481] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:40:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:40:11.649141 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9feab6d-dafb-49e2-8760-bb2b8d783c2b None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:40:11.649768 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9feab6d-dafb-49e2-8760-bb2b8d783c2b None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:40:11.649768 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9feab6d-dafb-49e2-8760-bb2b8d783c2b None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:40:11.651168 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 750/1482] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:40:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:40:11.656677 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3761db8-4ba2-4f04-b256-9b03201b2d97 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:40:11.657132 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3761db8-4ba2-4f04-b256-9b03201b2d97 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:40:11.657232 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3761db8-4ba2-4f04-b256-9b03201b2d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:40:11.723534 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-f3761db8-4ba2-4f04-b256-9b03201b2d97 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:40:11.724744 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-f3761db8-4ba2-4f04-b256-9b03201b2d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:40:11.774746 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:40:11.827345 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 733/1483] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:40:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:40:12.113643 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9feab6d-dafb-49e2-8760-bb2b8d783c2b None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:40:12.115173 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-e9feab6d-dafb-49e2-8760-bb2b8d783c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:40:12.139734 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:40:12.220686 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9feab6d-dafb-49e2-8760-bb2b8d783c2b None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:40:12.295401 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c960fbd6-6fcc-4a45-b4ce-970bcc8d1078 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:40:12.296006 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960fbd6-6fcc-4a45-b4ce-970bcc8d1078 service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:40:12.296286 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960fbd6-6fcc-4a45-b4ce-970bcc8d1078 service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:40:12.296821 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960fbd6-6fcc-4a45-b4ce-970bcc8d1078 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:40:12.298445 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-c960fbd6-6fcc-4a45-b4ce-970bcc8d1078 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:40:12.373918 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:40:12.408815 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c960fbd6-6fcc-4a45-b4ce-970bcc8d1078 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:40:12.410316 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c960fbd6-6fcc-4a45-b4ce-970bcc8d1078 service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:40:12.429284 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 751/1484] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:40:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:40:14.407189 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e4ae2-e44b-44d3-827f-710fc6d8c2c6 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:40:14.407619 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e4ae2-e44b-44d3-827f-710fc6d8c2c6 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:40:14.407821 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e4ae2-e44b-44d3-827f-710fc6d8c2c6 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:40:14.409178 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 734/1485] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:40:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:40:14.420662 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a3568-8f39-41c4-9064-98a2121efba3 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:40:14.421440 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a3568-8f39-41c4-9064-98a2121efba3 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:40:14.421569 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a3568-8f39-41c4-9064-98a2121efba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:40:14.489207 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-cc6a3568-8f39-41c4-9064-98a2121efba3 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:40:14.490465 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-cc6a3568-8f39-41c4-9064-98a2121efba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:40:14.591831 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 752/1486] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:40:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:40:14.883014 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e4ae2-e44b-44d3-827f-710fc6d8c2c6 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:40:14.884596 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-cb3e4ae2-e44b-44d3-827f-710fc6d8c2c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:40:14.990694 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e4ae2-e44b-44d3-827f-710fc6d8c2c6 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:40:15.064846 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:40:15.066943 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311b6cef-2aff-4c6e-a21d-a155a4d01226 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:40:15.067886 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b6cef-2aff-4c6e-a21d-a155a4d01226 service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:40:15.068200 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b6cef-2aff-4c6e-a21d-a155a4d01226 service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:40:15.068642 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b6cef-2aff-4c6e-a21d-a155a4d01226 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:40:15.070561 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-311b6cef-2aff-4c6e-a21d-a155a4d01226 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:40:15.303184 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311b6cef-2aff-4c6e-a21d-a155a4d01226 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:40:15.304552 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311b6cef-2aff-4c6e-a21d-a155a4d01226 service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:40:15.323936 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 735/1487] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:40:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:40:17.329272 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088bcc20-a358-49d7-a1e4-54547fcfdfee None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:40:17.329815 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088bcc20-a358-49d7-a1e4-54547fcfdfee None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:40:17.329927 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088bcc20-a358-49d7-a1e4-54547fcfdfee None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:40:17.331191 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 753/1488] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:40:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:40:17.336496 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4cee0b-4c50-4782-b12c-65951156b983 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:40:17.337045 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4cee0b-4c50-4782-b12c-65951156b983 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:40:17.337770 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4cee0b-4c50-4782-b12c-65951156b983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:40:17.402876 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-4e4cee0b-4c50-4782-b12c-65951156b983 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:40:17.404105 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-4e4cee0b-4c50-4782-b12c-65951156b983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:40:17.456601 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:40:17.501206 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 736/1489] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:40:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:40:17.802951 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088bcc20-a358-49d7-a1e4-54547fcfdfee None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:40:17.804518 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-088bcc20-a358-49d7-a1e4-54547fcfdfee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:40:17.841016 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:40:17.910307 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088bcc20-a358-49d7-a1e4-54547fcfdfee None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:40:17.985349 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d5664f-026d-4d5c-8ff8-ebd92878b392 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:40:17.985969 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5664f-026d-4d5c-8ff8-ebd92878b392 service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:40:17.986253 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5664f-026d-4d5c-8ff8-ebd92878b392 service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:40:17.986517 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5664f-026d-4d5c-8ff8-ebd92878b392 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:40:17.988105 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-20d5664f-026d-4d5c-8ff8-ebd92878b392 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:40:18.068992 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:40:18.098732 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d5664f-026d-4d5c-8ff8-ebd92878b392 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:40:18.100176 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d5664f-026d-4d5c-8ff8-ebd92878b392 service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:40:18.119822 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 754/1490] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:40:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:40:20.212717 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ec625-b0ee-4c5f-85ca-8452e5b57d21 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:40:20.213250 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ec625-b0ee-4c5f-85ca-8452e5b57d21 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:40:20.213250 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ec625-b0ee-4c5f-85ca-8452e5b57d21 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:40:20.214652 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 737/1491] 10.222.0.47 () {54 vars in 927 bytes} [Mon Aug 29 22:40:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:40:20.219850 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fbd243-768e-4f65-b602-230808da7c11 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:40:20.220259 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fbd243-768e-4f65-b602-230808da7c11 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:40:20.220397 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fbd243-768e-4f65-b602-230808da7c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:40:20.286710 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-f8fbd243-768e-4f65-b602-230808da7c11 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:40:20.287927 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-f8fbd243-768e-4f65-b602-230808da7c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:40:20.386093 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 755/1492] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Aug 29 22:40:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:40:20.676562 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ec625-b0ee-4c5f-85ca-8452e5b57d21 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:40:20.678152 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-3a6ec625-b0ee-4c5f-85ca-8452e5b57d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:40:20.782117 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ec625-b0ee-4c5f-85ca-8452e5b57d21 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:40:20.856328 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90375726-ffee-42be-92dc-e57669a5571b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:40:20.856927 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90375726-ffee-42be-92dc-e57669a5571b service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:40:20.857201 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90375726-ffee-42be-92dc-e57669a5571b service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:40:20.857497 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90375726-ffee-42be-92dc-e57669a5571b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:40:20.859083 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-90375726-ffee-42be-92dc-e57669a5571b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:40:20.867614 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:40:20.969981 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90375726-ffee-42be-92dc-e57669a5571b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:40:20.971329 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90375726-ffee-42be-92dc-e57669a5571b service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:40:20.989957 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 738/1493] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:40:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:40:30.384207 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=82 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:40:30.987805 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=50 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:34.894831 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48916a1-efdd-422c-8198-acc9dd2cf73e None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:34.895590 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48916a1-efdd-422c-8198-acc9dd2cf73e None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:34.895590 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48916a1-efdd-422c-8198-acc9dd2cf73e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:34.974869 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-f48916a1-efdd-422c-8198-acc9dd2cf73e None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:41:34.976094 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-f48916a1-efdd-422c-8198-acc9dd2cf73e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:41:35.077041 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 756/1494] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:41:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:41:35.084997 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0af88-ae27-4b5b-bdfd-55648e7a4840 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:35.085548 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0af88-ae27-4b5b-bdfd-55648e7a4840 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:35.085689 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0af88-ae27-4b5b-bdfd-55648e7a4840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:35.162021 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-76b0af88-ae27-4b5b-bdfd-55648e7a4840 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:41:35.163171 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-76b0af88-ae27-4b5b-bdfd-55648e7a4840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:41:35.264758 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 739/1495] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:41:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:41:35.270571 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48916a1-efdd-422c-8198-acc9dd2cf73e None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:35.271871 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-f48916a1-efdd-422c-8198-acc9dd2cf73e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:41:35.283845 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48916a1-efdd-422c-8198-acc9dd2cf73e None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:35.347595 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:35.381539 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4fbd9b-2e2d-4dab-b524-b028fb42fe1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:35.382143 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4fbd9b-2e2d-4dab-b524-b028fb42fe1b admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:35.382423 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4fbd9b-2e2d-4dab-b524-b028fb42fe1b admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:35.382695 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4fbd9b-2e2d-4dab-b524-b028fb42fe1b admin admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:35.383337 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4fbd9b-2e2d-4dab-b524-b028fb42fe1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:41:35.383636 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4fbd9b-2e2d-4dab-b524-b028fb42fe1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:35.384802 dv-cinder-854270-4-smb devstack@keystone.service[88339]: WARNING py.warnings [None req-bb4fbd9b-2e2d-4dab-b524-b028fb42fe1b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 22:41:35.384802 dv-cinder-854270-4-smb devstack@keystone.service[88339]: warnings.warn(msg) Aug 29 22:41:35.384802 dv-cinder-854270-4-smb devstack@keystone.service[88339]: Aug 29 22:41:35.385726 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4fbd9b-2e2d-4dab-b524-b028fb42fe1b admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:35.397391 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 757/1496] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Aug 29 22:41:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:41:35.406281 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b0af88-ae27-4b5b-bdfd-55648e7a4840 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:35.416336 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b0af88-ae27-4b5b-bdfd-55648e7a4840 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:35.476562 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:35.512515 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce91a568-a518-479a-b973-92ee2823a5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:35.513124 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91a568-a518-479a-b973-92ee2823a5c2 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:35.513431 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91a568-a518-479a-b973-92ee2823a5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:35.513704 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91a568-a518-479a-b973-92ee2823a5c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:35.514346 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce91a568-a518-479a-b973-92ee2823a5c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:35.516087 dv-cinder-854270-4-smb devstack@keystone.service[88338]: WARNING py.warnings [None req-ce91a568-a518-479a-b973-92ee2823a5c2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 22:41:35.516087 dv-cinder-854270-4-smb devstack@keystone.service[88338]: warnings.warn(msg) Aug 29 22:41:35.516087 dv-cinder-854270-4-smb devstack@keystone.service[88338]: Aug 29 22:41:35.517306 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce91a568-a518-479a-b973-92ee2823a5c2 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:35.574634 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 740/1497] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:41:35 2022] POST /identity/v3/projects => generated 379 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:41:35.578986 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4fbd9b-2e2d-4dab-b524-b028fb42fe1b admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:35.580571 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-bb4fbd9b-2e2d-4dab-b524-b028fb42fe1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:41:35.615369 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4fbd9b-2e2d-4dab-b524-b028fb42fe1b admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:35.710789 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb91796-c78f-460d-a98a-ea8fc96d63a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:35.711310 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb91796-c78f-460d-a98a-ea8fc96d63a2 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:35.711584 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb91796-c78f-460d-a98a-ea8fc96d63a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:35.711853 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb91796-c78f-460d-a98a-ea8fc96d63a2 admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:35.713307 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb91796-c78f-460d-a98a-ea8fc96d63a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:35.714106 dv-cinder-854270-4-smb devstack@keystone.service[88339]: WARNING py.warnings [None req-1fb91796-c78f-460d-a98a-ea8fc96d63a2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 22:41:35.714106 dv-cinder-854270-4-smb devstack@keystone.service[88339]: warnings.warn(msg) Aug 29 22:41:35.714106 dv-cinder-854270-4-smb devstack@keystone.service[88339]: Aug 29 22:41:35.715313 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb91796-c78f-460d-a98a-ea8fc96d63a2 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:35.757871 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 758/1498] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:41:35 2022] POST /identity/v3/users => generated 290 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:41:35.762493 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce91a568-a518-479a-b973-92ee2823a5c2 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:35.764101 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-ce91a568-a518-479a-b973-92ee2823a5c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:41:35.826891 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce91a568-a518-479a-b973-92ee2823a5c2 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:35.911440 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:35.923499 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc26b9-3309-4bd1-85ae-61778fd46cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:35.924112 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc26b9-3309-4bd1-85ae-61778fd46cc4 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:35.924390 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc26b9-3309-4bd1-85ae-61778fd46cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:35.924662 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc26b9-3309-4bd1-85ae-61778fd46cc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:35.925301 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbc26b9-3309-4bd1-85ae-61778fd46cc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:35.926355 dv-cinder-854270-4-smb devstack@keystone.service[88338]: WARNING py.warnings [None req-1cbc26b9-3309-4bd1-85ae-61778fd46cc4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 22:41:35.926355 dv-cinder-854270-4-smb devstack@keystone.service[88338]: warnings.warn(msg) Aug 29 22:41:35.926355 dv-cinder-854270-4-smb devstack@keystone.service[88338]: Aug 29 22:41:35.927244 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbc26b9-3309-4bd1-85ae-61778fd46cc4 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:35.940082 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 741/1499] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:41:35 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:41:35.944159 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb91796-c78f-460d-a98a-ea8fc96d63a2 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:35.945688 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-1fb91796-c78f-460d-a98a-ea8fc96d63a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:41:35.957699 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb91796-c78f-460d-a98a-ea8fc96d63a2 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:35.983369 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:36.054910 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68f68e2-1686-4999-a9a5-7e211d6d29b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:36.055514 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f68e2-1686-4999-a9a5-7e211d6d29b6 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:36.056465 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f68e2-1686-4999-a9a5-7e211d6d29b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:36.056800 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f68e2-1686-4999-a9a5-7e211d6d29b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:36.057550 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68f68e2-1686-4999-a9a5-7e211d6d29b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:36.058562 dv-cinder-854270-4-smb devstack@keystone.service[88339]: WARNING py.warnings [None req-d68f68e2-1686-4999-a9a5-7e211d6d29b6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 22:41:36.058562 dv-cinder-854270-4-smb devstack@keystone.service[88339]: warnings.warn(msg) Aug 29 22:41:36.058562 dv-cinder-854270-4-smb devstack@keystone.service[88339]: Aug 29 22:41:36.059528 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68f68e2-1686-4999-a9a5-7e211d6d29b6 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:36.072230 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 759/1500] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:41:35 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:41:36.076424 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc26b9-3309-4bd1-85ae-61778fd46cc4 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:36.077972 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-1cbc26b9-3309-4bd1-85ae-61778fd46cc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:41:36.114179 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc26b9-3309-4bd1-85ae-61778fd46cc4 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:36.209110 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e14ae21-3712-467b-8506-1d46c0d8ea29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:36.209819 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14ae21-3712-467b-8506-1d46c0d8ea29 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:36.210098 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14ae21-3712-467b-8506-1d46c0d8ea29 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:36.210368 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14ae21-3712-467b-8506-1d46c0d8ea29 admin admin] PATH_INFO: `/v3/projects/b87030b3446d4ae293f934a7b062fbf5/users/ceebdc7510734c4cb05cc4b9e309b434/roles/0c67797d444d4c929b2ccab47c468848` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:36.233346 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e14ae21-3712-467b-8506-1d46c0d8ea29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b87030b3446d4ae293f934a7b062fbf5, user_id=ceebdc7510734c4cb05cc4b9e309b434, role_id=0c67797d444d4c929b2ccab47c468848)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:36.234435 dv-cinder-854270-4-smb devstack@keystone.service[88338]: WARNING py.warnings [None req-0e14ae21-3712-467b-8506-1d46c0d8ea29 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 22:41:36.234435 dv-cinder-854270-4-smb devstack@keystone.service[88338]: warnings.warn(msg) Aug 29 22:41:36.234435 dv-cinder-854270-4-smb devstack@keystone.service[88338]: Aug 29 22:41:36.236326 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e14ae21-3712-467b-8506-1d46c0d8ea29 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:36.260458 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 742/1501] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:41:36 2022] PUT /identity/v3/projects/b87030b3446d4ae293f934a7b062fbf5/users/ceebdc7510734c4cb05cc4b9e309b434/roles/0c67797d444d4c929b2ccab47c468848 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:41:36.272634 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08096e9-6a72-4e6e-8ef6-ba89a33679ad None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:36.272982 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08096e9-6a72-4e6e-8ef6-ba89a33679ad None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:36.273268 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08096e9-6a72-4e6e-8ef6-ba89a33679ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:36.332331 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-b08096e9-6a72-4e6e-8ef6-ba89a33679ad None None] MFA Rules not processed for user `ceebdc7510734c4cb05cc4b9e309b434`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:41:36.333961 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-b08096e9-6a72-4e6e-8ef6-ba89a33679ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:41:36.412485 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 760/1502] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:41:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:41:36.426082 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a26da18-667c-4390-8871-1dddd771ac78 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:36.426370 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a26da18-667c-4390-8871-1dddd771ac78 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:36.426644 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a26da18-667c-4390-8871-1dddd771ac78 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:36.427976 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 743/1503] 10.222.0.47 () {54 vars in 964 bytes} [Mon Aug 29 22:41:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:41:36.432697 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3577418-8ff7-4770-a3fd-c5f458eda1f6 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:36.432983 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3577418-8ff7-4770-a3fd-c5f458eda1f6 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:36.433256 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3577418-8ff7-4770-a3fd-c5f458eda1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:36.465229 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:36.510120 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-c3577418-8ff7-4770-a3fd-c5f458eda1f6 None None] MFA Rules not processed for user `d6a05d7ad37e4547bada8aabc0fcb64b`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:41:36.511240 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-c3577418-8ff7-4770-a3fd-c5f458eda1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:41:36.586285 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 761/1504] 10.222.0.47 () {58 vars in 1061 bytes} [Mon Aug 29 22:41:36 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:41:36.595112 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a26da18-667c-4390-8871-1dddd771ac78 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:36.596634 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-9a26da18-667c-4390-8871-1dddd771ac78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:41:36.647596 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:36.703127 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a26da18-667c-4390-8871-1dddd771ac78 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:36.777905 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40106124-1ff1-431e-810d-1f82e6221c3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:36.778427 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40106124-1ff1-431e-810d-1f82e6221c3c service cinder] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:36.778706 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40106124-1ff1-431e-810d-1f82e6221c3c service cinder] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:36.778976 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40106124-1ff1-431e-810d-1f82e6221c3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:36.780559 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-40106124-1ff1-431e-810d-1f82e6221c3c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:41:36.878954 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40106124-1ff1-431e-810d-1f82e6221c3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:36.880415 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40106124-1ff1-431e-810d-1f82e6221c3c service cinder] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:36.884616 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:36.899956 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 744/1505] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:41:36 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:41:36.944916 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e84a4-705e-4609-9c9f-8e0b63649dc2 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:36.945316 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e84a4-705e-4609-9c9f-8e0b63649dc2 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:36.945503 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e84a4-705e-4609-9c9f-8e0b63649dc2 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:36.947499 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 762/1506] 10.222.0.47 () {52 vars in 830 bytes} [Mon Aug 29 22:41:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:41:36.951225 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40106124-1ff1-431e-810d-1f82e6221c3c service cinder] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:36.952430 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-40106124-1ff1-431e-810d-1f82e6221c3c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:41:37.051485 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40106124-1ff1-431e-810d-1f82e6221c3c service cinder] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:37.145701 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5430be64-c53a-4758-8e9e-ae5809fdfd44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:37.146404 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430be64-c53a-4758-8e9e-ae5809fdfd44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:37.146598 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430be64-c53a-4758-8e9e-ae5809fdfd44 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:37.146868 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430be64-c53a-4758-8e9e-ae5809fdfd44 admin admin] PATH_INFO: `/v3/users/ceebdc7510734c4cb05cc4b9e309b434` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:37.159935 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5430be64-c53a-4758-8e9e-ae5809fdfd44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ceebdc7510734c4cb05cc4b9e309b434)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:37.160955 dv-cinder-854270-4-smb devstack@keystone.service[88338]: WARNING py.warnings [None req-5430be64-c53a-4758-8e9e-ae5809fdfd44 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 22:41:37.160955 dv-cinder-854270-4-smb devstack@keystone.service[88338]: warnings.warn(msg) Aug 29 22:41:37.160955 dv-cinder-854270-4-smb devstack@keystone.service[88338]: Aug 29 22:41:37.163919 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5430be64-c53a-4758-8e9e-ae5809fdfd44 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:37.174321 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:37.231649 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-5430be64-c53a-4758-8e9e-ae5809fdfd44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ceebdc7510734c4cb05cc4b9e309b434'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:41:37.245838 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-5430be64-c53a-4758-8e9e-ae5809fdfd44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ceebdc7510734c4cb05cc4b9e309b434'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:41:37.246388 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-5430be64-c53a-4758-8e9e-ae5809fdfd44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ceebdc7510734c4cb05cc4b9e309b434'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:41:37.268875 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-5430be64-c53a-4758-8e9e-ae5809fdfd44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ceebdc7510734c4cb05cc4b9e309b434'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:41:37.279058 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-5430be64-c53a-4758-8e9e-ae5809fdfd44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ceebdc7510734c4cb05cc4b9e309b434'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:41:37.285759 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 745/1507] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:41:36 2022] DELETE /identity/v3/users/ceebdc7510734c4cb05cc4b9e309b434 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:41:37.291012 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1600827c-3ce4-4584-a174-564e3619456c None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:37.291297 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1600827c-3ce4-4584-a174-564e3619456c None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:37.291569 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1600827c-3ce4-4584-a174-564e3619456c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:37.348434 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-1600827c-3ce4-4584-a174-564e3619456c None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:41:37.349681 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-1600827c-3ce4-4584-a174-564e3619456c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:41:37.424216 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:37.438188 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 763/1508] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:41:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:41:37.447816 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5430be64-c53a-4758-8e9e-ae5809fdfd44 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:37.449052 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-5430be64-c53a-4758-8e9e-ae5809fdfd44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:41:37.551046 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5430be64-c53a-4758-8e9e-ae5809fdfd44 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:37.611688 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:37.632904 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d37318-1fcf-4e44-a40f-bbd12843bcb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:37.633586 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d37318-1fcf-4e44-a40f-bbd12843bcb4 service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:37.633845 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d37318-1fcf-4e44-a40f-bbd12843bcb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:37.634109 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d37318-1fcf-4e44-a40f-bbd12843bcb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:37.635696 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-a3d37318-1fcf-4e44-a40f-bbd12843bcb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:41:37.743115 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d37318-1fcf-4e44-a40f-bbd12843bcb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:37.744558 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d37318-1fcf-4e44-a40f-bbd12843bcb4 service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:37.762871 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 746/1509] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:41:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:41:38.104014 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1600827c-3ce4-4584-a174-564e3619456c None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:41:38.105379 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-1600827c-3ce4-4584-a174-564e3619456c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:41:38.119432 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1600827c-3ce4-4584-a174-564e3619456c None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:41:38.216241 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113edc5c-e3d4-41d4-8f9c-d7662c03831d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:41:38.216780 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113edc5c-e3d4-41d4-8f9c-d7662c03831d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:41:38.217053 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113edc5c-e3d4-41d4-8f9c-d7662c03831d admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:41:38.217319 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113edc5c-e3d4-41d4-8f9c-d7662c03831d admin admin] PATH_INFO: `/v3/projects/b87030b3446d4ae293f934a7b062fbf5` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:41:38.227012 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113edc5c-e3d4-41d4-8f9c-d7662c03831d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b87030b3446d4ae293f934a7b062fbf5)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:41:38.228134 dv-cinder-854270-4-smb devstack@keystone.service[88339]: WARNING py.warnings [None req-113edc5c-e3d4-41d4-8f9c-d7662c03831d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 22:41:38.228134 dv-cinder-854270-4-smb devstack@keystone.service[88339]: warnings.warn(msg) Aug 29 22:41:38.228134 dv-cinder-854270-4-smb devstack@keystone.service[88339]: Aug 29 22:41:38.229356 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113edc5c-e3d4-41d4-8f9c-d7662c03831d admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:41:38.289345 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-113edc5c-e3d4-41d4-8f9c-d7662c03831d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b87030b3446d4ae293f934a7b062fbf5', 'request_id': 'req-113edc5c-e3d4-41d4-8f9c-d7662c03831d'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:41:38.302605 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-113edc5c-e3d4-41d4-8f9c-d7662c03831d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b87030b3446d4ae293f934a7b062fbf5', 'request_id': 'req-113edc5c-e3d4-41d4-8f9c-d7662c03831d'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:41:38.309554 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-113edc5c-e3d4-41d4-8f9c-d7662c03831d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b87030b3446d4ae293f934a7b062fbf5', 'request_id': 'req-113edc5c-e3d4-41d4-8f9c-d7662c03831d'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:41:38.336036 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-113edc5c-e3d4-41d4-8f9c-d7662c03831d admin admin] The token cache is being invalidate because project b87030b3446d4ae293f934a7b062fbf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:41:38.336327 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-113edc5c-e3d4-41d4-8f9c-d7662c03831d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:41:38.337942 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-113edc5c-e3d4-41d4-8f9c-d7662c03831d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:41:38.338339 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 764/1510] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:41:38 2022] DELETE /identity/v3/projects/b87030b3446d4ae293f934a7b062fbf5 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:41:47.760601 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=62 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:48.333992 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:23.447932 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb2bb89-0bd0-457c-b6a4-1a43be1d7478 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:23.448529 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb2bb89-0bd0-457c-b6a4-1a43be1d7478 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:23.448529 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb2bb89-0bd0-457c-b6a4-1a43be1d7478 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:23.449976 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 747/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 22:43:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:43:23.455061 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c01c19-cb66-49fe-a53d-14553b424101 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:23.455515 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c01c19-cb66-49fe-a53d-14553b424101 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:23.455619 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c01c19-cb66-49fe-a53d-14553b424101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:23.537597 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-43c01c19-cb66-49fe-a53d-14553b424101 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:43:23.538817 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-43c01c19-cb66-49fe-a53d-14553b424101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:43:23.642703 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 765/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 22:43:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:43:23.794807 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb2bb89-0bd0-457c-b6a4-1a43be1d7478 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:43:23.796921 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-2cb2bb89-0bd0-457c-b6a4-1a43be1d7478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:43:23.917276 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb2bb89-0bd0-457c-b6a4-1a43be1d7478 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:43:23.922767 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b39ac-2470-4ee2-9d4d-18ac4e695a04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35441c061e514b1b9341e7694ec2c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:43:23.923370 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b39ac-2470-4ee2-9d4d-18ac4e695a04 service nova] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:23.923651 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b39ac-2470-4ee2-9d4d-18ac4e695a04 service nova] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:23.923926 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b39ac-2470-4ee2-9d4d-18ac4e695a04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:23.932889 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641b39ac-2470-4ee2-9d4d-18ac4e695a04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:43:23.934527 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641b39ac-2470-4ee2-9d4d-18ac4e695a04 service nova] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:43:23.944192 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 748/1513] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:43:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:43:24.772115 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d665b9-c34f-415b-9c2a-ca9a780b4e66 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:24.772690 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d665b9-c34f-415b-9c2a-ca9a780b4e66 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:24.772690 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d665b9-c34f-415b-9c2a-ca9a780b4e66 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:24.774077 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 766/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 22:43:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:43:24.779178 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd6a3a-3e59-4ee4-b4c8-a7e5bb54b31a None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:24.779634 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd6a3a-3e59-4ee4-b4c8-a7e5bb54b31a None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:24.779738 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd6a3a-3e59-4ee4-b4c8-a7e5bb54b31a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:24.800055 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-2efd6a3a-3e59-4ee4-b4c8-a7e5bb54b31a None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:43:24.801309 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-2efd6a3a-3e59-4ee4-b4c8-a7e5bb54b31a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:43:24.809276 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 749/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 22:43:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:43:24.962747 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d665b9-c34f-415b-9c2a-ca9a780b4e66 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:43:24.978608 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d665b9-c34f-415b-9c2a-ca9a780b4e66 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:43:24.984084 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbda7be-1c45-421c-945f-8bab192e62e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35441c061e514b1b9341e7694ec2c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:43:24.984682 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbda7be-1c45-421c-945f-8bab192e62e2 service nova] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:24.984966 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbda7be-1c45-421c-945f-8bab192e62e2 service nova] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:24.985245 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbda7be-1c45-421c-945f-8bab192e62e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:24.993556 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbda7be-1c45-421c-945f-8bab192e62e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:43:24.995155 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbda7be-1c45-421c-945f-8bab192e62e2 service nova] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:43:25.004718 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 767/1516] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:43:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:43:28.858960 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955130b9-bea4-4110-aeaa-1fe1eac15580 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:28.859495 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955130b9-bea4-4110-aeaa-1fe1eac15580 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:28.859495 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955130b9-bea4-4110-aeaa-1fe1eac15580 None None] PATH_INFO: `/v3` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:28.860668 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 750/1517] 10.222.0.18 () {54 vars in 925 bytes} [Mon Aug 29 22:43:28 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:43:28.868624 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba1c6f9-87e5-4732-8662-95e9fb4e7e09 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:28.869056 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba1c6f9-87e5-4732-8662-95e9fb4e7e09 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:28.869209 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba1c6f9-87e5-4732-8662-95e9fb4e7e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:28.929292 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-0ba1c6f9-87e5-4732-8662-95e9fb4e7e09 None None] MFA Rules not processed for user `296cbef772104e078971ba93aa2e022c`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:43:28.930586 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-0ba1c6f9-87e5-4732-8662-95e9fb4e7e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:43:28.947554 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:29.003892 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 768/1518] 10.222.0.18 () {58 vars in 1015 bytes} [Mon Aug 29 22:43:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:43:33.523156 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35798a40-aa03-4d23-80ce-b74b9f27b6b8 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:33.523684 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35798a40-aa03-4d23-80ce-b74b9f27b6b8 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:33.523684 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35798a40-aa03-4d23-80ce-b74b9f27b6b8 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:33.524936 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 751/1519] 10.222.0.47 () {54 vars in 961 bytes} [Mon Aug 29 22:43:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:43:33.530125 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ced714-eab0-41ef-92f9-21aa3a84d0be None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:33.530568 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ced714-eab0-41ef-92f9-21aa3a84d0be None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:33.530675 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ced714-eab0-41ef-92f9-21aa3a84d0be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:33.552179 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-f7ced714-eab0-41ef-92f9-21aa3a84d0be None None] MFA Rules not processed for user `296cbef772104e078971ba93aa2e022c`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:43:33.553452 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-f7ced714-eab0-41ef-92f9-21aa3a84d0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:43:33.561946 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 769/1520] 10.222.0.47 () {58 vars in 1058 bytes} [Mon Aug 29 22:43:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:43:33.570112 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35798a40-aa03-4d23-80ce-b74b9f27b6b8 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:43:33.583924 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35798a40-aa03-4d23-80ce-b74b9f27b6b8 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:43:33.588847 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1216b614-bd33-4c33-9f67-9de1e47f9c01 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296cbef772104e078971ba93aa2e022c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:43:33.589473 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1216b614-bd33-4c33-9f67-9de1e47f9c01 service placement] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:33.589753 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1216b614-bd33-4c33-9f67-9de1e47f9c01 service placement] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:33.590025 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1216b614-bd33-4c33-9f67-9de1e47f9c01 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:33.598478 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1216b614-bd33-4c33-9f67-9de1e47f9c01 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:43:33.600069 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1216b614-bd33-4c33-9f67-9de1e47f9c01 service placement] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:43:33.610080 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 752/1521] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:43:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:43:36.228841 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcacb736-ad74-4869-ba27-945f9879b7c7 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:36.229456 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcacb736-ad74-4869-ba27-945f9879b7c7 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:36.229456 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcacb736-ad74-4869-ba27-945f9879b7c7 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:36.230763 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 770/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 22:43:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:43:36.235682 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68139623-a8b9-46fc-a7af-8ca2ca4c0643 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:36.236104 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68139623-a8b9-46fc-a7af-8ca2ca4c0643 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:36.236221 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68139623-a8b9-46fc-a7af-8ca2ca4c0643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:36.255781 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-68139623-a8b9-46fc-a7af-8ca2ca4c0643 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:43:36.257031 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-68139623-a8b9-46fc-a7af-8ca2ca4c0643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:43:36.264917 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 753/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 22:43:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:43:36.423775 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcacb736-ad74-4869-ba27-945f9879b7c7 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:43:36.438526 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcacb736-ad74-4869-ba27-945f9879b7c7 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:43:36.444618 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30bc8b5-9c68-4e67-b3d1-60b4a80ebf44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35441c061e514b1b9341e7694ec2c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:43:36.445213 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30bc8b5-9c68-4e67-b3d1-60b4a80ebf44 service nova] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:36.445525 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30bc8b5-9c68-4e67-b3d1-60b4a80ebf44 service nova] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:36.445799 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30bc8b5-9c68-4e67-b3d1-60b4a80ebf44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:36.453825 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30bc8b5-9c68-4e67-b3d1-60b4a80ebf44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:43:36.455403 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30bc8b5-9c68-4e67-b3d1-60b4a80ebf44 service nova] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:43:36.465503 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 771/1524] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:43:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:43:37.302416 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad8ced-fe12-45f6-a7d4-236ec49527bc None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:37.302921 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad8ced-fe12-45f6-a7d4-236ec49527bc None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:37.302921 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad8ced-fe12-45f6-a7d4-236ec49527bc None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:37.304398 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 754/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 22:43:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:43:37.309533 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7384dc9f-c8ff-4db0-b04b-c207ad4073cd None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:37.309921 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7384dc9f-c8ff-4db0-b04b-c207ad4073cd None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:37.310075 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7384dc9f-c8ff-4db0-b04b-c207ad4073cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:37.330072 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-7384dc9f-c8ff-4db0-b04b-c207ad4073cd None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:43:37.331257 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-7384dc9f-c8ff-4db0-b04b-c207ad4073cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:43:37.339810 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 772/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 22:43:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:43:37.495416 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ad8ced-fe12-45f6-a7d4-236ec49527bc None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:43:37.509527 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ad8ced-fe12-45f6-a7d4-236ec49527bc None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:43:37.514882 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b7a16-a6d1-4ab1-8ef4-09b62c22cc26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35441c061e514b1b9341e7694ec2c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:43:37.515471 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b7a16-a6d1-4ab1-8ef4-09b62c22cc26 service nova] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:37.515746 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b7a16-a6d1-4ab1-8ef4-09b62c22cc26 service nova] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:37.516017 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b7a16-a6d1-4ab1-8ef4-09b62c22cc26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:37.524545 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3b7a16-a6d1-4ab1-8ef4-09b62c22cc26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:43:37.526151 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3b7a16-a6d1-4ab1-8ef4-09b62c22cc26 service nova] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:43:37.536228 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 755/1527] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:43:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:43:41.375350 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fbea35-3e14-40cf-a07b-94e29a5739c8 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:41.375928 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fbea35-3e14-40cf-a07b-94e29a5739c8 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:41.375928 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fbea35-3e14-40cf-a07b-94e29a5739c8 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:41.377232 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 773/1528] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 22:43:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:43:41.382627 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d549c49-3d57-4c12-a8dc-33ef41c3e4c7 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:41.383088 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d549c49-3d57-4c12-a8dc-33ef41c3e4c7 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:41.383194 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d549c49-3d57-4c12-a8dc-33ef41c3e4c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:41.403592 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-7d549c49-3d57-4c12-a8dc-33ef41c3e4c7 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:43:41.405115 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-7d549c49-3d57-4c12-a8dc-33ef41c3e4c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:43:41.415139 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 756/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 22:43:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:43:41.701658 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fbea35-3e14-40cf-a07b-94e29a5739c8 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:43:41.703369 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-a2fbea35-3e14-40cf-a07b-94e29a5739c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:43:41.786918 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fbea35-3e14-40cf-a07b-94e29a5739c8 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:43:41.790536 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b84287-0ff7-41c3-84ee-53a13e4b02cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:43:41.791138 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b84287-0ff7-41c3-84ee-53a13e4b02cb service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:41.791419 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b84287-0ff7-41c3-84ee-53a13e4b02cb service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:41.791687 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b84287-0ff7-41c3-84ee-53a13e4b02cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:41.800833 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b84287-0ff7-41c3-84ee-53a13e4b02cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:43:41.802363 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b84287-0ff7-41c3-84ee-53a13e4b02cb service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:43:41.811694 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 774/1530] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:43:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:43:43.740750 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd007e6-5929-4f63-80a0-42fdd9bafe1a None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:43.741316 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd007e6-5929-4f63-80a0-42fdd9bafe1a None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:43.741316 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd007e6-5929-4f63-80a0-42fdd9bafe1a None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:43.742715 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 757/1531] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 22:43:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:43:43.748012 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a57db2f-bd26-4890-b60f-3cd4519d8f65 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:43.748475 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a57db2f-bd26-4890-b60f-3cd4519d8f65 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:43.748580 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a57db2f-bd26-4890-b60f-3cd4519d8f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:43.768114 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-0a57db2f-bd26-4890-b60f-3cd4519d8f65 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:43:43.770305 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-0a57db2f-bd26-4890-b60f-3cd4519d8f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:43:43.777750 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 775/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 22:43:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:43:44.070616 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd007e6-5929-4f63-80a0-42fdd9bafe1a None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:43:44.081619 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd007e6-5929-4f63-80a0-42fdd9bafe1a None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:43:44.085425 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cabc6a4-afc0-44fe-a4a6-99b391fbd547 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:43:44.086058 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cabc6a4-afc0-44fe-a4a6-99b391fbd547 service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:44.086340 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cabc6a4-afc0-44fe-a4a6-99b391fbd547 service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:44.086617 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cabc6a4-afc0-44fe-a4a6-99b391fbd547 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:44.095489 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cabc6a4-afc0-44fe-a4a6-99b391fbd547 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:43:44.096921 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cabc6a4-afc0-44fe-a4a6-99b391fbd547 service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:43:44.106845 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 758/1533] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:43:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:43:47.674856 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5502c222-030a-4776-849f-a55b29426ad9 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:47.675510 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5502c222-030a-4776-849f-a55b29426ad9 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:47.675510 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5502c222-030a-4776-849f-a55b29426ad9 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:47.676754 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 776/1534] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 22:43:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:43:47.681898 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07718f07-f769-4cae-af28-ae300e333b14 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:47.682361 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07718f07-f769-4cae-af28-ae300e333b14 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:47.682491 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07718f07-f769-4cae-af28-ae300e333b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:47.702441 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-07718f07-f769-4cae-af28-ae300e333b14 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:43:47.703635 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-07718f07-f769-4cae-af28-ae300e333b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:43:47.712163 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 759/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 22:43:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:43:48.266355 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5502c222-030a-4776-849f-a55b29426ad9 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:43:48.268126 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-5502c222-030a-4776-849f-a55b29426ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:43:48.335615 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:48.349874 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5502c222-030a-4776-849f-a55b29426ad9 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:43:48.353487 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca82ff9-9bd4-444c-abef-4217d3ab91e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:43:48.354094 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca82ff9-9bd4-444c-abef-4217d3ab91e7 service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:48.354377 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca82ff9-9bd4-444c-abef-4217d3ab91e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:48.354650 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca82ff9-9bd4-444c-abef-4217d3ab91e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:48.364269 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca82ff9-9bd4-444c-abef-4217d3ab91e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:43:48.365736 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca82ff9-9bd4-444c-abef-4217d3ab91e7 service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:43:48.375082 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 777/1536] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:43:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:43:50.305676 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6cfd3a-fe40-43ef-bfd9-46fa69b553e4 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:50.306247 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6cfd3a-fe40-43ef-bfd9-46fa69b553e4 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:50.306247 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6cfd3a-fe40-43ef-bfd9-46fa69b553e4 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:50.307582 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 760/1537] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 22:43:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:43:50.312782 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79271dc3-7bf1-4091-b579-7d1d546686b8 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:50.313239 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79271dc3-7bf1-4091-b579-7d1d546686b8 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:50.313367 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79271dc3-7bf1-4091-b579-7d1d546686b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:50.333627 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-79271dc3-7bf1-4091-b579-7d1d546686b8 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:43:50.334883 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-79271dc3-7bf1-4091-b579-7d1d546686b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:43:50.342974 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 778/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 22:43:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:43:50.895209 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6cfd3a-fe40-43ef-bfd9-46fa69b553e4 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:43:50.896950 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-4f6cfd3a-fe40-43ef-bfd9-46fa69b553e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:43:50.904679 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=84 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:50.911106 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6cfd3a-fe40-43ef-bfd9-46fa69b553e4 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:43:50.914589 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a74d70-9c12-415c-9e37-58612525c182 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:43:50.915211 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a74d70-9c12-415c-9e37-58612525c182 service cinder] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:43:50.915488 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a74d70-9c12-415c-9e37-58612525c182 service cinder] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:43:50.915757 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a74d70-9c12-415c-9e37-58612525c182 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:43:50.924588 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a74d70-9c12-415c-9e37-58612525c182 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:43:50.926551 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a74d70-9c12-415c-9e37-58612525c182 service cinder] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:43:50.935877 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 761/1539] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:43:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:44:00.328544 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=11 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:44:00.931743 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=5 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:22.346276 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25a996-f8e9-4a47-96b0-91e7e27571bb None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:22.347257 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25a996-f8e9-4a47-96b0-91e7e27571bb None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:22.347257 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25a996-f8e9-4a47-96b0-91e7e27571bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:22.374404 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-6b25a996-f8e9-4a47-96b0-91e7e27571bb None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:22.375642 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-6b25a996-f8e9-4a47-96b0-91e7e27571bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:22.390443 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 779/1540] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:45:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:45:22.400380 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd5b2ba-da31-4db7-a72a-bee70dfbf358 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:22.401250 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd5b2ba-da31-4db7-a72a-bee70dfbf358 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:22.401462 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd5b2ba-da31-4db7-a72a-bee70dfbf358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:22.412147 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca2c87-d099-4cca-8160-43d9754b918c None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:22.412415 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca2c87-d099-4cca-8160-43d9754b918c None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:22.412746 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca2c87-d099-4cca-8160-43d9754b918c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:22.453539 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-6dd5b2ba-da31-4db7-a72a-bee70dfbf358 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:22.453539 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-6dd5b2ba-da31-4db7-a72a-bee70dfbf358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:22.459386 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-31ca2c87-d099-4cca-8160-43d9754b918c None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:22.461757 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-31ca2c87-d099-4cca-8160-43d9754b918c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:22.480386 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 762/1541] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:45:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:45:22.486588 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd5b2ba-da31-4db7-a72a-bee70dfbf358 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:22.488730 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 780/1542] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:45:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:45:22.511314 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd5b2ba-da31-4db7-a72a-bee70dfbf358 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:22.519123 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e734d3d-61eb-4d76-b6e3-dd225b3f5bd9 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:22.519888 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e734d3d-61eb-4d76-b6e3-dd225b3f5bd9 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:22.521196 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e734d3d-61eb-4d76-b6e3-dd225b3f5bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:22.525182 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925530db-f35f-4339-be80-e59ba6abaa64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:22.526155 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925530db-f35f-4339-be80-e59ba6abaa64 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:22.526578 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925530db-f35f-4339-be80-e59ba6abaa64 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:22.527211 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925530db-f35f-4339-be80-e59ba6abaa64 admin admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:22.528431 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925530db-f35f-4339-be80-e59ba6abaa64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:45:22.529282 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925530db-f35f-4339-be80-e59ba6abaa64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:22.531119 dv-cinder-854270-4-smb devstack@keystone.service[88338]: WARNING py.warnings [None req-925530db-f35f-4339-be80-e59ba6abaa64 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 22:45:22.531119 dv-cinder-854270-4-smb devstack@keystone.service[88338]: warnings.warn(msg) Aug 29 22:45:22.531119 dv-cinder-854270-4-smb devstack@keystone.service[88338]: Aug 29 22:45:22.532923 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925530db-f35f-4339-be80-e59ba6abaa64 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:22.560860 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 763/1543] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Aug 29 22:45:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:45:22.571224 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925530db-f35f-4339-be80-e59ba6abaa64 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:22.571412 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-7e734d3d-61eb-4d76-b6e3-dd225b3f5bd9 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:22.574179 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-7e734d3d-61eb-4d76-b6e3-dd225b3f5bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:22.593967 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925530db-f35f-4339-be80-e59ba6abaa64 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:22.596532 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 781/1544] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:45:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:45:22.604525 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e734d3d-61eb-4d76-b6e3-dd225b3f5bd9 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:22.612103 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76545fd2-d11f-4c0e-aef1-1377b11909f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:22.613131 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76545fd2-d11f-4c0e-aef1-1377b11909f4 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:22.613700 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76545fd2-d11f-4c0e-aef1-1377b11909f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:22.614171 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76545fd2-d11f-4c0e-aef1-1377b11909f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:22.615312 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76545fd2-d11f-4c0e-aef1-1377b11909f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:22.618922 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76545fd2-d11f-4c0e-aef1-1377b11909f4 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:22.626086 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e734d3d-61eb-4d76-b6e3-dd225b3f5bd9 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:22.641572 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f34034-36f7-454e-8884-bf85a2903fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:22.642529 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f34034-36f7-454e-8884-bf85a2903fe9 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:22.643834 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f34034-36f7-454e-8884-bf85a2903fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:22.644307 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f34034-36f7-454e-8884-bf85a2903fe9 admin admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:22.647060 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f34034-36f7-454e-8884-bf85a2903fe9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:45:22.647684 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f34034-36f7-454e-8884-bf85a2903fe9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:22.654463 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f34034-36f7-454e-8884-bf85a2903fe9 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:22.691522 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 782/1545] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Aug 29 22:45:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:45:22.719700 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f34034-36f7-454e-8884-bf85a2903fe9 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:22.732051 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 764/1546] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:45:22 2022] POST /identity/v3/projects => generated 393 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:45:22.738629 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76545fd2-d11f-4c0e-aef1-1377b11909f4 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:22.750337 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f34034-36f7-454e-8884-bf85a2903fe9 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:22.880107 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a037cf24-fac8-4cba-a3ac-d3367e2de74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:22.881016 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a037cf24-fac8-4cba-a3ac-d3367e2de74d admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:22.881546 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a037cf24-fac8-4cba-a3ac-d3367e2de74d admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:22.882034 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a037cf24-fac8-4cba-a3ac-d3367e2de74d admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:22.883215 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a037cf24-fac8-4cba-a3ac-d3367e2de74d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:22.888634 dv-cinder-854270-4-smb devstack@keystone.service[88339]: WARNING py.warnings [None req-a037cf24-fac8-4cba-a3ac-d3367e2de74d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 22:45:22.888634 dv-cinder-854270-4-smb devstack@keystone.service[88339]: warnings.warn(msg) Aug 29 22:45:22.888634 dv-cinder-854270-4-smb devstack@keystone.service[88339]: Aug 29 22:45:22.890971 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a037cf24-fac8-4cba-a3ac-d3367e2de74d admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:22.965013 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76545fd2-d11f-4c0e-aef1-1377b11909f4 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:22.980329 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff4e280-f1aa-43b7-b491-1a4bec025b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:22.981639 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4e280-f1aa-43b7-b491-1a4bec025b3f admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:22.982452 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4e280-f1aa-43b7-b491-1a4bec025b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:22.983183 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4e280-f1aa-43b7-b491-1a4bec025b3f admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:22.985321 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff4e280-f1aa-43b7-b491-1a4bec025b3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:22.987420 dv-cinder-854270-4-smb devstack@keystone.service[88338]: WARNING py.warnings [None req-0ff4e280-f1aa-43b7-b491-1a4bec025b3f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 22:45:22.987420 dv-cinder-854270-4-smb devstack@keystone.service[88338]: warnings.warn(msg) Aug 29 22:45:22.987420 dv-cinder-854270-4-smb devstack@keystone.service[88338]: Aug 29 22:45:22.988151 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 783/1547] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:45:22 2022] POST /identity/v3/projects => generated 389 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:45:22.991227 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff4e280-f1aa-43b7-b491-1a4bec025b3f admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:22.993466 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e13ab-ebf5-46e2-af8f-d34ee27a895d None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:22.993975 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e13ab-ebf5-46e2-af8f-d34ee27a895d None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:22.994474 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e13ab-ebf5-46e2-af8f-d34ee27a895d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:23.029382 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 765/1548] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:45:22 2022] POST /identity/v3/users => generated 297 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:45:23.029382 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83db2f8-666f-466e-95e6-4f347374fb08 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:23.029382 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83db2f8-666f-466e-95e6-4f347374fb08 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:23.029382 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83db2f8-666f-466e-95e6-4f347374fb08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:23.031200 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-826e13ab-ebf5-46e2-af8f-d34ee27a895d None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:23.032761 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-826e13ab-ebf5-46e2-af8f-d34ee27a895d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:23.050107 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-f83db2f8-666f-466e-95e6-4f347374fb08 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:23.052054 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-f83db2f8-666f-466e-95e6-4f347374fb08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:23.097732 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 784/1549] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:45:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:45:23.099345 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a5639-4cb5-4df0-a9d3-46fdedbe8375 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:23.099641 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a5639-4cb5-4df0-a9d3-46fdedbe8375 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:23.099918 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a5639-4cb5-4df0-a9d3-46fdedbe8375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:23.118504 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 766/1550] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:45:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:45:23.119487 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83db2f8-666f-466e-95e6-4f347374fb08 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:23.120459 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-b97a5639-4cb5-4df0-a9d3-46fdedbe8375 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:23.121708 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-b97a5639-4cb5-4df0-a9d3-46fdedbe8375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:23.130502 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83db2f8-666f-466e-95e6-4f347374fb08 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:23.133634 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 785/1551] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:45:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:45:23.134981 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad2f44-57df-4552-a182-23e8da50ce3d None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:23.135239 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad2f44-57df-4552-a182-23e8da50ce3d None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:23.135518 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad2f44-57df-4552-a182-23e8da50ce3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:23.135631 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e229c177-328c-4c14-b73a-969029615a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:23.136197 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229c177-328c-4c14-b73a-969029615a28 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:23.136483 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229c177-328c-4c14-b73a-969029615a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:23.136759 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229c177-328c-4c14-b73a-969029615a28 admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:23.137424 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e229c177-328c-4c14-b73a-969029615a28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:23.139509 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e229c177-328c-4c14-b73a-969029615a28 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:23.156622 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-b3ad2f44-57df-4552-a182-23e8da50ce3d None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:23.157922 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-b3ad2f44-57df-4552-a182-23e8da50ce3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:23.163797 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 767/1552] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:45:23 2022] POST /identity/v3/users => generated 295 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:45:23.165159 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b959feb-2d30-4d03-a800-4a28c7be6450 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:23.165477 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b959feb-2d30-4d03-a800-4a28c7be6450 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:23.165757 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b959feb-2d30-4d03-a800-4a28c7be6450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:23.171484 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 786/1553] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:45:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:45:23.172290 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ad2f44-57df-4552-a182-23e8da50ce3d None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:23.184202 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ad2f44-57df-4552-a182-23e8da50ce3d None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:23.186345 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-1b959feb-2d30-4d03-a800-4a28c7be6450 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:23.187571 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-1b959feb-2d30-4d03-a800-4a28c7be6450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:23.189118 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c53778-762c-4276-91de-fa68e3009949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:23.189752 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c53778-762c-4276-91de-fa68e3009949 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:23.190033 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c53778-762c-4276-91de-fa68e3009949 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:23.190307 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c53778-762c-4276-91de-fa68e3009949 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:23.190950 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c53778-762c-4276-91de-fa68e3009949 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:23.192969 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c53778-762c-4276-91de-fa68e3009949 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:23.196604 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 768/1554] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:45:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:45:23.198199 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1e5f7-c909-48d8-a2be-03272407cc98 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:23.199021 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1e5f7-c909-48d8-a2be-03272407cc98 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:23.199021 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1e5f7-c909-48d8-a2be-03272407cc98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:23.203988 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 787/1555] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:45:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:45:23.205359 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b5bce-62d8-4f47-ab7e-39994bea22bc None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:23.205652 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b5bce-62d8-4f47-ab7e-39994bea22bc None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:23.205928 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b5bce-62d8-4f47-ab7e-39994bea22bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:23.227278 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-c46b5bce-62d8-4f47-ab7e-39994bea22bc None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:23.227660 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-b4b1e5f7-c909-48d8-a2be-03272407cc98 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:23.228514 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-c46b5bce-62d8-4f47-ab7e-39994bea22bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:23.228852 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-b4b1e5f7-c909-48d8-a2be-03272407cc98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:23.236424 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 788/1556] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:45:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:45:23.236640 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 769/1557] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:45:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:45:23.237923 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdde07a-e8e1-4bb9-aa82-d1a16eca41b2 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:23.238205 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdde07a-e8e1-4bb9-aa82-d1a16eca41b2 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:23.238508 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdde07a-e8e1-4bb9-aa82-d1a16eca41b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:23.245456 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc3738-3377-4df8-a5d9-c2527f6c42cc None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:23.245744 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc3738-3377-4df8-a5d9-c2527f6c42cc None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:23.246019 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc3738-3377-4df8-a5d9-c2527f6c42cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:23.259513 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-4cdde07a-e8e1-4bb9-aa82-d1a16eca41b2 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:23.260806 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-4cdde07a-e8e1-4bb9-aa82-d1a16eca41b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:23.265605 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-b3fc3738-3377-4df8-a5d9-c2527f6c42cc None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:23.266790 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-b3fc3738-3377-4df8-a5d9-c2527f6c42cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:23.268719 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 789/1558] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:45:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:45:23.269591 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdde07a-e8e1-4bb9-aa82-d1a16eca41b2 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:23.280114 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 770/1559] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:45:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:45:23.281022 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdde07a-e8e1-4bb9-aa82-d1a16eca41b2 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:23.281531 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5266d18-b90a-44e3-8b21-f8c2f5c56153 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:23.281886 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5266d18-b90a-44e3-8b21-f8c2f5c56153 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:23.282228 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5266d18-b90a-44e3-8b21-f8c2f5c56153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:23.287807 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5a5c3c-ed59-4c45-954c-49190c215863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:23.288410 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a5c3c-ed59-4c45-954c-49190c215863 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:23.288691 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a5c3c-ed59-4c45-954c-49190c215863 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:23.288965 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a5c3c-ed59-4c45-954c-49190c215863 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:23.289643 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5a5c3c-ed59-4c45-954c-49190c215863 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:23.289799 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:23.291259 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5a5c3c-ed59-4c45-954c-49190c215863 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:23.303649 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-f5266d18-b90a-44e3-8b21-f8c2f5c56153 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:23.304863 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-f5266d18-b90a-44e3-8b21-f8c2f5c56153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:23.305377 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 790/1560] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:45:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:45:23.306738 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a2208-5838-4aa8-a95b-5f545e971e70 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:23.307028 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a2208-5838-4aa8-a95b-5f545e971e70 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:23.307310 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a2208-5838-4aa8-a95b-5f545e971e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:23.313249 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 771/1561] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:45:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:45:23.314456 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5266d18-b90a-44e3-8b21-f8c2f5c56153 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:23.317517 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:23.324286 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5266d18-b90a-44e3-8b21-f8c2f5c56153 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:23.328963 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3942330-7c97-41b7-85e5-cba743dfb7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:23.329123 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-1a2a2208-5838-4aa8-a95b-5f545e971e70 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:23.329584 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3942330-7c97-41b7-85e5-cba743dfb7a1 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:23.329862 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3942330-7c97-41b7-85e5-cba743dfb7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:23.330131 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3942330-7c97-41b7-85e5-cba743dfb7a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:23.330389 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-1a2a2208-5838-4aa8-a95b-5f545e971e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:23.330765 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3942330-7c97-41b7-85e5-cba743dfb7a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:23.332931 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3942330-7c97-41b7-85e5-cba743dfb7a1 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:23.339002 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 791/1562] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:45:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:45:23.339904 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a2208-5838-4aa8-a95b-5f545e971e70 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:23.346181 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 772/1563] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:45:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:45:23.346181 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbcaa52-01f7-4ce4-b3b2-67d3ff101efc None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:23.346181 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbcaa52-01f7-4ce4-b3b2-67d3ff101efc None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:23.346181 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbcaa52-01f7-4ce4-b3b2-67d3ff101efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:23.350723 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a2208-5838-4aa8-a95b-5f545e971e70 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:23.355260 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e600ad61-10d2-429b-bfdb-7df3b41c4358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:23.355859 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600ad61-10d2-429b-bfdb-7df3b41c4358 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:23.356136 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600ad61-10d2-429b-bfdb-7df3b41c4358 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:23.356408 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600ad61-10d2-429b-bfdb-7df3b41c4358 admin admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:23.357051 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e600ad61-10d2-429b-bfdb-7df3b41c4358 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:45:23.357376 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e600ad61-10d2-429b-bfdb-7df3b41c4358 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:23.358972 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e600ad61-10d2-429b-bfdb-7df3b41c4358 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:23.364575 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-2cbcaa52-01f7-4ce4-b3b2-67d3ff101efc None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:23.365818 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-2cbcaa52-01f7-4ce4-b3b2-67d3ff101efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:23.370513 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 792/1564] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Aug 29 22:45:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:45:23.371355 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e600ad61-10d2-429b-bfdb-7df3b41c4358 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:23.377264 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 773/1565] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:45:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:45:23.377264 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbcaa52-01f7-4ce4-b3b2-67d3ff101efc None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:23.383368 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e600ad61-10d2-429b-bfdb-7df3b41c4358 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:23.387285 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbcaa52-01f7-4ce4-b3b2-67d3ff101efc None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:23.387915 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb1e6c2-d310-4026-8a3f-bcec738027d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:23.388504 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1e6c2-d310-4026-8a3f-bcec738027d1 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:23.388782 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1e6c2-d310-4026-8a3f-bcec738027d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:23.389050 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1e6c2-d310-4026-8a3f-bcec738027d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:23.389716 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb1e6c2-d310-4026-8a3f-bcec738027d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:45:23.390014 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb1e6c2-d310-4026-8a3f-bcec738027d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:23.391596 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb1e6c2-d310-4026-8a3f-bcec738027d1 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:23.391896 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441ed007-9309-45bd-8208-476323c5a11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:23.392490 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ed007-9309-45bd-8208-476323c5a11d admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:23.392770 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ed007-9309-45bd-8208-476323c5a11d admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:23.393048 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ed007-9309-45bd-8208-476323c5a11d admin admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:23.393726 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441ed007-9309-45bd-8208-476323c5a11d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:45:23.394057 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441ed007-9309-45bd-8208-476323c5a11d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:23.396200 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441ed007-9309-45bd-8208-476323c5a11d admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:23.404533 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 793/1566] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Aug 29 22:45:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:45:23.405345 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb1e6c2-d310-4026-8a3f-bcec738027d1 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:23.414944 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb1e6c2-d310-4026-8a3f-bcec738027d1 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:23.415553 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 774/1567] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Aug 29 22:45:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:45:23.416523 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441ed007-9309-45bd-8208-476323c5a11d admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:23.419856 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca2974f-e9ce-4e0b-a89c-11cb2dad8a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:23.420515 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2974f-e9ce-4e0b-a89c-11cb2dad8a9c admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:23.420859 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2974f-e9ce-4e0b-a89c-11cb2dad8a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:23.421194 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2974f-e9ce-4e0b-a89c-11cb2dad8a9c admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:23.421935 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca2974f-e9ce-4e0b-a89c-11cb2dad8a9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:23.423588 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca2974f-e9ce-4e0b-a89c-11cb2dad8a9c admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:23.427307 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441ed007-9309-45bd-8208-476323c5a11d admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:23.432473 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777ba607-5c33-49bd-ae2b-db484440536b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:23.433074 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ba607-5c33-49bd-ae2b-db484440536b admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:23.433387 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ba607-5c33-49bd-ae2b-db484440536b admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:23.433675 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ba607-5c33-49bd-ae2b-db484440536b admin admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:23.433816 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 794/1568] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:45:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:45:23.434324 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777ba607-5c33-49bd-ae2b-db484440536b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:45:23.434509 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca2974f-e9ce-4e0b-a89c-11cb2dad8a9c admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:23.434708 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777ba607-5c33-49bd-ae2b-db484440536b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:23.436279 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777ba607-5c33-49bd-ae2b-db484440536b admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:23.445028 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca2974f-e9ce-4e0b-a89c-11cb2dad8a9c admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:23.449618 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30d3c97-f4a4-4ca4-a780-bba45ef6d724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:23.449748 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 775/1569] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Aug 29 22:45:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:45:23.450201 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d3c97-f4a4-4ca4-a780-bba45ef6d724 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:23.450479 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d3c97-f4a4-4ca4-a780-bba45ef6d724 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:23.450584 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777ba607-5c33-49bd-ae2b-db484440536b admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:23.450883 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d3c97-f4a4-4ca4-a780-bba45ef6d724 admin admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:23.451527 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30d3c97-f4a4-4ca4-a780-bba45ef6d724 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:45:23.451823 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30d3c97-f4a4-4ca4-a780-bba45ef6d724 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:23.453419 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30d3c97-f4a4-4ca4-a780-bba45ef6d724 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:23.473432 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 795/1570] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Aug 29 22:45:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:45:23.473631 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777ba607-5c33-49bd-ae2b-db484440536b admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:23.473732 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30d3c97-f4a4-4ca4-a780-bba45ef6d724 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:23.473861 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630f3278-ea89-4f48-a5d3-36d5d5d276eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:23.473861 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f3278-ea89-4f48-a5d3-36d5d5d276eb admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:23.473861 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f3278-ea89-4f48-a5d3-36d5d5d276eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:23.473861 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f3278-ea89-4f48-a5d3-36d5d5d276eb admin admin] PATH_INFO: `/v3/projects/589d651060244dd5a74a1e98513ac74f/users/c9d2b7dc4c6f4061a2606e514d2a4c88/roles/0c67797d444d4c929b2ccab47c468848` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:23.477402 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30d3c97-f4a4-4ca4-a780-bba45ef6d724 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:23.482044 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a2f3c-3441-46ab-bcc7-259ede892b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:23.482633 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a2f3c-3441-46ab-bcc7-259ede892b4e admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:23.482911 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a2f3c-3441-46ab-bcc7-259ede892b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:23.483182 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a2f3c-3441-46ab-bcc7-259ede892b4e admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:23.483806 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38a2f3c-3441-46ab-bcc7-259ede892b4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:23.485745 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38a2f3c-3441-46ab-bcc7-259ede892b4e admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:23.488131 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630f3278-ea89-4f48-a5d3-36d5d5d276eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=589d651060244dd5a74a1e98513ac74f, user_id=c9d2b7dc4c6f4061a2606e514d2a4c88, role_id=0c67797d444d4c929b2ccab47c468848)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:23.490849 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630f3278-ea89-4f48-a5d3-36d5d5d276eb admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:23.506009 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 776/1571] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:45:23 2022] PUT /identity/v3/projects/589d651060244dd5a74a1e98513ac74f/users/c9d2b7dc4c6f4061a2606e514d2a4c88/roles/0c67797d444d4c929b2ccab47c468848 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:45:23.507022 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630f3278-ea89-4f48-a5d3-36d5d5d276eb admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:23.522218 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 796/1572] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:45:23 2022] POST /identity/v3/projects => generated 365 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:45:23.522218 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a2f3c-3441-46ab-bcc7-259ede892b4e admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:23.574752 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630f3278-ea89-4f48-a5d3-36d5d5d276eb admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:23.579400 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f622f42e-30ed-4b56-8e9b-65f08305535f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:23.580010 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f622f42e-30ed-4b56-8e9b-65f08305535f admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:23.580291 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f622f42e-30ed-4b56-8e9b-65f08305535f admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:23.580562 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f622f42e-30ed-4b56-8e9b-65f08305535f admin admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:23.581004 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a2f3c-3441-46ab-bcc7-259ede892b4e admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:23.581207 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f622f42e-30ed-4b56-8e9b-65f08305535f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:45:23.581544 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f622f42e-30ed-4b56-8e9b-65f08305535f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:23.583773 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f622f42e-30ed-4b56-8e9b-65f08305535f admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:23.586958 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cfa77a-02cd-4a80-b234-97386194ecf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:23.587729 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cfa77a-02cd-4a80-b234-97386194ecf5 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:23.588018 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cfa77a-02cd-4a80-b234-97386194ecf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:23.588318 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cfa77a-02cd-4a80-b234-97386194ecf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:23.588961 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cfa77a-02cd-4a80-b234-97386194ecf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:23.590998 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cfa77a-02cd-4a80-b234-97386194ecf5 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:23.595403 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 777/1573] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Aug 29 22:45:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:45:23.596454 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f622f42e-30ed-4b56-8e9b-65f08305535f admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:23.606664 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f622f42e-30ed-4b56-8e9b-65f08305535f admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:23.611443 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff66f19-2b46-4d3b-86cb-a3a0c76e5110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:23.612250 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff66f19-2b46-4d3b-86cb-a3a0c76e5110 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:23.612560 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff66f19-2b46-4d3b-86cb-a3a0c76e5110 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:23.612857 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff66f19-2b46-4d3b-86cb-a3a0c76e5110 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:23.614153 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff66f19-2b46-4d3b-86cb-a3a0c76e5110 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:23.616196 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff66f19-2b46-4d3b-86cb-a3a0c76e5110 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:23.620297 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 797/1574] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:45:23 2022] POST /identity/v3/projects => generated 379 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:45:23.624253 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cfa77a-02cd-4a80-b234-97386194ecf5 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:23.649614 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 778/1575] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:45:23 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:45:23.649614 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff66f19-2b46-4d3b-86cb-a3a0c76e5110 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:23.694609 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cfa77a-02cd-4a80-b234-97386194ecf5 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:23.707005 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:23.712405 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff66f19-2b46-4d3b-86cb-a3a0c76e5110 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:23.717231 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824a5d5b-bcda-42d1-8b66-66f47ec40650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:23.717892 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a5d5b-bcda-42d1-8b66-66f47ec40650 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:23.718177 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a5d5b-bcda-42d1-8b66-66f47ec40650 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:23.718448 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a5d5b-bcda-42d1-8b66-66f47ec40650 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:23.719075 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824a5d5b-bcda-42d1-8b66-66f47ec40650 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:23.720984 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824a5d5b-bcda-42d1-8b66-66f47ec40650 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:23.725922 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:23.752800 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 779/1576] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:45:23 2022] POST /identity/v3/projects => generated 403 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:45:23.753601 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824a5d5b-bcda-42d1-8b66-66f47ec40650 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:23.757109 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37714e74-2b6a-4840-9360-001c27542587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:23.757886 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37714e74-2b6a-4840-9360-001c27542587 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:23.758269 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37714e74-2b6a-4840-9360-001c27542587 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:23.758649 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37714e74-2b6a-4840-9360-001c27542587 admin admin] PATH_INFO: `/v3/projects/ee915667d25b467f972a68e68b08a8b6/users/e2710a23114c4962a06886572be82b12/roles/0c67797d444d4c929b2ccab47c468848` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:23.773725 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37714e74-2b6a-4840-9360-001c27542587 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee915667d25b467f972a68e68b08a8b6, user_id=e2710a23114c4962a06886572be82b12, role_id=0c67797d444d4c929b2ccab47c468848)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:23.774766 dv-cinder-854270-4-smb devstack@keystone.service[88339]: WARNING py.warnings [None req-37714e74-2b6a-4840-9360-001c27542587 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 22:45:23.774766 dv-cinder-854270-4-smb devstack@keystone.service[88339]: warnings.warn(msg) Aug 29 22:45:23.774766 dv-cinder-854270-4-smb devstack@keystone.service[88339]: Aug 29 22:45:23.776955 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37714e74-2b6a-4840-9360-001c27542587 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:23.791664 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 798/1577] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:45:23 2022] PUT /identity/v3/projects/ee915667d25b467f972a68e68b08a8b6/users/e2710a23114c4962a06886572be82b12/roles/0c67797d444d4c929b2ccab47c468848 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:45:23.793562 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39715681-b3bf-47cf-93da-4919d05dd295 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:23.793848 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39715681-b3bf-47cf-93da-4919d05dd295 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:23.794123 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39715681-b3bf-47cf-93da-4919d05dd295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:23.813435 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-39715681-b3bf-47cf-93da-4919d05dd295 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:23.815641 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-39715681-b3bf-47cf-93da-4919d05dd295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:23.820085 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824a5d5b-bcda-42d1-8b66-66f47ec40650 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:23.875948 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 799/1578] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:45:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:45:23.876434 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef49ea3-432b-4f33-887a-19bc9ecaf947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:23.876578 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39715681-b3bf-47cf-93da-4919d05dd295 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:23.877610 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef49ea3-432b-4f33-887a-19bc9ecaf947 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:23.878271 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef49ea3-432b-4f33-887a-19bc9ecaf947 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:23.878649 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef49ea3-432b-4f33-887a-19bc9ecaf947 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:23.879577 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef49ea3-432b-4f33-887a-19bc9ecaf947 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:23.881951 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef49ea3-432b-4f33-887a-19bc9ecaf947 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:23.886728 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39715681-b3bf-47cf-93da-4919d05dd295 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:23.891710 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cef262-9f5f-41c0-929c-a5df0ada80dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:23.892322 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cef262-9f5f-41c0-929c-a5df0ada80dc admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:23.892621 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cef262-9f5f-41c0-929c-a5df0ada80dc admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:23.892893 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cef262-9f5f-41c0-929c-a5df0ada80dc admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:23.893599 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cef262-9f5f-41c0-929c-a5df0ada80dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:23.896124 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cef262-9f5f-41c0-929c-a5df0ada80dc admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:23.912770 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 780/1579] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:45:23 2022] POST /identity/v3/projects => generated 379 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:45:23.914117 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef49ea3-432b-4f33-887a-19bc9ecaf947 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:23.919983 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 800/1580] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:45:23 2022] POST /identity/v3/users => generated 283 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:45:23.921064 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cef262-9f5f-41c0-929c-a5df0ada80dc admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:23.931868 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cef262-9f5f-41c0-929c-a5df0ada80dc admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:23.979756 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef49ea3-432b-4f33-887a-19bc9ecaf947 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:23.984596 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17946d15-2bfb-4581-ac1d-af5176b0f830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:23.985265 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17946d15-2bfb-4581-ac1d-af5176b0f830 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:23.985518 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17946d15-2bfb-4581-ac1d-af5176b0f830 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:23.985796 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17946d15-2bfb-4581-ac1d-af5176b0f830 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:23.986435 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17946d15-2bfb-4581-ac1d-af5176b0f830 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:23.988476 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17946d15-2bfb-4581-ac1d-af5176b0f830 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:23.991622 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c2c96-801c-4fb5-8f3e-cca412d6ebe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:23.992231 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c2c96-801c-4fb5-8f3e-cca412d6ebe9 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:23.992506 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c2c96-801c-4fb5-8f3e-cca412d6ebe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:23.992860 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c2c96-801c-4fb5-8f3e-cca412d6ebe9 admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:23.993601 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672c2c96-801c-4fb5-8f3e-cca412d6ebe9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:23.995546 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672c2c96-801c-4fb5-8f3e-cca412d6ebe9 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:24.017172 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 801/1581] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:45:23 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:45:24.021180 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 781/1582] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:45:23 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:45:24.021310 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c2c96-801c-4fb5-8f3e-cca412d6ebe9 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:24.021448 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17946d15-2bfb-4581-ac1d-af5176b0f830 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:24.025343 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:24.031671 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c2c96-801c-4fb5-8f3e-cca412d6ebe9 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:24.041322 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:24.087040 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17946d15-2bfb-4581-ac1d-af5176b0f830 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:24.091817 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1223889c-f95a-465b-80a9-8fd5ddfdf5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:24.092041 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a43bb02-0f48-49f8-9ad7-23778cb14c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:24.092426 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223889c-f95a-465b-80a9-8fd5ddfdf5b8 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:24.092656 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43bb02-0f48-49f8-9ad7-23778cb14c13 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:24.092771 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223889c-f95a-465b-80a9-8fd5ddfdf5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:24.092966 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223889c-f95a-465b-80a9-8fd5ddfdf5b8 admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:24.093060 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43bb02-0f48-49f8-9ad7-23778cb14c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:24.093341 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43bb02-0f48-49f8-9ad7-23778cb14c13 admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:24.093646 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1223889c-f95a-465b-80a9-8fd5ddfdf5b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:24.094007 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a43bb02-0f48-49f8-9ad7-23778cb14c13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:24.095562 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1223889c-f95a-465b-80a9-8fd5ddfdf5b8 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:24.096042 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a43bb02-0f48-49f8-9ad7-23778cb14c13 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:24.118806 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 802/1583] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:45:24 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:45:24.124780 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 782/1584] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:45:24 2022] POST /identity/v3/users => generated 302 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:45:24.124875 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72581eca-5739-4f92-a59d-1b35ff6d2034 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:24.124971 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a43bb02-0f48-49f8-9ad7-23778cb14c13 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:24.125045 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72581eca-5739-4f92-a59d-1b35ff6d2034 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:24.125045 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72581eca-5739-4f92-a59d-1b35ff6d2034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:24.141830 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-72581eca-5739-4f92-a59d-1b35ff6d2034 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:24.143059 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-72581eca-5739-4f92-a59d-1b35ff6d2034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:24.150926 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 803/1585] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:45:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:45:24.154482 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72581eca-5739-4f92-a59d-1b35ff6d2034 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:24.162327 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72581eca-5739-4f92-a59d-1b35ff6d2034 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:24.167825 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c02ec66-08d3-4d0e-8229-69d04f224959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:24.168379 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c02ec66-08d3-4d0e-8229-69d04f224959 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:24.168657 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c02ec66-08d3-4d0e-8229-69d04f224959 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:24.168951 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c02ec66-08d3-4d0e-8229-69d04f224959 admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:24.169621 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c02ec66-08d3-4d0e-8229-69d04f224959 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:24.171609 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c02ec66-08d3-4d0e-8229-69d04f224959 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:24.177593 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a43bb02-0f48-49f8-9ad7-23778cb14c13 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:24.181239 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478edff9-41ac-406f-ae8b-857cf7a3f5ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:24.181886 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478edff9-41ac-406f-ae8b-857cf7a3f5ce service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:24.182168 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478edff9-41ac-406f-ae8b-857cf7a3f5ce service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:24.182439 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478edff9-41ac-406f-ae8b-857cf7a3f5ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:24.192986 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478edff9-41ac-406f-ae8b-857cf7a3f5ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:24.197198 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 804/1586] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:45:24 2022] POST /identity/v3/users => generated 290 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:45:24.197440 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478edff9-41ac-406f-ae8b-857cf7a3f5ce service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:24.197563 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c02ec66-08d3-4d0e-8229-69d04f224959 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:24.204061 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 783/1587] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:45:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:45:24.204843 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478edff9-41ac-406f-ae8b-857cf7a3f5ce service neutron] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:24.205030 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c02ec66-08d3-4d0e-8229-69d04f224959 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:24.211333 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5534aa7-ad2c-4b94-ad00-b99d72cf5e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:24.211635 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5534aa7-ad2c-4b94-ad00-b99d72cf5e07 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:24.211916 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5534aa7-ad2c-4b94-ad00-b99d72cf5e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:24.212192 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5534aa7-ad2c-4b94-ad00-b99d72cf5e07 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:24.212836 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5534aa7-ad2c-4b94-ad00-b99d72cf5e07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:24.214484 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5534aa7-ad2c-4b94-ad00-b99d72cf5e07 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:24.215198 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478edff9-41ac-406f-ae8b-857cf7a3f5ce service neutron] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:24.220240 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a401ecf-b232-4bae-8826-cbbe29749edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:24.220850 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a401ecf-b232-4bae-8826-cbbe29749edb admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:24.221132 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a401ecf-b232-4bae-8826-cbbe29749edb admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:24.221444 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a401ecf-b232-4bae-8826-cbbe29749edb admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:24.222092 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a401ecf-b232-4bae-8826-cbbe29749edb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:24.224149 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a401ecf-b232-4bae-8826-cbbe29749edb admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:24.226275 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 805/1588] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:45:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:45:24.230192 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5534aa7-ad2c-4b94-ad00-b99d72cf5e07 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:24.239858 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 784/1589] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:45:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:45:24.240801 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a401ecf-b232-4bae-8826-cbbe29749edb admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:24.241278 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5534aa7-ad2c-4b94-ad00-b99d72cf5e07 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:24.246261 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bfe7d0-803c-4d90-b26f-292ed4ac736d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:24.246863 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bfe7d0-803c-4d90-b26f-292ed4ac736d admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:24.247150 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bfe7d0-803c-4d90-b26f-292ed4ac736d admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:24.247419 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bfe7d0-803c-4d90-b26f-292ed4ac736d admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:24.248092 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bfe7d0-803c-4d90-b26f-292ed4ac736d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:24.250056 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bfe7d0-803c-4d90-b26f-292ed4ac736d admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:24.251480 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a401ecf-b232-4bae-8826-cbbe29749edb admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:24.258868 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e417a-aa59-4afb-b475-91bc80a6fbda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:24.259494 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e417a-aa59-4afb-b475-91bc80a6fbda admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:24.260111 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e417a-aa59-4afb-b475-91bc80a6fbda admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:24.260385 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e417a-aa59-4afb-b475-91bc80a6fbda admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:24.261071 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91e417a-aa59-4afb-b475-91bc80a6fbda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:24.262850 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91e417a-aa59-4afb-b475-91bc80a6fbda admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:24.276732 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 785/1590] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:45:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:45:24.277753 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e417a-aa59-4afb-b475-91bc80a6fbda admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:24.289351 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e417a-aa59-4afb-b475-91bc80a6fbda admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:24.290766 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 806/1591] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:45:24 2022] POST /identity/v3/users => generated 292 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:45:24.292018 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bfe7d0-803c-4d90-b26f-292ed4ac736d admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:24.294737 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f0810-85a1-4807-8a30-44fe6cf3e357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:24.295354 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f0810-85a1-4807-8a30-44fe6cf3e357 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:24.295637 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f0810-85a1-4807-8a30-44fe6cf3e357 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:24.295914 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f0810-85a1-4807-8a30-44fe6cf3e357 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:24.296556 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000f0810-85a1-4807-8a30-44fe6cf3e357 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:24.298200 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000f0810-85a1-4807-8a30-44fe6cf3e357 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:24.309822 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 786/1592] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:45:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:45:24.310832 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f0810-85a1-4807-8a30-44fe6cf3e357 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:24.312029 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bfe7d0-803c-4d90-b26f-292ed4ac736d admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:24.317557 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d56788a-2a04-4cfe-8b00-f97609356136 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:24.318217 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d56788a-2a04-4cfe-8b00-f97609356136 service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:24.318496 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d56788a-2a04-4cfe-8b00-f97609356136 service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:24.318779 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d56788a-2a04-4cfe-8b00-f97609356136 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:24.324113 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f0810-85a1-4807-8a30-44fe6cf3e357 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:24.329071 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b51dbf-1120-4424-bbc1-92eeb9b78821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:24.329770 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b51dbf-1120-4424-bbc1-92eeb9b78821 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:24.330124 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b51dbf-1120-4424-bbc1-92eeb9b78821 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:24.330498 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b51dbf-1120-4424-bbc1-92eeb9b78821 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:24.330691 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d56788a-2a04-4cfe-8b00-f97609356136 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:24.331264 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b51dbf-1120-4424-bbc1-92eeb9b78821 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:24.332139 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d56788a-2a04-4cfe-8b00-f97609356136 service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:24.333357 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b51dbf-1120-4424-bbc1-92eeb9b78821 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:24.343938 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 807/1594] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:45:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:45:24.344108 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 787/1594] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:45:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:45:24.345124 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b51dbf-1120-4424-bbc1-92eeb9b78821 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:24.349204 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d56788a-2a04-4cfe-8b00-f97609356136 service neutron] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:24.356516 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b51dbf-1120-4424-bbc1-92eeb9b78821 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:24.359045 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d56788a-2a04-4cfe-8b00-f97609356136 service neutron] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:24.362086 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba91411-7eb3-4a1c-bd54-70f9b3c972af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:24.362782 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba91411-7eb3-4a1c-bd54-70f9b3c972af admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:24.363140 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba91411-7eb3-4a1c-bd54-70f9b3c972af admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:24.363647 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba91411-7eb3-4a1c-bd54-70f9b3c972af admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:24.364389 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba91411-7eb3-4a1c-bd54-70f9b3c972af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:24.365230 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f9924-bc6e-4ecf-b05c-c83f144f51dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:24.365875 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f9924-bc6e-4ecf-b05c-c83f144f51dc admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:24.366155 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f9924-bc6e-4ecf-b05c-c83f144f51dc admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:24.366354 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba91411-7eb3-4a1c-bd54-70f9b3c972af admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:24.366465 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f9924-bc6e-4ecf-b05c-c83f144f51dc admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:24.367114 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853f9924-bc6e-4ecf-b05c-c83f144f51dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:24.368735 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853f9924-bc6e-4ecf-b05c-c83f144f51dc admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:24.379387 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 788/1595] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:45:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:45:24.380690 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 808/1596] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:45:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:45:24.382486 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba91411-7eb3-4a1c-bd54-70f9b3c972af admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:24.384384 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f9924-bc6e-4ecf-b05c-c83f144f51dc admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:24.395262 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f9924-bc6e-4ecf-b05c-c83f144f51dc admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:24.399223 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba91411-7eb3-4a1c-bd54-70f9b3c972af admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:24.403544 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a31b27-05a3-429f-84aa-f5057b760ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:24.404500 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a31b27-05a3-429f-84aa-f5057b760ad6 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:24.404919 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a31b27-05a3-429f-84aa-f5057b760ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:24.405289 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a31b27-05a3-429f-84aa-f5057b760ad6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:24.406213 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a31b27-05a3-429f-84aa-f5057b760ad6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:24.406324 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a0abcb-e4eb-4dd7-9ca8-5be9a4c00261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:24.406914 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a0abcb-e4eb-4dd7-9ca8-5be9a4c00261 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:24.407195 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a0abcb-e4eb-4dd7-9ca8-5be9a4c00261 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:24.407470 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a0abcb-e4eb-4dd7-9ca8-5be9a4c00261 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:24.407843 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a31b27-05a3-429f-84aa-f5057b760ad6 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:24.408142 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a0abcb-e4eb-4dd7-9ca8-5be9a4c00261 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:24.410205 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a0abcb-e4eb-4dd7-9ca8-5be9a4c00261 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:24.423573 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 809/1597] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:45:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:45:24.423573 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a31b27-05a3-429f-84aa-f5057b760ad6 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:24.424011 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 789/1598] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:45:24 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:45:24.425052 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a0abcb-e4eb-4dd7-9ca8-5be9a4c00261 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:24.437660 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a31b27-05a3-429f-84aa-f5057b760ad6 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:24.438693 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a0abcb-e4eb-4dd7-9ca8-5be9a4c00261 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:24.442802 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c07c64-ce47-4412-99e5-a388289d46ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:24.443437 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c07c64-ce47-4412-99e5-a388289d46ed admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:24.443686 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c07c64-ce47-4412-99e5-a388289d46ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:24.443799 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbca224-3f16-4756-85eb-71ee9d4870c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:24.443955 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c07c64-ce47-4412-99e5-a388289d46ed admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:24.444567 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbca224-3f16-4756-85eb-71ee9d4870c2 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:24.444691 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c07c64-ce47-4412-99e5-a388289d46ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:24.444964 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbca224-3f16-4756-85eb-71ee9d4870c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:24.445313 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbca224-3f16-4756-85eb-71ee9d4870c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:24.446223 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbca224-3f16-4756-85eb-71ee9d4870c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:24.446347 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c07c64-ce47-4412-99e5-a388289d46ed admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:24.448024 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbca224-3f16-4756-85eb-71ee9d4870c2 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:24.456556 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 810/1599] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:45:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:45:24.458347 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c07c64-ce47-4412-99e5-a388289d46ed admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:24.461368 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 790/1600] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:45:24 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:45:24.465009 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbca224-3f16-4756-85eb-71ee9d4870c2 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:24.469181 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c07c64-ce47-4412-99e5-a388289d46ed admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:24.475044 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e98c5d6-693d-4119-b355-a11de98f05e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:24.475694 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98c5d6-693d-4119-b355-a11de98f05e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:24.475979 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98c5d6-693d-4119-b355-a11de98f05e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:24.476247 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98c5d6-693d-4119-b355-a11de98f05e1 admin admin] PATH_INFO: `/v3/projects/ed4a1b08994140118f518b277aba1ea0/users/bc082b6b20ee434895592442eb9d1c00/roles/0c67797d444d4c929b2ccab47c468848` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:24.477252 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbca224-3f16-4756-85eb-71ee9d4870c2 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:24.483758 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff98f272-9e03-460a-91b9-0cfdf7c1d705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:24.484628 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98f272-9e03-460a-91b9-0cfdf7c1d705 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:24.484765 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98f272-9e03-460a-91b9-0cfdf7c1d705 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:24.484985 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98f272-9e03-460a-91b9-0cfdf7c1d705 admin admin] PATH_INFO: `/v3/projects/855b90599dff4063a833adc4fdd78663/users/390c624745d3449aad6ab4d76dde5f17/roles/0c67797d444d4c929b2ccab47c468848` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:24.493986 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e98c5d6-693d-4119-b355-a11de98f05e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed4a1b08994140118f518b277aba1ea0, user_id=bc082b6b20ee434895592442eb9d1c00, role_id=0c67797d444d4c929b2ccab47c468848)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:24.496674 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e98c5d6-693d-4119-b355-a11de98f05e1 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:24.506499 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff98f272-9e03-460a-91b9-0cfdf7c1d705 admin admin] RBAC: Authorizing `identity:create_grant(project_id=855b90599dff4063a833adc4fdd78663, user_id=390c624745d3449aad6ab4d76dde5f17, role_id=0c67797d444d4c929b2ccab47c468848)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:24.509570 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff98f272-9e03-460a-91b9-0cfdf7c1d705 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:24.511991 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:24.515091 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 811/1601] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:45:24 2022] PUT /identity/v3/projects/ed4a1b08994140118f518b277aba1ea0/users/bc082b6b20ee434895592442eb9d1c00/roles/0c67797d444d4c929b2ccab47c468848 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:45:24.516134 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e98c5d6-693d-4119-b355-a11de98f05e1 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:24.543055 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 791/1602] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:45:24 2022] PUT /identity/v3/projects/855b90599dff4063a833adc4fdd78663/users/390c624745d3449aad6ab4d76dde5f17/roles/0c67797d444d4c929b2ccab47c468848 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:45:24.544182 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff98f272-9e03-460a-91b9-0cfdf7c1d705 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:24.579291 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:24.603592 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e98c5d6-693d-4119-b355-a11de98f05e1 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:24.642965 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff98f272-9e03-460a-91b9-0cfdf7c1d705 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:24.650619 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af6762e-4ee5-4188-9464-78ee4b3ba964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:24.651631 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af6762e-4ee5-4188-9464-78ee4b3ba964 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:24.652068 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af6762e-4ee5-4188-9464-78ee4b3ba964 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:24.652639 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af6762e-4ee5-4188-9464-78ee4b3ba964 admin admin] PATH_INFO: `/v3/projects/65c39abe811441eb93d54c90ca939aa6/users/9efc9ad6f7524175ae8bb7a67f6f2c1f/roles/0c67797d444d4c929b2ccab47c468848` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:24.669755 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af6762e-4ee5-4188-9464-78ee4b3ba964 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65c39abe811441eb93d54c90ca939aa6, user_id=9efc9ad6f7524175ae8bb7a67f6f2c1f, role_id=0c67797d444d4c929b2ccab47c468848)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:24.669995 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2395af-5869-454c-a0a0-3823a344ab34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:24.670608 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2395af-5869-454c-a0a0-3823a344ab34 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:24.670948 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2395af-5869-454c-a0a0-3823a344ab34 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:24.671384 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2395af-5869-454c-a0a0-3823a344ab34 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:24.672093 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2395af-5869-454c-a0a0-3823a344ab34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:24.673800 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af6762e-4ee5-4188-9464-78ee4b3ba964 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:24.673926 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2395af-5869-454c-a0a0-3823a344ab34 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:24.686357 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 812/1603] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:45:24 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:45:24.687286 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2395af-5869-454c-a0a0-3823a344ab34 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:24.690631 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 792/1604] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:45:24 2022] PUT /identity/v3/projects/65c39abe811441eb93d54c90ca939aa6/users/9efc9ad6f7524175ae8bb7a67f6f2c1f/roles/0c67797d444d4c929b2ccab47c468848 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:45:24.691811 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af6762e-4ee5-4188-9464-78ee4b3ba964 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:24.703751 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2395af-5869-454c-a0a0-3823a344ab34 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:24.799496 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af6762e-4ee5-4188-9464-78ee4b3ba964 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:24.807021 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecdefb7-1009-4bd9-8820-a241f7ae7b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:24.808363 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecdefb7-1009-4bd9-8820-a241f7ae7b08 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:24.808866 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecdefb7-1009-4bd9-8820-a241f7ae7b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:24.809220 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecdefb7-1009-4bd9-8820-a241f7ae7b08 admin admin] PATH_INFO: `/v3/projects/d485acfa629249d69c5f165bcb2711d9/users/21070561ca4f4b5fb621cde17195d1cc/roles/0c67797d444d4c929b2ccab47c468848` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:24.822257 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d76459-e9a0-4e2a-8c3a-05a7b341b1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:24.824112 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d76459-e9a0-4e2a-8c3a-05a7b341b1d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:24.824400 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d76459-e9a0-4e2a-8c3a-05a7b341b1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:24.824683 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d76459-e9a0-4e2a-8c3a-05a7b341b1d4 admin admin] PATH_INFO: `/v3/projects/f3469f315b1146858349ee384d077f0e/users/60e544f8015a4b5d805c12e56eb2ca28/roles/0c67797d444d4c929b2ccab47c468848` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:24.831870 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecdefb7-1009-4bd9-8820-a241f7ae7b08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d485acfa629249d69c5f165bcb2711d9, user_id=21070561ca4f4b5fb621cde17195d1cc, role_id=0c67797d444d4c929b2ccab47c468848)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:24.841835 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecdefb7-1009-4bd9-8820-a241f7ae7b08 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:24.868327 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d76459-e9a0-4e2a-8c3a-05a7b341b1d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3469f315b1146858349ee384d077f0e, user_id=60e544f8015a4b5d805c12e56eb2ca28, role_id=0c67797d444d4c929b2ccab47c468848)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:24.872099 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 793/1605] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:45:24 2022] PUT /identity/v3/projects/d485acfa629249d69c5f165bcb2711d9/users/21070561ca4f4b5fb621cde17195d1cc/roles/0c67797d444d4c929b2ccab47c468848 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:45:24.873467 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5cebee-12eb-4ee2-b257-1adbf44fba97 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:24.873710 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5cebee-12eb-4ee2-b257-1adbf44fba97 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:24.873988 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5cebee-12eb-4ee2-b257-1adbf44fba97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:24.875929 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d76459-e9a0-4e2a-8c3a-05a7b341b1d4 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:24.901648 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 813/1606] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:45:24 2022] PUT /identity/v3/projects/f3469f315b1146858349ee384d077f0e/users/60e544f8015a4b5d805c12e56eb2ca28/roles/0c67797d444d4c929b2ccab47c468848 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:45:24.905220 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b39a67b-8ffd-4676-abc3-0cf17216c8b7 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:24.905768 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b39a67b-8ffd-4676-abc3-0cf17216c8b7 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:24.906053 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b39a67b-8ffd-4676-abc3-0cf17216c8b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:24.921100 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-bd5cebee-12eb-4ee2-b257-1adbf44fba97 None None] MFA Rules not processed for user `bc082b6b20ee434895592442eb9d1c00`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:24.922584 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-bd5cebee-12eb-4ee2-b257-1adbf44fba97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:24.949985 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-3b39a67b-8ffd-4676-abc3-0cf17216c8b7 None None] MFA Rules not processed for user `390c624745d3449aad6ab4d76dde5f17`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:24.951799 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-3b39a67b-8ffd-4676-abc3-0cf17216c8b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:24.984432 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:25.013360 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 794/1607] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:45:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:45:25.013360 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5cebee-12eb-4ee2-b257-1adbf44fba97 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:25.033461 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:25.053694 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 814/1608] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:45:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:45:25.053694 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e4e81-b527-4f91-8195-7c30c920e896 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:25.053694 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e4e81-b527-4f91-8195-7c30c920e896 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:25.053694 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e4e81-b527-4f91-8195-7c30c920e896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:25.094060 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5cebee-12eb-4ee2-b257-1adbf44fba97 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:25.100541 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2552f771-ea1f-4187-8826-b7adbf70efbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:25.101446 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552f771-ea1f-4187-8826-b7adbf70efbd admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:25.101798 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552f771-ea1f-4187-8826-b7adbf70efbd admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:25.102299 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552f771-ea1f-4187-8826-b7adbf70efbd admin admin] PATH_INFO: `/v3/projects/936e89b946f64d9fa2955e1eea57169b/users/50f7df9dc9f2455d9426b1737770140f/roles/0c67797d444d4c929b2ccab47c468848` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:25.119598 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2552f771-ea1f-4187-8826-b7adbf70efbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=936e89b946f64d9fa2955e1eea57169b, user_id=50f7df9dc9f2455d9426b1737770140f, role_id=0c67797d444d4c929b2ccab47c468848)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:25.122907 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2552f771-ea1f-4187-8826-b7adbf70efbd admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:25.128839 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-8e9e4e81-b527-4f91-8195-7c30c920e896 None None] MFA Rules not processed for user `9efc9ad6f7524175ae8bb7a67f6f2c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:25.130291 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-8e9e4e81-b527-4f91-8195-7c30c920e896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:25.142358 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 795/1609] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:45:25 2022] PUT /identity/v3/projects/936e89b946f64d9fa2955e1eea57169b/users/50f7df9dc9f2455d9426b1737770140f/roles/0c67797d444d4c929b2ccab47c468848 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:45:25.144254 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a1271-8e38-4241-9478-12ce07391b57 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:25.145356 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a1271-8e38-4241-9478-12ce07391b57 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:25.145921 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a1271-8e38-4241-9478-12ce07391b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:25.180647 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-ce3a1271-8e38-4241-9478-12ce07391b57 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:25.181993 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-ce3a1271-8e38-4241-9478-12ce07391b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:25.233847 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 815/1610] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:45:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:45:25.235756 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84bc44-4c43-4a6d-a433-e7ac3f533ec2 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:25.236593 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84bc44-4c43-4a6d-a433-e7ac3f533ec2 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:25.237122 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84bc44-4c43-4a6d-a433-e7ac3f533ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:25.277753 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-cf84bc44-4c43-4a6d-a433-e7ac3f533ec2 None None] MFA Rules not processed for user `60e544f8015a4b5d805c12e56eb2ca28`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:25.283869 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 796/1611] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:45:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:45:25.284189 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-cf84bc44-4c43-4a6d-a433-e7ac3f533ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:25.285140 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3a1271-8e38-4241-9478-12ce07391b57 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:25.306535 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3a1271-8e38-4241-9478-12ce07391b57 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:25.315730 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a3c090-4849-468b-90d3-d216f82d0df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:25.317211 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3c090-4849-468b-90d3-d216f82d0df3 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:25.317671 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3c090-4849-468b-90d3-d216f82d0df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:25.318023 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3c090-4849-468b-90d3-d216f82d0df3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:25.318801 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a3c090-4849-468b-90d3-d216f82d0df3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:25.321518 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a3c090-4849-468b-90d3-d216f82d0df3 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:25.362848 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 797/1612] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:45:25 2022] POST /identity/v3/projects => generated 381 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:45:25.367129 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a3c090-4849-468b-90d3-d216f82d0df3 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:25.418701 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 816/1613] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:45:25 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:45:25.418701 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae119d7a-1ce7-4274-95cd-11d9da7c5958 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:25.418701 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae119d7a-1ce7-4274-95cd-11d9da7c5958 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:25.418701 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae119d7a-1ce7-4274-95cd-11d9da7c5958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:25.435566 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:25.451377 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-ae119d7a-1ce7-4274-95cd-11d9da7c5958 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:25.452277 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a3c090-4849-468b-90d3-d216f82d0df3 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:25.453606 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-ae119d7a-1ce7-4274-95cd-11d9da7c5958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:25.457879 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7447566f-6097-4203-997f-93b57632d51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:25.458665 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447566f-6097-4203-997f-93b57632d51a admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:25.458991 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447566f-6097-4203-997f-93b57632d51a admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:25.459265 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447566f-6097-4203-997f-93b57632d51a admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:25.459906 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7447566f-6097-4203-997f-93b57632d51a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:25.462676 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7447566f-6097-4203-997f-93b57632d51a admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:25.465748 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 817/1614] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:45:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:45:25.467618 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd28cae-4348-44c4-9f76-8170e6b06015 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:25.468504 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd28cae-4348-44c4-9f76-8170e6b06015 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:25.469216 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd28cae-4348-44c4-9f76-8170e6b06015 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:25.471296 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 818/1615] 10.222.0.47 () {54 vars in 962 bytes} [Mon Aug 29 22:45:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:45:25.472538 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd28cae-4348-44c4-9f76-8170e6b06015 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:25.520888 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 798/1616] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:45:25 2022] POST /identity/v3/projects => generated 365 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:45:25.521800 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7447566f-6097-4203-997f-93b57632d51a admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:25.576029 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd28cae-4348-44c4-9f76-8170e6b06015 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:25.621733 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7447566f-6097-4203-997f-93b57632d51a admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:25.622002 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:25.630163 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e938ce22-e710-4dc2-8b4a-9d02cc6ba8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:25.631083 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938ce22-e710-4dc2-8b4a-9d02cc6ba8d3 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:25.631496 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938ce22-e710-4dc2-8b4a-9d02cc6ba8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:25.631811 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938ce22-e710-4dc2-8b4a-9d02cc6ba8d3 admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:25.633054 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e938ce22-e710-4dc2-8b4a-9d02cc6ba8d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:25.636903 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e938ce22-e710-4dc2-8b4a-9d02cc6ba8d3 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:25.673529 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 799/1617] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:45:25 2022] POST /identity/v3/users => generated 297 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:45:25.678382 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e938ce22-e710-4dc2-8b4a-9d02cc6ba8d3 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:25.693036 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e938ce22-e710-4dc2-8b4a-9d02cc6ba8d3 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:25.698426 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f1424-dcb5-406d-a2b4-061b6116ad6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:25.699053 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f1424-dcb5-406d-a2b4-061b6116ad6b admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:25.699389 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f1424-dcb5-406d-a2b4-061b6116ad6b admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:25.699721 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f1424-dcb5-406d-a2b4-061b6116ad6b admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:25.700100 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5575f0c4-e416-4909-b5b7-6d59c6b99a63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:25.700570 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742f1424-dcb5-406d-a2b4-061b6116ad6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:25.700734 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575f0c4-e416-4909-b5b7-6d59c6b99a63 service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:25.701011 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575f0c4-e416-4909-b5b7-6d59c6b99a63 service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:25.701285 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575f0c4-e416-4909-b5b7-6d59c6b99a63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:25.702740 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742f1424-dcb5-406d-a2b4-061b6116ad6b admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:25.721630 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5575f0c4-e416-4909-b5b7-6d59c6b99a63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:25.723543 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5575f0c4-e416-4909-b5b7-6d59c6b99a63 service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:25.744275 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 819/1618] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:45:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:45:25.745699 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8771029c-b3e4-4170-a578-d954c381f289 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:25.745983 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8771029c-b3e4-4170-a578-d954c381f289 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:25.746259 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8771029c-b3e4-4170-a578-d954c381f289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:25.761694 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 800/1619] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:45:25 2022] POST /identity/v3/projects => generated 403 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:45:25.767845 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f1424-dcb5-406d-a2b4-061b6116ad6b admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:25.836898 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-8771029c-b3e4-4170-a578-d954c381f289 None None] MFA Rules not processed for user `35441c061e514b1b9341e7694ec2c0bc`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:25.838114 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-8771029c-b3e4-4170-a578-d954c381f289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:25.892238 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f1424-dcb5-406d-a2b4-061b6116ad6b admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:25.897647 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae917d79-89ee-4e63-ac1b-cbd0e62b5295 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:25.898313 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae917d79-89ee-4e63-ac1b-cbd0e62b5295 service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:25.898605 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae917d79-89ee-4e63-ac1b-cbd0e62b5295 service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:25.898934 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae917d79-89ee-4e63-ac1b-cbd0e62b5295 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:25.985764 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 820/1620] 10.222.0.47 () {58 vars in 1059 bytes} [Mon Aug 29 22:45:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:45:25.987484 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8771029c-b3e4-4170-a578-d954c381f289 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:25.997207 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:26.008227 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae917d79-89ee-4e63-ac1b-cbd0e62b5295 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:26.011084 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae917d79-89ee-4e63-ac1b-cbd0e62b5295 service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:26.041585 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 801/1621] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:45:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:45:26.042857 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae917d79-89ee-4e63-ac1b-cbd0e62b5295 service neutron] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:26.067864 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae917d79-89ee-4e63-ac1b-cbd0e62b5295 service neutron] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:26.070309 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8771029c-b3e4-4170-a578-d954c381f289 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:26.075063 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3151b3-000f-4fbb-95bb-bea7d15002c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:26.075679 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3151b3-000f-4fbb-95bb-bea7d15002c7 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:26.075958 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3151b3-000f-4fbb-95bb-bea7d15002c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:26.076229 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3151b3-000f-4fbb-95bb-bea7d15002c7 admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:26.076867 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3151b3-000f-4fbb-95bb-bea7d15002c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:26.079125 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3151b3-000f-4fbb-95bb-bea7d15002c7 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:26.083408 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15958c09-6f34-4ef8-9522-4cad28573086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:26.085700 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15958c09-6f34-4ef8-9522-4cad28573086 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:26.085996 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15958c09-6f34-4ef8-9522-4cad28573086 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:26.086279 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15958c09-6f34-4ef8-9522-4cad28573086 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:26.087644 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15958c09-6f34-4ef8-9522-4cad28573086 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:26.092976 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15958c09-6f34-4ef8-9522-4cad28573086 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:26.107774 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 802/1622] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:45:26 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:45:26.108700 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15958c09-6f34-4ef8-9522-4cad28573086 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:26.117562 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 821/1623] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:45:25 2022] POST /identity/v3/users => generated 289 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:45:26.121392 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3151b3-000f-4fbb-95bb-bea7d15002c7 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:26.124297 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15958c09-6f34-4ef8-9522-4cad28573086 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:26.134710 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915f3028-12a2-4a5f-984b-60cb940705e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:26.135371 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f3028-12a2-4a5f-984b-60cb940705e7 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:26.136553 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f3028-12a2-4a5f-984b-60cb940705e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:26.136553 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f3028-12a2-4a5f-984b-60cb940705e7 admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:26.136946 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915f3028-12a2-4a5f-984b-60cb940705e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:26.140035 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915f3028-12a2-4a5f-984b-60cb940705e7 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:26.154597 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3151b3-000f-4fbb-95bb-bea7d15002c7 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:26.172698 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7905996d-240b-4918-a0c1-3038875d3123 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35441c061e514b1b9341e7694ec2c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:26.173558 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905996d-240b-4918-a0c1-3038875d3123 service nova] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:26.174057 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905996d-240b-4918-a0c1-3038875d3123 service nova] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:26.175030 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905996d-240b-4918-a0c1-3038875d3123 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:26.179178 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 803/1624] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:45:26 2022] POST /identity/v3/users => generated 308 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:45:26.180432 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915f3028-12a2-4a5f-984b-60cb940705e7 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:26.201663 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915f3028-12a2-4a5f-984b-60cb940705e7 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:26.208374 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2ac8af-a175-48c7-b760-beb136b14782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:26.209590 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ac8af-a175-48c7-b760-beb136b14782 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:26.209950 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ac8af-a175-48c7-b760-beb136b14782 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:26.210300 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ac8af-a175-48c7-b760-beb136b14782 admin admin] PATH_INFO: `/v3/projects/5c7e4f8c29ce494e894058a793c218da/users/111bc92de66e4f5da3d1814cfa68eefc/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:26.240742 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2ac8af-a175-48c7-b760-beb136b14782 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c7e4f8c29ce494e894058a793c218da, user_id=111bc92de66e4f5da3d1814cfa68eefc, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:26.245927 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2ac8af-a175-48c7-b760-beb136b14782 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:26.253543 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:26.296520 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 804/1625] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:45:26 2022] PUT /identity/v3/projects/5c7e4f8c29ce494e894058a793c218da/users/111bc92de66e4f5da3d1814cfa68eefc/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:45:26.297606 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2ac8af-a175-48c7-b760-beb136b14782 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:26.315370 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7905996d-240b-4918-a0c1-3038875d3123 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:26.317030 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7905996d-240b-4918-a0c1-3038875d3123 service nova] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:26.344013 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 822/1626] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:45:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:45:26.356087 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7905996d-240b-4918-a0c1-3038875d3123 service nova] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:26.378435 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7905996d-240b-4918-a0c1-3038875d3123 service nova] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:26.406657 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2ac8af-a175-48c7-b760-beb136b14782 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:26.417382 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead8e3a1-3fb1-41fd-85f4-0bdb75276115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:26.419305 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8e3a1-3fb1-41fd-85f4-0bdb75276115 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:26.420280 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8e3a1-3fb1-41fd-85f4-0bdb75276115 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:26.420985 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8e3a1-3fb1-41fd-85f4-0bdb75276115 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:26.422275 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead8e3a1-3fb1-41fd-85f4-0bdb75276115 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:26.430944 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead8e3a1-3fb1-41fd-85f4-0bdb75276115 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:26.451812 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 805/1627] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:45:26 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:45:26.452996 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead8e3a1-3fb1-41fd-85f4-0bdb75276115 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:26.475878 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead8e3a1-3fb1-41fd-85f4-0bdb75276115 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:26.483636 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a383c-f7c1-4769-8b88-9ca35ee6c958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:26.484560 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a383c-f7c1-4769-8b88-9ca35ee6c958 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:26.485614 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a383c-f7c1-4769-8b88-9ca35ee6c958 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:26.485995 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a383c-f7c1-4769-8b88-9ca35ee6c958 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:26.486697 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1a383c-f7c1-4769-8b88-9ca35ee6c958 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:26.490120 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1a383c-f7c1-4769-8b88-9ca35ee6c958 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:26.510648 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 806/1628] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:45:26 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:45:26.510648 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a383c-f7c1-4769-8b88-9ca35ee6c958 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:26.518326 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d37032a-aa73-4172-ac50-7d8369b83337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:26.518923 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37032a-aa73-4172-ac50-7d8369b83337 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:26.518923 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37032a-aa73-4172-ac50-7d8369b83337 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:26.519090 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37032a-aa73-4172-ac50-7d8369b83337 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:26.521996 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d37032a-aa73-4172-ac50-7d8369b83337 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:26.523781 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a383c-f7c1-4769-8b88-9ca35ee6c958 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:26.523915 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d37032a-aa73-4172-ac50-7d8369b83337 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:26.528039 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a372f52-9aba-4b2d-9f97-5664f4fcb923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:26.529475 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a372f52-9aba-4b2d-9f97-5664f4fcb923 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:26.529875 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a372f52-9aba-4b2d-9f97-5664f4fcb923 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:26.530234 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a372f52-9aba-4b2d-9f97-5664f4fcb923 admin admin] PATH_INFO: `/v3/projects/108019c33607456d9fbbf252e95e5c77/users/1202fb08db3647e880944b27a531a76e/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:26.546916 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 823/1629] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:45:26 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:45:26.550728 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d37032a-aa73-4172-ac50-7d8369b83337 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:26.556614 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a372f52-9aba-4b2d-9f97-5664f4fcb923 admin admin] RBAC: Authorizing `identity:create_grant(project_id=108019c33607456d9fbbf252e95e5c77, user_id=1202fb08db3647e880944b27a531a76e, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:26.559552 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a372f52-9aba-4b2d-9f97-5664f4fcb923 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:26.575573 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d37032a-aa73-4172-ac50-7d8369b83337 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:26.594614 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 807/1630] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:45:26 2022] PUT /identity/v3/projects/108019c33607456d9fbbf252e95e5c77/users/1202fb08db3647e880944b27a531a76e/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:45:26.595873 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a372f52-9aba-4b2d-9f97-5664f4fcb923 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:26.717321 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f4d351-17d2-471f-8083-db6a51a15ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:26.718133 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f4d351-17d2-471f-8083-db6a51a15ca5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:26.718409 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f4d351-17d2-471f-8083-db6a51a15ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:26.718680 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f4d351-17d2-471f-8083-db6a51a15ca5 admin admin] PATH_INFO: `/v3/projects/5c7e4f8c29ce494e894058a793c218da/users/111bc92de66e4f5da3d1814cfa68eefc/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:26.729649 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f4d351-17d2-471f-8083-db6a51a15ca5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c7e4f8c29ce494e894058a793c218da, user_id=111bc92de66e4f5da3d1814cfa68eefc, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:26.733045 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f4d351-17d2-471f-8083-db6a51a15ca5 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:26.753974 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a372f52-9aba-4b2d-9f97-5664f4fcb923 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:26.760765 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 824/1631] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:45:26 2022] PUT /identity/v3/projects/5c7e4f8c29ce494e894058a793c218da/users/111bc92de66e4f5da3d1814cfa68eefc/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:45:26.762130 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f4d351-17d2-471f-8083-db6a51a15ca5 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:26.777197 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:26.881482 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301a0d5e-9182-4697-bec2-7a40896d0c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:26.882170 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a0d5e-9182-4697-bec2-7a40896d0c3e admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:26.882610 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a0d5e-9182-4697-bec2-7a40896d0c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:26.882849 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a0d5e-9182-4697-bec2-7a40896d0c3e admin admin] PATH_INFO: `/v3/projects/e0ef6814c4264a3ab8992d05e82aca1a/users/fa4f79fb58c046a4b554adaebac5baf6/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:26.904167 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f4d351-17d2-471f-8083-db6a51a15ca5 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:26.917867 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc58d04-8ea7-4d6f-a9b3-9fc2bb2dfcd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:26.918832 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc58d04-8ea7-4d6f-a9b3-9fc2bb2dfcd0 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:26.919175 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc58d04-8ea7-4d6f-a9b3-9fc2bb2dfcd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:26.919890 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc58d04-8ea7-4d6f-a9b3-9fc2bb2dfcd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:26.920868 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc58d04-8ea7-4d6f-a9b3-9fc2bb2dfcd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:26.923344 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301a0d5e-9182-4697-bec2-7a40896d0c3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0ef6814c4264a3ab8992d05e82aca1a, user_id=fa4f79fb58c046a4b554adaebac5baf6, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:26.923590 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc58d04-8ea7-4d6f-a9b3-9fc2bb2dfcd0 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:26.926569 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301a0d5e-9182-4697-bec2-7a40896d0c3e admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:26.938957 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:26.949660 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 808/1632] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:45:26 2022] PUT /identity/v3/projects/e0ef6814c4264a3ab8992d05e82aca1a/users/fa4f79fb58c046a4b554adaebac5baf6/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:45:26.958432 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 825/1633] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:45:26 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:45:26.958432 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32d0e1-afef-404e-be82-be647b49cc54 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:26.958432 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32d0e1-afef-404e-be82-be647b49cc54 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:26.958841 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d599c5f6-5418-42a2-9874-64d3630b5d57 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:26.958932 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32d0e1-afef-404e-be82-be647b49cc54 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:26.959009 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d599c5f6-5418-42a2-9874-64d3630b5d57 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:26.959009 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d599c5f6-5418-42a2-9874-64d3630b5d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:26.960131 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 826/1634] 10.222.0.47 () {54 vars in 912 bytes} [Mon Aug 29 22:45:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:45:26.965001 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be32d0e1-afef-404e-be82-be647b49cc54 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:27.031320 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-d599c5f6-5418-42a2-9874-64d3630b5d57 None None] MFA Rules not processed for user `111bc92de66e4f5da3d1814cfa68eefc`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:27.033203 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-d599c5f6-5418-42a2-9874-64d3630b5d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:27.084926 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be32d0e1-afef-404e-be82-be647b49cc54 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:27.092035 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a59f934-37b2-4120-85af-9547e8eb2dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:27.093670 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a59f934-37b2-4120-85af-9547e8eb2dd4 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:27.094377 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a59f934-37b2-4120-85af-9547e8eb2dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:27.095234 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a59f934-37b2-4120-85af-9547e8eb2dd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:27.097125 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a59f934-37b2-4120-85af-9547e8eb2dd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:27.100169 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a59f934-37b2-4120-85af-9547e8eb2dd4 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:27.120241 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 827/1635] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:45:26 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:45:27.121128 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a59f934-37b2-4120-85af-9547e8eb2dd4 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:27.136282 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a59f934-37b2-4120-85af-9547e8eb2dd4 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:27.150453 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7342d2fe-6377-440b-af9d-619008b87b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:27.151349 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342d2fe-6377-440b-af9d-619008b87b1c admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:27.151643 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342d2fe-6377-440b-af9d-619008b87b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:27.151917 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342d2fe-6377-440b-af9d-619008b87b1c admin admin] PATH_INFO: `/v3/projects/108019c33607456d9fbbf252e95e5c77/users/1202fb08db3647e880944b27a531a76e/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:27.155425 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7342d2fe-6377-440b-af9d-619008b87b1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=108019c33607456d9fbbf252e95e5c77, user_id=1202fb08db3647e880944b27a531a76e, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:27.158746 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7342d2fe-6377-440b-af9d-619008b87b1c admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:27.181624 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 828/1636] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:45:27 2022] PUT /identity/v3/projects/108019c33607456d9fbbf252e95e5c77/users/1202fb08db3647e880944b27a531a76e/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:45:27.183068 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0c18a0-7cf4-4313-9876-4fc6a2abac6d None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:27.183360 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0c18a0-7cf4-4313-9876-4fc6a2abac6d None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:27.183779 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0c18a0-7cf4-4313-9876-4fc6a2abac6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:27.222022 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 809/1637] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:45:26 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:45:27.222022 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d599c5f6-5418-42a2-9874-64d3630b5d57 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:27.230806 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-1f0c18a0-7cf4-4313-9876-4fc6a2abac6d None None] MFA Rules not processed for user `35441c061e514b1b9341e7694ec2c0bc`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:27.232063 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-1f0c18a0-7cf4-4313-9876-4fc6a2abac6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:27.239937 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d599c5f6-5418-42a2-9874-64d3630b5d57 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:27.410910 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3190400-36a0-4e64-9bce-18590b825268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:27.410910 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3190400-36a0-4e64-9bce-18590b825268 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:27.410910 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3190400-36a0-4e64-9bce-18590b825268 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:27.410910 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3190400-36a0-4e64-9bce-18590b825268 admin admin] PATH_INFO: `/v3/projects/e0ef6814c4264a3ab8992d05e82aca1a/users/fa4f79fb58c046a4b554adaebac5baf6/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:27.412717 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3190400-36a0-4e64-9bce-18590b825268 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0ef6814c4264a3ab8992d05e82aca1a, user_id=fa4f79fb58c046a4b554adaebac5baf6, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:27.412717 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3190400-36a0-4e64-9bce-18590b825268 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:27.423487 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 810/1638] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:45:27 2022] PUT /identity/v3/projects/e0ef6814c4264a3ab8992d05e82aca1a/users/fa4f79fb58c046a4b554adaebac5baf6/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:45:27.433061 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04935c05-7d03-4bea-8156-f99161f0abb4 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:27.433061 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04935c05-7d03-4bea-8156-f99161f0abb4 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:27.433061 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04935c05-7d03-4bea-8156-f99161f0abb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:27.468538 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 829/1639] 10.222.0.47 () {58 vars in 1009 bytes} [Mon Aug 29 22:45:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:45:27.470370 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0c18a0-7cf4-4313-9876-4fc6a2abac6d None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:27.555705 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:27.581243 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-04935c05-7d03-4bea-8156-f99161f0abb4 None None] MFA Rules not processed for user `1202fb08db3647e880944b27a531a76e`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:27.583002 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-04935c05-7d03-4bea-8156-f99161f0abb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:27.628029 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0c18a0-7cf4-4313-9876-4fc6a2abac6d None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:27.682672 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:27.731649 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3055b548-705b-473e-9801-2d5e5a4f55bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:27.733441 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3055b548-705b-473e-9801-2d5e5a4f55bf service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:27.734428 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3055b548-705b-473e-9801-2d5e5a4f55bf service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:27.735389 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3055b548-705b-473e-9801-2d5e5a4f55bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:27.757594 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 811/1640] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:45:27 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:45:27.759437 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ba9e9-e5d5-43ff-9379-c7123ec99fc2 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:27.759824 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ba9e9-e5d5-43ff-9379-c7123ec99fc2 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:27.760207 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ba9e9-e5d5-43ff-9379-c7123ec99fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:27.810552 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-700ba9e9-e5d5-43ff-9379-c7123ec99fc2 None None] MFA Rules not processed for user `fa4f79fb58c046a4b554adaebac5baf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:27.812279 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-700ba9e9-e5d5-43ff-9379-c7123ec99fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:27.845731 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3055b548-705b-473e-9801-2d5e5a4f55bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:27.851199 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3055b548-705b-473e-9801-2d5e5a4f55bf service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:27.866583 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 830/1641] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:45:27 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:45:27.867806 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3055b548-705b-473e-9801-2d5e5a4f55bf service cinder] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:27.878705 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3055b548-705b-473e-9801-2d5e5a4f55bf service cinder] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:27.891103 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b7e7d0-5717-44fd-8784-90e856746257 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:27.892280 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7e7d0-5717-44fd-8784-90e856746257 service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:27.892786 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7e7d0-5717-44fd-8784-90e856746257 service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:27.893305 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7e7d0-5717-44fd-8784-90e856746257 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:27.923259 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 812/1642] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:45:27 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:45:27.936507 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ba9e9-e5d5-43ff-9379-c7123ec99fc2 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:27.964286 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ba9e9-e5d5-43ff-9379-c7123ec99fc2 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:27.968440 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc3e52f-e701-4b3d-9a19-5e481c5cf144 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:27.969047 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3e52f-e701-4b3d-9a19-5e481c5cf144 service cinder] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:27.969588 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3e52f-e701-4b3d-9a19-5e481c5cf144 service cinder] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:27.969823 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3e52f-e701-4b3d-9a19-5e481c5cf144 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:27.987332 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc3e52f-e701-4b3d-9a19-5e481c5cf144 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:27.991057 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc3e52f-e701-4b3d-9a19-5e481c5cf144 service cinder] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:28.007664 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 813/1643] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:45:27 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:45:28.018315 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b7e7d0-5717-44fd-8784-90e856746257 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:28.022505 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b7e7d0-5717-44fd-8784-90e856746257 service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:28.041065 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 831/1644] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:45:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:45:28.085205 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc3e52f-e701-4b3d-9a19-5e481c5cf144 service cinder] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:28.094869 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc3e52f-e701-4b3d-9a19-5e481c5cf144 service cinder] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:28.100619 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26215fc-a156-4b9b-83a3-a2834fd1b263 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:28.102006 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26215fc-a156-4b9b-83a3-a2834fd1b263 service cinder] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:28.102667 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26215fc-a156-4b9b-83a3-a2834fd1b263 service cinder] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:28.103055 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26215fc-a156-4b9b-83a3-a2834fd1b263 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:28.117371 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26215fc-a156-4b9b-83a3-a2834fd1b263 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:28.119470 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26215fc-a156-4b9b-83a3-a2834fd1b263 service cinder] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:28.144654 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 814/1645] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:45:28 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:45:28.680534 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b7e7d0-5717-44fd-8784-90e856746257 service cinder] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:28.721826 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b7e7d0-5717-44fd-8784-90e856746257 service cinder] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:28.742719 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee921b-f8a4-40ab-b959-60bf08ae6809 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:28.745261 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee921b-f8a4-40ab-b959-60bf08ae6809 service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:28.747777 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee921b-f8a4-40ab-b959-60bf08ae6809 service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:28.748263 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee921b-f8a4-40ab-b959-60bf08ae6809 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:29.041394 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ee921b-f8a4-40ab-b959-60bf08ae6809 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:29.043970 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ee921b-f8a4-40ab-b959-60bf08ae6809 service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:29.092180 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 832/1646] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:45:28 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:45:29.102002 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26215fc-a156-4b9b-83a3-a2834fd1b263 service cinder] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:29.132130 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26215fc-a156-4b9b-83a3-a2834fd1b263 service cinder] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:29.160303 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0706913-7db2-4453-aad5-4dd256c21382 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:29.163052 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0706913-7db2-4453-aad5-4dd256c21382 service cinder] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:29.163559 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0706913-7db2-4453-aad5-4dd256c21382 service cinder] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:29.164044 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0706913-7db2-4453-aad5-4dd256c21382 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:29.418380 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:29.428947 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0706913-7db2-4453-aad5-4dd256c21382 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:29.430586 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0706913-7db2-4453-aad5-4dd256c21382 service cinder] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:29.452428 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 815/1647] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:45:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:45:29.931913 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee921b-f8a4-40ab-b959-60bf08ae6809 service cinder] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:29.937543 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:30.222268 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee921b-f8a4-40ab-b959-60bf08ae6809 service cinder] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:30.233412 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4bc50d-9698-4732-9b66-c0c3fa5979d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:30.234497 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4bc50d-9698-4732-9b66-c0c3fa5979d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:30.234803 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4bc50d-9698-4732-9b66-c0c3fa5979d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:30.235079 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4bc50d-9698-4732-9b66-c0c3fa5979d7 admin admin] PATH_INFO: `/v3/users/60e544f8015a4b5d805c12e56eb2ca28` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:30.236371 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4bc50d-9698-4732-9b66-c0c3fa5979d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60e544f8015a4b5d805c12e56eb2ca28)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:30.237423 dv-cinder-854270-4-smb devstack@keystone.service[88339]: WARNING py.warnings [None req-8c4bc50d-9698-4732-9b66-c0c3fa5979d7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 22:45:30.237423 dv-cinder-854270-4-smb devstack@keystone.service[88339]: warnings.warn(msg) Aug 29 22:45:30.237423 dv-cinder-854270-4-smb devstack@keystone.service[88339]: Aug 29 22:45:30.238713 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4bc50d-9698-4732-9b66-c0c3fa5979d7 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:30.379657 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-8c4bc50d-9698-4732-9b66-c0c3fa5979d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60e544f8015a4b5d805c12e56eb2ca28'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:30.397384 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-8c4bc50d-9698-4732-9b66-c0c3fa5979d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60e544f8015a4b5d805c12e56eb2ca28'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:30.398252 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-8c4bc50d-9698-4732-9b66-c0c3fa5979d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60e544f8015a4b5d805c12e56eb2ca28'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:30.412562 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-8c4bc50d-9698-4732-9b66-c0c3fa5979d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60e544f8015a4b5d805c12e56eb2ca28'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:30.413592 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-8c4bc50d-9698-4732-9b66-c0c3fa5979d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60e544f8015a4b5d805c12e56eb2ca28'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:30.530651 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 833/1648] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:45:29 2022] DELETE /identity/v3/users/60e544f8015a4b5d805c12e56eb2ca28 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:45:30.531699 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b50e10-2c4e-41e7-8676-c057a4b683aa None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:30.532173 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b50e10-2c4e-41e7-8676-c057a4b683aa None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:30.532371 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b50e10-2c4e-41e7-8676-c057a4b683aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:30.595737 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-85b50e10-2c4e-41e7-8676-c057a4b683aa None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:30.597026 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-85b50e10-2c4e-41e7-8676-c057a4b683aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:30.812179 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 816/1649] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:45:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:45:30.837949 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4bc50d-9698-4732-9b66-c0c3fa5979d7 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:30.840047 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-8c4bc50d-9698-4732-9b66-c0c3fa5979d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:30.920992 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a27102-8d30-4c19-ab03-51e1385a1b49 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:30.921220 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a27102-8d30-4c19-ab03-51e1385a1b49 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:30.921539 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a27102-8d30-4c19-ab03-51e1385a1b49 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:30.923496 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 817/1650] 10.222.0.47 () {54 vars in 962 bytes} [Mon Aug 29 22:45:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:45:30.970192 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353dbac0-9144-4681-9308-b0c70d1253fc None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:30.970192 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353dbac0-9144-4681-9308-b0c70d1253fc None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:30.970192 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353dbac0-9144-4681-9308-b0c70d1253fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:31.043531 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-353dbac0-9144-4681-9308-b0c70d1253fc None None] MFA Rules not processed for user `35441c061e514b1b9341e7694ec2c0bc`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:31.047983 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-353dbac0-9144-4681-9308-b0c70d1253fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:31.070143 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4bc50d-9698-4732-9b66-c0c3fa5979d7 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:31.083429 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fbcf99-aca7-4a39-bbdc-40a09e762b4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:31.084071 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fbcf99-aca7-4a39-bbdc-40a09e762b4d service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:31.084350 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fbcf99-aca7-4a39-bbdc-40a09e762b4d service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:31.084619 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fbcf99-aca7-4a39-bbdc-40a09e762b4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:31.136132 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fbcf99-aca7-4a39-bbdc-40a09e762b4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:31.140656 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fbcf99-aca7-4a39-bbdc-40a09e762b4d service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:31.176328 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 834/1651] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:45:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:45:31.264162 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 818/1652] 10.222.0.47 () {58 vars in 1059 bytes} [Mon Aug 29 22:45:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:45:31.274188 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19536624-fd60-4ca3-9d87-fa82525b4501 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:31.274188 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19536624-fd60-4ca3-9d87-fa82525b4501 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:31.274188 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19536624-fd60-4ca3-9d87-fa82525b4501 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:31.274188 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 835/1653] 10.222.0.47 () {54 vars in 912 bytes} [Mon Aug 29 22:45:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:45:31.284580 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd1bae-00b1-49db-96fe-ba863c5cc990 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:31.284870 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd1bae-00b1-49db-96fe-ba863c5cc990 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:31.285153 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd1bae-00b1-49db-96fe-ba863c5cc990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:31.337200 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-90dd1bae-00b1-49db-96fe-ba863c5cc990 None None] MFA Rules not processed for user `35441c061e514b1b9341e7694ec2c0bc`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:31.343604 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-90dd1bae-00b1-49db-96fe-ba863c5cc990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:31.385982 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 819/1654] 10.222.0.47 () {58 vars in 1009 bytes} [Mon Aug 29 22:45:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:45:31.464221 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19536624-fd60-4ca3-9d87-fa82525b4501 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:31.466151 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-19536624-fd60-4ca3-9d87-fa82525b4501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:31.531053 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:31.614313 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19536624-fd60-4ca3-9d87-fa82525b4501 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:31.619181 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f60e7-ce4a-41ea-a6ae-0d731ae8a1ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:31.619824 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f60e7-ce4a-41ea-a6ae-0d731ae8a1ea service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:31.620102 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f60e7-ce4a-41ea-a6ae-0d731ae8a1ea service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:31.620372 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f60e7-ce4a-41ea-a6ae-0d731ae8a1ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:31.649670 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57f60e7-ce4a-41ea-a6ae-0d731ae8a1ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:31.651171 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57f60e7-ce4a-41ea-a6ae-0d731ae8a1ea service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:31.675748 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 836/1655] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:45:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:45:32.385773 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dd1bae-00b1-49db-96fe-ba863c5cc990 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:32.386383 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-90dd1bae-00b1-49db-96fe-ba863c5cc990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:32.439925 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dd1bae-00b1-49db-96fe-ba863c5cc990 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:32.449312 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9eebee-449e-4bcb-b123-64179334b589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:32.450844 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9eebee-449e-4bcb-b123-64179334b589 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:32.451487 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9eebee-449e-4bcb-b123-64179334b589 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:32.452243 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9eebee-449e-4bcb-b123-64179334b589 admin admin] PATH_INFO: `/v3/users/390c624745d3449aad6ab4d76dde5f17` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:32.456036 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9eebee-449e-4bcb-b123-64179334b589 admin admin] RBAC: Authorizing `identity:delete_user(user_id=390c624745d3449aad6ab4d76dde5f17)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:32.461297 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9eebee-449e-4bcb-b123-64179334b589 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:32.580691 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-fe9eebee-449e-4bcb-b123-64179334b589 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '390c624745d3449aad6ab4d76dde5f17'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:32.597837 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-fe9eebee-449e-4bcb-b123-64179334b589 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '390c624745d3449aad6ab4d76dde5f17'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:32.601821 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-fe9eebee-449e-4bcb-b123-64179334b589 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '390c624745d3449aad6ab4d76dde5f17'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:32.635366 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-fe9eebee-449e-4bcb-b123-64179334b589 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '390c624745d3449aad6ab4d76dde5f17'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:32.637299 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:32.650957 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-fe9eebee-449e-4bcb-b123-64179334b589 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '390c624745d3449aad6ab4d76dde5f17'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:32.660018 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 820/1656] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:45:32 2022] DELETE /identity/v3/users/390c624745d3449aad6ab4d76dde5f17 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:45:32.665733 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed092d29-93dd-4bf7-8ff9-dca1d6567210 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:32.666271 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed092d29-93dd-4bf7-8ff9-dca1d6567210 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:32.666271 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed092d29-93dd-4bf7-8ff9-dca1d6567210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:32.706408 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-ed092d29-93dd-4bf7-8ff9-dca1d6567210 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:32.708401 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-ed092d29-93dd-4bf7-8ff9-dca1d6567210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:32.794636 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 837/1657] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:45:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:45:32.816995 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9eebee-449e-4bcb-b123-64179334b589 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:32.820486 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-fe9eebee-449e-4bcb-b123-64179334b589 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:32.927601 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9eebee-449e-4bcb-b123-64179334b589 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:32.945513 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e221910-116f-4a00-a908-1d0875691ce3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:32.946174 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e221910-116f-4a00-a908-1d0875691ce3 service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:32.946842 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e221910-116f-4a00-a908-1d0875691ce3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:32.947130 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e221910-116f-4a00-a908-1d0875691ce3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:32.962388 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e221910-116f-4a00-a908-1d0875691ce3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:32.964007 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e221910-116f-4a00-a908-1d0875691ce3 service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:32.978058 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 821/1658] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:45:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:45:33.387490 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f6e5e-525b-4e31-8dfd-293c860ffdb7 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:33.387787 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f6e5e-525b-4e31-8dfd-293c860ffdb7 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:33.388050 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f6e5e-525b-4e31-8dfd-293c860ffdb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:33.467118 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-ab8f6e5e-525b-4e31-8dfd-293c860ffdb7 None None] MFA Rules not processed for user `c9d2b7dc4c6f4061a2606e514d2a4c88`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:33.474614 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-ab8f6e5e-525b-4e31-8dfd-293c860ffdb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:33.613448 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e221910-116f-4a00-a908-1d0875691ce3 service neutron] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:33.616950 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-4e221910-116f-4a00-a908-1d0875691ce3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:33.641257 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e221910-116f-4a00-a908-1d0875691ce3 service neutron] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:33.655001 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc9784f-14b4-4309-9f81-8a2a1eff46de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:33.655667 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc9784f-14b4-4309-9f81-8a2a1eff46de admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:33.655948 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc9784f-14b4-4309-9f81-8a2a1eff46de admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:33.656223 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc9784f-14b4-4309-9f81-8a2a1eff46de admin admin] PATH_INFO: `/v3/users/9efc9ad6f7524175ae8bb7a67f6f2c1f` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:33.661183 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc9784f-14b4-4309-9f81-8a2a1eff46de admin admin] RBAC: Authorizing `identity:delete_user(user_id=9efc9ad6f7524175ae8bb7a67f6f2c1f)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:33.663231 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc9784f-14b4-4309-9f81-8a2a1eff46de admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:33.712651 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 838/1659] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:45:33 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:45:33.717872 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce87581-1642-4ac3-adac-9be8e09a32b2 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:33.718215 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce87581-1642-4ac3-adac-9be8e09a32b2 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:33.718495 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce87581-1642-4ac3-adac-9be8e09a32b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:33.762977 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-1ce87581-1642-4ac3-adac-9be8e09a32b2 None None] MFA Rules not processed for user `c9d2b7dc4c6f4061a2606e514d2a4c88`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:33.768493 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-1ce87581-1642-4ac3-adac-9be8e09a32b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:33.792462 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 839/1660] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:45:33 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:45:33.793775 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce87581-1642-4ac3-adac-9be8e09a32b2 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:33.795127 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-fcc9784f-14b4-4309-9f81-8a2a1eff46de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9efc9ad6f7524175ae8bb7a67f6f2c1f'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:33.805977 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-1ce87581-1642-4ac3-adac-9be8e09a32b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:33.827501 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-fcc9784f-14b4-4309-9f81-8a2a1eff46de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9efc9ad6f7524175ae8bb7a67f6f2c1f'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:33.829173 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-fcc9784f-14b4-4309-9f81-8a2a1eff46de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9efc9ad6f7524175ae8bb7a67f6f2c1f'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:33.847749 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce87581-1642-4ac3-adac-9be8e09a32b2 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:33.859816 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1368bd0-ac04-446a-870a-29ab2d648338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:33.861045 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1368bd0-ac04-446a-870a-29ab2d648338 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:33.861895 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1368bd0-ac04-446a-870a-29ab2d648338 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:33.863290 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1368bd0-ac04-446a-870a-29ab2d648338 admin admin] PATH_INFO: `/v3/projects/855b90599dff4063a833adc4fdd78663` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:33.865826 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1368bd0-ac04-446a-870a-29ab2d648338 admin admin] RBAC: Authorizing `identity:delete_project(project_id=855b90599dff4063a833adc4fdd78663)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:33.869671 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1368bd0-ac04-446a-870a-29ab2d648338 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:33.877625 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-fcc9784f-14b4-4309-9f81-8a2a1eff46de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9efc9ad6f7524175ae8bb7a67f6f2c1f'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:33.902636 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-fcc9784f-14b4-4309-9f81-8a2a1eff46de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9efc9ad6f7524175ae8bb7a67f6f2c1f'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:33.925349 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 822/1661] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:45:33 2022] DELETE /identity/v3/users/9efc9ad6f7524175ae8bb7a67f6f2c1f => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:45:33.931402 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc9784f-14b4-4309-9f81-8a2a1eff46de admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:33.936392 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-fcc9784f-14b4-4309-9f81-8a2a1eff46de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:33.945590 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:33.946951 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-d1368bd0-ac04-446a-870a-29ab2d648338 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '855b90599dff4063a833adc4fdd78663', 'request_id': 'req-d1368bd0-ac04-446a-870a-29ab2d648338'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:33.958994 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-d1368bd0-ac04-446a-870a-29ab2d648338 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '855b90599dff4063a833adc4fdd78663', 'request_id': 'req-d1368bd0-ac04-446a-870a-29ab2d648338'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:33.972106 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-d1368bd0-ac04-446a-870a-29ab2d648338 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '855b90599dff4063a833adc4fdd78663', 'request_id': 'req-d1368bd0-ac04-446a-870a-29ab2d648338'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:33.991447 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-d1368bd0-ac04-446a-870a-29ab2d648338 admin admin] The token cache is being invalidate because project 855b90599dff4063a833adc4fdd78663 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:45:33.991686 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-d1368bd0-ac04-446a-870a-29ab2d648338 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:33.992929 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-d1368bd0-ac04-446a-870a-29ab2d648338 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:33.996166 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 840/1662] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:45:33 2022] DELETE /identity/v3/projects/855b90599dff4063a833adc4fdd78663 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:45:33.997117 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1368bd0-ac04-446a-870a-29ab2d648338 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:33.999094 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-d1368bd0-ac04-446a-870a-29ab2d648338 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:34.100897 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc9784f-14b4-4309-9f81-8a2a1eff46de admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:34.128224 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:34.151467 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1368bd0-ac04-446a-870a-29ab2d648338 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:34.168819 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bccbb42-bb21-4954-91bd-682f1c3dc9e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35441c061e514b1b9341e7694ec2c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:34.169556 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bccbb42-bb21-4954-91bd-682f1c3dc9e0 service nova] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:34.169885 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bccbb42-bb21-4954-91bd-682f1c3dc9e0 service nova] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:34.170163 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bccbb42-bb21-4954-91bd-682f1c3dc9e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:34.172813 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-3bccbb42-bb21-4954-91bd-682f1c3dc9e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:34.267339 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a83734-af3b-4dcd-8f4a-56e4db451e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:34.268011 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a83734-af3b-4dcd-8f4a-56e4db451e02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:34.268393 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a83734-af3b-4dcd-8f4a-56e4db451e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:34.269166 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a83734-af3b-4dcd-8f4a-56e4db451e02 admin admin] PATH_INFO: `/v3/projects/f3469f315b1146858349ee384d077f0e` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:34.271094 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a83734-af3b-4dcd-8f4a-56e4db451e02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3469f315b1146858349ee384d077f0e)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:34.276301 dv-cinder-854270-4-smb devstack@keystone.service[88338]: WARNING py.warnings [None req-d0a83734-af3b-4dcd-8f4a-56e4db451e02 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 22:45:34.276301 dv-cinder-854270-4-smb devstack@keystone.service[88338]: warnings.warn(msg) Aug 29 22:45:34.276301 dv-cinder-854270-4-smb devstack@keystone.service[88338]: Aug 29 22:45:34.276301 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a83734-af3b-4dcd-8f4a-56e4db451e02 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:34.372184 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bccbb42-bb21-4954-91bd-682f1c3dc9e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:34.377732 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bccbb42-bb21-4954-91bd-682f1c3dc9e0 service nova] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:34.423039 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-d0a83734-af3b-4dcd-8f4a-56e4db451e02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3469f315b1146858349ee384d077f0e', 'request_id': 'req-d0a83734-af3b-4dcd-8f4a-56e4db451e02'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:34.423541 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 841/1663] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:45:33 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:45:34.431349 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a2530-be5d-4ec2-ae5c-ae96c0c126f3 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:34.431684 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a2530-be5d-4ec2-ae5c-ae96c0c126f3 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:34.431975 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a2530-be5d-4ec2-ae5c-ae96c0c126f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:34.438928 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-d0a83734-af3b-4dcd-8f4a-56e4db451e02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3469f315b1146858349ee384d077f0e', 'request_id': 'req-d0a83734-af3b-4dcd-8f4a-56e4db451e02'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:34.455766 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-d0a83734-af3b-4dcd-8f4a-56e4db451e02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3469f315b1146858349ee384d077f0e', 'request_id': 'req-d0a83734-af3b-4dcd-8f4a-56e4db451e02'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:34.476392 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-d0a83734-af3b-4dcd-8f4a-56e4db451e02 admin admin] The token cache is being invalidate because project f3469f315b1146858349ee384d077f0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:45:34.476914 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-d0a83734-af3b-4dcd-8f4a-56e4db451e02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:34.478378 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-d0a83734-af3b-4dcd-8f4a-56e4db451e02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:34.481268 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 823/1664] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:45:33 2022] DELETE /identity/v3/projects/f3469f315b1146858349ee384d077f0e => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:45:34.482376 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a83734-af3b-4dcd-8f4a-56e4db451e02 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:34.485617 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-d0a83734-af3b-4dcd-8f4a-56e4db451e02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:34.489474 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-8a3a2530-be5d-4ec2-ae5c-ae96c0c126f3 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:34.490736 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-8a3a2530-be5d-4ec2-ae5c-ae96c0c126f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:34.613801 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 842/1665] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:45:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:45:34.614845 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a2530-be5d-4ec2-ae5c-ae96c0c126f3 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:34.625140 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-8a3a2530-be5d-4ec2-ae5c-ae96c0c126f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:34.646576 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a83734-af3b-4dcd-8f4a-56e4db451e02 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:34.653514 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a2530-be5d-4ec2-ae5c-ae96c0c126f3 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:34.661608 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5874f42-9d3b-4e6b-aa5b-4181c9865d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:34.663267 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44ff426-374a-4e97-b37c-04086472f9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:34.663572 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5874f42-9d3b-4e6b-aa5b-4181c9865d87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:34.663863 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5874f42-9d3b-4e6b-aa5b-4181c9865d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:34.664193 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5874f42-9d3b-4e6b-aa5b-4181c9865d87 admin admin] PATH_INFO: `/v3/users/fa4f79fb58c046a4b554adaebac5baf6` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:34.664549 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44ff426-374a-4e97-b37c-04086472f9ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:34.664980 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44ff426-374a-4e97-b37c-04086472f9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:34.665445 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5874f42-9d3b-4e6b-aa5b-4181c9865d87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa4f79fb58c046a4b554adaebac5baf6)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:34.665549 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44ff426-374a-4e97-b37c-04086472f9ce admin admin] PATH_INFO: `/v3/users/1202fb08db3647e880944b27a531a76e` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:34.667019 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44ff426-374a-4e97-b37c-04086472f9ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=1202fb08db3647e880944b27a531a76e)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:34.667931 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5874f42-9d3b-4e6b-aa5b-4181c9865d87 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:34.669250 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44ff426-374a-4e97-b37c-04086472f9ce admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:34.681546 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:34.767564 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:34.769400 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-f44ff426-374a-4e97-b37c-04086472f9ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1202fb08db3647e880944b27a531a76e'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:34.794479 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-f44ff426-374a-4e97-b37c-04086472f9ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1202fb08db3647e880944b27a531a76e'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:34.796806 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-f44ff426-374a-4e97-b37c-04086472f9ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1202fb08db3647e880944b27a531a76e'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:34.799525 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-e5874f42-9d3b-4e6b-aa5b-4181c9865d87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa4f79fb58c046a4b554adaebac5baf6'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:34.808475 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-e5874f42-9d3b-4e6b-aa5b-4181c9865d87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa4f79fb58c046a4b554adaebac5baf6'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:34.809770 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-e5874f42-9d3b-4e6b-aa5b-4181c9865d87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa4f79fb58c046a4b554adaebac5baf6'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:34.825411 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-e5874f42-9d3b-4e6b-aa5b-4181c9865d87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa4f79fb58c046a4b554adaebac5baf6'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:34.826575 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-e5874f42-9d3b-4e6b-aa5b-4181c9865d87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa4f79fb58c046a4b554adaebac5baf6'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:34.832257 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-f44ff426-374a-4e97-b37c-04086472f9ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1202fb08db3647e880944b27a531a76e'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:34.866010 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-f44ff426-374a-4e97-b37c-04086472f9ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1202fb08db3647e880944b27a531a76e'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:34.878602 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 824/1666] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:45:34 2022] DELETE /identity/v3/users/1202fb08db3647e880944b27a531a76e => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:45:34.879229 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44ff426-374a-4e97-b37c-04086472f9ce admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:34.887148 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-f44ff426-374a-4e97-b37c-04086472f9ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:34.899475 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 843/1667] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:45:34 2022] DELETE /identity/v3/users/fa4f79fb58c046a4b554adaebac5baf6 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:45:34.991198 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44ff426-374a-4e97-b37c-04086472f9ce admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:35.134657 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cef601-c33c-47e3-8b88-0a114a326315 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:35.135320 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cef601-c33c-47e3-8b88-0a114a326315 service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:35.135609 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cef601-c33c-47e3-8b88-0a114a326315 service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:35.135872 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cef601-c33c-47e3-8b88-0a114a326315 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:35.142379 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-88cef601-c33c-47e3-8b88-0a114a326315 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:35.329374 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cef601-c33c-47e3-8b88-0a114a326315 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:35.339449 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cef601-c33c-47e3-8b88-0a114a326315 service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:35.369262 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 825/1668] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:45:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:45:36.046810 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd79be77-e785-4727-b9e8-191ecbd6fda5 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:36.047778 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd79be77-e785-4727-b9e8-191ecbd6fda5 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:36.048110 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd79be77-e785-4727-b9e8-191ecbd6fda5 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:36.049862 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 844/1669] 10.222.0.47 () {54 vars in 912 bytes} [Mon Aug 29 22:45:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:45:36.074024 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc9955-8771-4343-afce-2d3e584943d8 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:36.074468 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc9955-8771-4343-afce-2d3e584943d8 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:36.074555 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc9955-8771-4343-afce-2d3e584943d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:36.156341 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-1ebc9955-8771-4343-afce-2d3e584943d8 None None] MFA Rules not processed for user `27abbf7b40e54fc091ebfe10aa6da90d`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:36.157726 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-1ebc9955-8771-4343-afce-2d3e584943d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:36.175067 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 826/1670] 10.222.0.47 () {58 vars in 1009 bytes} [Mon Aug 29 22:45:36 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:45:36.209285 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd79be77-e785-4727-b9e8-191ecbd6fda5 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:36.226871 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd79be77-e785-4727-b9e8-191ecbd6fda5 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:36.239290 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d881c233-96a0-4ac0-be81-c9aec4a2c355 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:36.240103 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881c233-96a0-4ac0-be81-c9aec4a2c355 service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:36.240504 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881c233-96a0-4ac0-be81-c9aec4a2c355 service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:36.240907 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881c233-96a0-4ac0-be81-c9aec4a2c355 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:36.257630 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d881c233-96a0-4ac0-be81-c9aec4a2c355 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:36.259240 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d881c233-96a0-4ac0-be81-c9aec4a2c355 service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:36.273891 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 845/1671] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:45:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:45:36.456538 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc9955-8771-4343-afce-2d3e584943d8 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:36.458868 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-1ebc9955-8771-4343-afce-2d3e584943d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:36.487961 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc9955-8771-4343-afce-2d3e584943d8 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:36.502047 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9829ab9-a8a9-48a5-8896-96e3257d102a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:36.502713 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9829ab9-a8a9-48a5-8896-96e3257d102a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:36.502993 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9829ab9-a8a9-48a5-8896-96e3257d102a admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:36.503268 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9829ab9-a8a9-48a5-8896-96e3257d102a admin admin] PATH_INFO: `/v3/projects/108019c33607456d9fbbf252e95e5c77` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:36.505209 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9829ab9-a8a9-48a5-8896-96e3257d102a admin admin] RBAC: Authorizing `identity:delete_project(project_id=108019c33607456d9fbbf252e95e5c77)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:36.507399 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9829ab9-a8a9-48a5-8896-96e3257d102a admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:36.518802 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:36.618088 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-b9829ab9-a8a9-48a5-8896-96e3257d102a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '108019c33607456d9fbbf252e95e5c77', 'request_id': 'req-b9829ab9-a8a9-48a5-8896-96e3257d102a'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:36.634410 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-b9829ab9-a8a9-48a5-8896-96e3257d102a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '108019c33607456d9fbbf252e95e5c77', 'request_id': 'req-b9829ab9-a8a9-48a5-8896-96e3257d102a'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:36.648058 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-b9829ab9-a8a9-48a5-8896-96e3257d102a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '108019c33607456d9fbbf252e95e5c77', 'request_id': 'req-b9829ab9-a8a9-48a5-8896-96e3257d102a'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:36.673705 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-b9829ab9-a8a9-48a5-8896-96e3257d102a admin admin] The token cache is being invalidate because project 108019c33607456d9fbbf252e95e5c77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:45:36.674061 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-b9829ab9-a8a9-48a5-8896-96e3257d102a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:36.684932 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d881c233-96a0-4ac0-be81-c9aec4a2c355 service neutron] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:36.687413 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-d881c233-96a0-4ac0-be81-c9aec4a2c355 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:36.690084 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-b9829ab9-a8a9-48a5-8896-96e3257d102a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:36.697460 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 827/1672] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:45:36 2022] DELETE /identity/v3/projects/108019c33607456d9fbbf252e95e5c77 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:45:36.698567 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ef544-f07c-4642-8154-b84ba88c2157 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:36.698848 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ef544-f07c-4642-8154-b84ba88c2157 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:36.699120 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ef544-f07c-4642-8154-b84ba88c2157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:36.718561 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d881c233-96a0-4ac0-be81-c9aec4a2c355 service neutron] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:36.765488 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-585ef544-f07c-4642-8154-b84ba88c2157 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:36.773532 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-585ef544-f07c-4642-8154-b84ba88c2157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:36.914485 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a97c6a-b594-422c-b8ce-7c427cdc4414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:36.916751 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a97c6a-b594-422c-b8ce-7c427cdc4414 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:36.917310 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a97c6a-b594-422c-b8ce-7c427cdc4414 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:36.917613 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a97c6a-b594-422c-b8ce-7c427cdc4414 admin admin] PATH_INFO: `/v3/projects/e0ef6814c4264a3ab8992d05e82aca1a` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:36.921233 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a97c6a-b594-422c-b8ce-7c427cdc4414 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0ef6814c4264a3ab8992d05e82aca1a)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:36.924468 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a97c6a-b594-422c-b8ce-7c427cdc4414 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:36.925601 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 828/1673] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:45:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:45:36.935798 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901fc5b-94a1-476b-a413-97c912a6f1b0 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:36.935901 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901fc5b-94a1-476b-a413-97c912a6f1b0 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:36.936457 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901fc5b-94a1-476b-a413-97c912a6f1b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:36.990490 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-7901fc5b-94a1-476b-a413-97c912a6f1b0 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:36.995675 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-7901fc5b-94a1-476b-a413-97c912a6f1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:37.016929 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 829/1674] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:45:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:45:37.021043 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7901fc5b-94a1-476b-a413-97c912a6f1b0 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:37.047794 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7901fc5b-94a1-476b-a413-97c912a6f1b0 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:37.064459 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b1ac5c-b9c9-4304-94b7-f2e01415a795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:37.065098 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b1ac5c-b9c9-4304-94b7-f2e01415a795 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:37.065443 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b1ac5c-b9c9-4304-94b7-f2e01415a795 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:37.065726 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b1ac5c-b9c9-4304-94b7-f2e01415a795 admin admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:37.066394 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b1ac5c-b9c9-4304-94b7-f2e01415a795 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:45:37.067238 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b1ac5c-b9c9-4304-94b7-f2e01415a795 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:37.069091 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b1ac5c-b9c9-4304-94b7-f2e01415a795 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:37.091287 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-10a97c6a-b594-422c-b8ce-7c427cdc4414 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0ef6814c4264a3ab8992d05e82aca1a', 'request_id': 'req-10a97c6a-b594-422c-b8ce-7c427cdc4414'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:37.095142 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 830/1675] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Aug 29 22:45:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:45:37.100434 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b1ac5c-b9c9-4304-94b7-f2e01415a795 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:37.115289 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b1ac5c-b9c9-4304-94b7-f2e01415a795 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:37.131318 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-10a97c6a-b594-422c-b8ce-7c427cdc4414 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0ef6814c4264a3ab8992d05e82aca1a', 'request_id': 'req-10a97c6a-b594-422c-b8ce-7c427cdc4414'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:37.154479 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-10a97c6a-b594-422c-b8ce-7c427cdc4414 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0ef6814c4264a3ab8992d05e82aca1a', 'request_id': 'req-10a97c6a-b594-422c-b8ce-7c427cdc4414'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:37.188906 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-10a97c6a-b594-422c-b8ce-7c427cdc4414 admin admin] The token cache is being invalidate because project e0ef6814c4264a3ab8992d05e82aca1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:45:37.190857 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-10a97c6a-b594-422c-b8ce-7c427cdc4414 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:37.192718 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-10a97c6a-b594-422c-b8ce-7c427cdc4414 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:37.201075 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 846/1676] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:45:36 2022] DELETE /identity/v3/projects/e0ef6814c4264a3ab8992d05e82aca1a => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:45:37.204386 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6eded-773b-41cf-b160-1cf4dbd6b0e0 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:37.204742 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6eded-773b-41cf-b160-1cf4dbd6b0e0 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:37.205081 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6eded-773b-41cf-b160-1cf4dbd6b0e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:37.212192 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd603c5-80c8-4d00-a839-770810d8b795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:37.213285 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd603c5-80c8-4d00-a839-770810d8b795 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:37.213755 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd603c5-80c8-4d00-a839-770810d8b795 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:37.214341 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd603c5-80c8-4d00-a839-770810d8b795 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:37.215015 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd603c5-80c8-4d00-a839-770810d8b795 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:37.218438 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd603c5-80c8-4d00-a839-770810d8b795 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:37.242013 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:37.265594 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:37.272015 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-48b6eded-773b-41cf-b160-1cf4dbd6b0e0 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:37.282632 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-48b6eded-773b-41cf-b160-1cf4dbd6b0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:37.283460 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 831/1677] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:45:37 2022] POST /identity/v3/projects => generated 379 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:45:37.284530 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd603c5-80c8-4d00-a839-770810d8b795 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:37.288462 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-7dd603c5-80c8-4d00-a839-770810d8b795 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:37.501601 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd603c5-80c8-4d00-a839-770810d8b795 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:37.516710 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9236d7e-4105-4218-b888-4ef0fd6e911c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:37.517454 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9236d7e-4105-4218-b888-4ef0fd6e911c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:37.517737 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9236d7e-4105-4218-b888-4ef0fd6e911c admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:37.518109 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9236d7e-4105-4218-b888-4ef0fd6e911c admin admin] PATH_INFO: `/v3/projects/65c39abe811441eb93d54c90ca939aa6` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:37.521764 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9236d7e-4105-4218-b888-4ef0fd6e911c admin admin] RBAC: Authorizing `identity:delete_project(project_id=65c39abe811441eb93d54c90ca939aa6)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:37.526879 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9236d7e-4105-4218-b888-4ef0fd6e911c admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:37.547030 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 847/1678] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:45:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:45:37.548280 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b6eded-773b-41cf-b160-1cf4dbd6b0e0 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:37.554491 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-48b6eded-773b-41cf-b160-1cf4dbd6b0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:37.574437 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b6eded-773b-41cf-b160-1cf4dbd6b0e0 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:37.600442 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e79970-c1b6-400f-8f92-4dd7ae93d207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:37.600995 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e79970-c1b6-400f-8f92-4dd7ae93d207 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:37.601309 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e79970-c1b6-400f-8f92-4dd7ae93d207 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:37.601593 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e79970-c1b6-400f-8f92-4dd7ae93d207 admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:37.602763 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e79970-c1b6-400f-8f92-4dd7ae93d207 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:37.605265 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e79970-c1b6-400f-8f92-4dd7ae93d207 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:37.679879 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 848/1679] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:45:37 2022] POST /identity/v3/users => generated 290 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:45:37.682543 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e79970-c1b6-400f-8f92-4dd7ae93d207 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:37.687524 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-68e79970-c1b6-400f-8f92-4dd7ae93d207 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:37.736324 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-b9236d7e-4105-4218-b888-4ef0fd6e911c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65c39abe811441eb93d54c90ca939aa6', 'request_id': 'req-b9236d7e-4105-4218-b888-4ef0fd6e911c'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:37.757725 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-b9236d7e-4105-4218-b888-4ef0fd6e911c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65c39abe811441eb93d54c90ca939aa6', 'request_id': 'req-b9236d7e-4105-4218-b888-4ef0fd6e911c'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:37.776995 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-b9236d7e-4105-4218-b888-4ef0fd6e911c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65c39abe811441eb93d54c90ca939aa6', 'request_id': 'req-b9236d7e-4105-4218-b888-4ef0fd6e911c'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:37.826663 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-b9236d7e-4105-4218-b888-4ef0fd6e911c admin admin] The token cache is being invalidate because project 65c39abe811441eb93d54c90ca939aa6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:45:37.829617 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-b9236d7e-4105-4218-b888-4ef0fd6e911c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:37.831913 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-b9236d7e-4105-4218-b888-4ef0fd6e911c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:37.840367 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 832/1680] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:45:37 2022] DELETE /identity/v3/projects/65c39abe811441eb93d54c90ca939aa6 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:45:37.845384 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589ca47-3a6f-4989-8a59-908fc2b62b87 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:37.845558 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589ca47-3a6f-4989-8a59-908fc2b62b87 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:37.846699 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589ca47-3a6f-4989-8a59-908fc2b62b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:37.933035 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-7589ca47-3a6f-4989-8a59-908fc2b62b87 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:37.934523 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-7589ca47-3a6f-4989-8a59-908fc2b62b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:37.971076 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e79970-c1b6-400f-8f92-4dd7ae93d207 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:38.068358 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 833/1681] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:45:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:45:38.074992 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28545a-7edf-432c-9ad3-921118df1eb1 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:38.075794 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28545a-7edf-432c-9ad3-921118df1eb1 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:38.076928 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28545a-7edf-432c-9ad3-921118df1eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:38.087764 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b76ae7c-e5ad-4e33-960b-930beb1d227a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296cbef772104e078971ba93aa2e022c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:38.088503 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b76ae7c-e5ad-4e33-960b-930beb1d227a service placement] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:38.089570 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b76ae7c-e5ad-4e33-960b-930beb1d227a service placement] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:38.091216 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b76ae7c-e5ad-4e33-960b-930beb1d227a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:38.096054 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-4b76ae7c-e5ad-4e33-960b-930beb1d227a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:38.122072 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b76ae7c-e5ad-4e33-960b-930beb1d227a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:38.128538 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-0b28545a-7edf-432c-9ad3-921118df1eb1 None None] MFA Rules not processed for user `c9d2b7dc4c6f4061a2606e514d2a4c88`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:38.129730 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b76ae7c-e5ad-4e33-960b-930beb1d227a service placement] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:38.130046 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-0b28545a-7edf-432c-9ad3-921118df1eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:38.149387 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 849/1682] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:45:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:45:38.154667 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b76ae7c-e5ad-4e33-960b-930beb1d227a service placement] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:38.163012 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-4b76ae7c-e5ad-4e33-960b-930beb1d227a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:38.187730 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:38.192852 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b76ae7c-e5ad-4e33-960b-930beb1d227a service placement] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:38.214794 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0317658f-acd1-46fc-8dd4-0cf195d1f35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:38.215893 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0317658f-acd1-46fc-8dd4-0cf195d1f35e admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:38.216344 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0317658f-acd1-46fc-8dd4-0cf195d1f35e admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:38.216763 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0317658f-acd1-46fc-8dd4-0cf195d1f35e admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:38.219175 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0317658f-acd1-46fc-8dd4-0cf195d1f35e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:38.224898 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0317658f-acd1-46fc-8dd4-0cf195d1f35e admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:38.256612 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 850/1683] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:45:38 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:45:38.259541 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df119856-7713-4f2a-be7c-cf0bcd4ec925 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:38.259843 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df119856-7713-4f2a-be7c-cf0bcd4ec925 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:38.260129 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df119856-7713-4f2a-be7c-cf0bcd4ec925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:38.270671 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 834/1684] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:45:38 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:45:38.272171 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b28545a-7edf-432c-9ad3-921118df1eb1 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:38.302861 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b28545a-7edf-432c-9ad3-921118df1eb1 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:38.317929 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e054004b-763e-412e-b176-bd4b44bd8a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:38.319962 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e054004b-763e-412e-b176-bd4b44bd8a74 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:38.323549 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e054004b-763e-412e-b176-bd4b44bd8a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:38.323549 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e054004b-763e-412e-b176-bd4b44bd8a74 admin admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:38.325606 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e054004b-763e-412e-b176-bd4b44bd8a74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:45:38.326039 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e054004b-763e-412e-b176-bd4b44bd8a74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:38.335245 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e054004b-763e-412e-b176-bd4b44bd8a74 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:38.344087 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:38.358752 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-df119856-7713-4f2a-be7c-cf0bcd4ec925 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:38.361997 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-df119856-7713-4f2a-be7c-cf0bcd4ec925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:38.376941 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 835/1685] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Aug 29 22:45:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:45:38.378037 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e054004b-763e-412e-b176-bd4b44bd8a74 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:38.400514 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 851/1686] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:45:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:45:38.402881 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df119856-7713-4f2a-be7c-cf0bcd4ec925 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:38.408983 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e054004b-763e-412e-b176-bd4b44bd8a74 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:38.443546 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da535631-9602-447c-9380-f61b02081f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:38.443546 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da535631-9602-447c-9380-f61b02081f0f admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:38.443961 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df119856-7713-4f2a-be7c-cf0bcd4ec925 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:38.444053 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da535631-9602-447c-9380-f61b02081f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:38.444053 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da535631-9602-447c-9380-f61b02081f0f admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:38.444053 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da535631-9602-447c-9380-f61b02081f0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:38.445074 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da535631-9602-447c-9380-f61b02081f0f admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:38.465025 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c225efde-07f6-4e17-9646-75888c8a2a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:38.465694 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c225efde-07f6-4e17-9646-75888c8a2a91 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:38.466040 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c225efde-07f6-4e17-9646-75888c8a2a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:38.468613 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c225efde-07f6-4e17-9646-75888c8a2a91 admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:38.469287 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c225efde-07f6-4e17-9646-75888c8a2a91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:38.476677 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c225efde-07f6-4e17-9646-75888c8a2a91 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:38.480591 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 836/1687] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:45:38 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:45:38.483788 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a831e-b9c1-4900-9ab0-384af43d79bb None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:38.484412 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a831e-b9c1-4900-9ab0-384af43d79bb None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:38.484653 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a831e-b9c1-4900-9ab0-384af43d79bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:38.545426 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 852/1688] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:45:38 2022] POST /identity/v3/projects => generated 369 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:45:38.546365 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c225efde-07f6-4e17-9646-75888c8a2a91 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:38.550023 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-603a831e-b9c1-4900-9ab0-384af43d79bb None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:38.560376 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-603a831e-b9c1-4900-9ab0-384af43d79bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:38.742710 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c225efde-07f6-4e17-9646-75888c8a2a91 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:38.764387 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc4eb93-bedb-46db-919d-46e1f342d1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:38.765075 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc4eb93-bedb-46db-919d-46e1f342d1aa admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:38.765376 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc4eb93-bedb-46db-919d-46e1f342d1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:38.765644 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc4eb93-bedb-46db-919d-46e1f342d1aa admin admin] PATH_INFO: `/v3/projects/efe842bc43164957826da6493b10caba/users/15eef49c3021421f8e40ff94bc5fdd35/roles/0c67797d444d4c929b2ccab47c468848` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:38.772400 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 837/1689] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:45:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:45:38.785996 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a831e-b9c1-4900-9ab0-384af43d79bb None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:38.807638 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a831e-b9c1-4900-9ab0-384af43d79bb None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:38.823132 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bb0a3a-9725-4bc5-af28-d6796fe14204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:38.823768 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb0a3a-9725-4bc5-af28-d6796fe14204 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:38.824048 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb0a3a-9725-4bc5-af28-d6796fe14204 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:38.824323 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb0a3a-9725-4bc5-af28-d6796fe14204 admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:38.824481 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc4eb93-bedb-46db-919d-46e1f342d1aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=efe842bc43164957826da6493b10caba, user_id=15eef49c3021421f8e40ff94bc5fdd35, role_id=0c67797d444d4c929b2ccab47c468848)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:38.824973 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bb0a3a-9725-4bc5-af28-d6796fe14204 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:38.827325 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc4eb93-bedb-46db-919d-46e1f342d1aa admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:38.827470 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bb0a3a-9725-4bc5-af28-d6796fe14204 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:38.875895 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 838/1691] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:45:38 2022] POST /identity/v3/users => generated 285 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:45:38.880888 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bb0a3a-9725-4bc5-af28-d6796fe14204 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:38.884207 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 853/1691] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:45:38 2022] PUT /identity/v3/projects/efe842bc43164957826da6493b10caba/users/15eef49c3021421f8e40ff94bc5fdd35/roles/0c67797d444d4c929b2ccab47c468848 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:45:38.885228 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc4eb93-bedb-46db-919d-46e1f342d1aa admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:38.915735 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bb0a3a-9725-4bc5-af28-d6796fe14204 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:39.078402 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc4eb93-bedb-46db-919d-46e1f342d1aa admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:39.090707 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcc53be-b201-4791-a684-42bf9f86e9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:39.090974 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc53be-b201-4791-a684-42bf9f86e9bb admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:39.091261 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc53be-b201-4791-a684-42bf9f86e9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:39.091531 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc53be-b201-4791-a684-42bf9f86e9bb admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:39.092185 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcc53be-b201-4791-a684-42bf9f86e9bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:39.093961 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcc53be-b201-4791-a684-42bf9f86e9bb admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:39.110425 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 854/1692] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:45:38 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:45:39.112235 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af5407-f0d2-49db-a400-b01b62a5f17c None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:39.112448 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af5407-f0d2-49db-a400-b01b62a5f17c None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:39.112758 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af5407-f0d2-49db-a400-b01b62a5f17c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:39.128360 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae14694-76c5-4eb4-8e7f-bb34846713c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:39.133009 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae14694-76c5-4eb4-8e7f-bb34846713c3 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:39.133685 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae14694-76c5-4eb4-8e7f-bb34846713c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:39.135276 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae14694-76c5-4eb4-8e7f-bb34846713c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:39.139412 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae14694-76c5-4eb4-8e7f-bb34846713c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:45:39.141490 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae14694-76c5-4eb4-8e7f-bb34846713c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:39.143043 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae14694-76c5-4eb4-8e7f-bb34846713c3 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:39.188663 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-80af5407-f0d2-49db-a400-b01b62a5f17c None None] MFA Rules not processed for user `15eef49c3021421f8e40ff94bc5fdd35`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:39.194708 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-80af5407-f0d2-49db-a400-b01b62a5f17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:39.200883 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 839/1693] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Aug 29 22:45:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:45:39.201156 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae14694-76c5-4eb4-8e7f-bb34846713c3 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:39.241397 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae14694-76c5-4eb4-8e7f-bb34846713c3 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:39.265267 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713702bd-fd06-44eb-8c7a-509acc4b177d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:39.265926 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713702bd-fd06-44eb-8c7a-509acc4b177d admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:39.266210 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713702bd-fd06-44eb-8c7a-509acc4b177d admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:39.266486 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713702bd-fd06-44eb-8c7a-509acc4b177d admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:39.267145 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713702bd-fd06-44eb-8c7a-509acc4b177d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:39.271303 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713702bd-fd06-44eb-8c7a-509acc4b177d admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:39.311707 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 840/1694] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:45:39 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:45:39.312691 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713702bd-fd06-44eb-8c7a-509acc4b177d admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:39.332796 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:39.340324 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713702bd-fd06-44eb-8c7a-509acc4b177d admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:39.357252 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d1cc3e-3e71-466d-8268-a20982bddfe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:39.357977 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1cc3e-3e71-466d-8268-a20982bddfe4 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:39.358259 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1cc3e-3e71-466d-8268-a20982bddfe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:39.358534 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1cc3e-3e71-466d-8268-a20982bddfe4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:39.359404 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d1cc3e-3e71-466d-8268-a20982bddfe4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:39.361305 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d1cc3e-3e71-466d-8268-a20982bddfe4 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:39.393213 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 855/1695] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:45:39 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:45:39.394337 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af5407-f0d2-49db-a400-b01b62a5f17c None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:39.418889 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af5407-f0d2-49db-a400-b01b62a5f17c None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:39.419094 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:39.424166 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d920ec-6617-486c-bcdf-756a2fec0b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:39.424864 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d920ec-6617-486c-bcdf-756a2fec0b7a admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:39.425150 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d920ec-6617-486c-bcdf-756a2fec0b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:39.425544 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d920ec-6617-486c-bcdf-756a2fec0b7a admin admin] PATH_INFO: `/v3/projects/9f6a492ce4194dcdaa9636671278c24b/users/084bf355436944b9be6115ef64f34503/roles/0c67797d444d4c929b2ccab47c468848` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:39.456076 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d920ec-6617-486c-bcdf-756a2fec0b7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f6a492ce4194dcdaa9636671278c24b, user_id=084bf355436944b9be6115ef64f34503, role_id=0c67797d444d4c929b2ccab47c468848)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:39.461428 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d920ec-6617-486c-bcdf-756a2fec0b7a admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:39.461608 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 841/1696] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:45:39 2022] POST /identity/v3/projects => generated 365 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:45:39.462457 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d1cc3e-3e71-466d-8268-a20982bddfe4 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:39.496662 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 856/1697] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:45:39 2022] PUT /identity/v3/projects/9f6a492ce4194dcdaa9636671278c24b/users/084bf355436944b9be6115ef64f34503/roles/0c67797d444d4c929b2ccab47c468848 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:45:39.497710 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d920ec-6617-486c-bcdf-756a2fec0b7a admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:39.622438 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d920ec-6617-486c-bcdf-756a2fec0b7a admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:39.631276 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05545331-9d38-4b36-865f-b55f92b0a962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:39.631920 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05545331-9d38-4b36-865f-b55f92b0a962 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:39.632212 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05545331-9d38-4b36-865f-b55f92b0a962 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:39.632660 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05545331-9d38-4b36-865f-b55f92b0a962 admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:39.633720 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05545331-9d38-4b36-865f-b55f92b0a962 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:39.637161 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05545331-9d38-4b36-865f-b55f92b0a962 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:39.667157 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d1cc3e-3e71-466d-8268-a20982bddfe4 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:39.681027 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c71840-eee4-49c9-bc7b-72ac94bce549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:39.681253 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 857/1698] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:45:39 2022] POST /identity/v3/users => generated 283 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:45:39.681376 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c71840-eee4-49c9-bc7b-72ac94bce549 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:39.681376 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c71840-eee4-49c9-bc7b-72ac94bce549 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:39.681376 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c71840-eee4-49c9-bc7b-72ac94bce549 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:39.681376 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c71840-eee4-49c9-bc7b-72ac94bce549 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:39.681780 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e1e24f-ea4d-42d8-9d9b-53fd1f3e86f7 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:39.683205 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e1e24f-ea4d-42d8-9d9b-53fd1f3e86f7 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:39.683778 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e1e24f-ea4d-42d8-9d9b-53fd1f3e86f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:39.686710 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c71840-eee4-49c9-bc7b-72ac94bce549 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:39.746083 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-83e1e24f-ea4d-42d8-9d9b-53fd1f3e86f7 None None] MFA Rules not processed for user `084bf355436944b9be6115ef64f34503`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:39.747591 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-83e1e24f-ea4d-42d8-9d9b-53fd1f3e86f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:39.764925 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 842/1699] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:45:39 2022] POST /identity/v3/projects => generated 381 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:45:39.766164 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c71840-eee4-49c9-bc7b-72ac94bce549 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:39.768179 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-d0c71840-eee4-49c9-bc7b-72ac94bce549 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:39.926953 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c71840-eee4-49c9-bc7b-72ac94bce549 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:39.939766 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 858/1700] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:45:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:45:39.945949 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e1e24f-ea4d-42d8-9d9b-53fd1f3e86f7 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:39.946157 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6875f3df-6442-48fe-9e93-343896b27528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:39.948158 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875f3df-6442-48fe-9e93-343896b27528 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:39.949451 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875f3df-6442-48fe-9e93-343896b27528 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:39.951177 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875f3df-6442-48fe-9e93-343896b27528 admin admin] PATH_INFO: `/v3/users/bc082b6b20ee434895592442eb9d1c00` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:39.954192 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6875f3df-6442-48fe-9e93-343896b27528 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc082b6b20ee434895592442eb9d1c00)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:39.962444 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6875f3df-6442-48fe-9e93-343896b27528 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:39.981255 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e1e24f-ea4d-42d8-9d9b-53fd1f3e86f7 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:39.995895 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad887307-af8e-46df-a2d6-0399bfd43677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:39.996526 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad887307-af8e-46df-a2d6-0399bfd43677 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:39.996808 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad887307-af8e-46df-a2d6-0399bfd43677 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:39.997081 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad887307-af8e-46df-a2d6-0399bfd43677 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:39.997772 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad887307-af8e-46df-a2d6-0399bfd43677 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:39.999404 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad887307-af8e-46df-a2d6-0399bfd43677 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:40.023915 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 859/1701] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:45:39 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:45:40.024826 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad887307-af8e-46df-a2d6-0399bfd43677 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:40.075710 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad887307-af8e-46df-a2d6-0399bfd43677 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:40.082160 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc2f35e-2fc4-4b82-9332-4d0d352e3054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:40.083246 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2f35e-2fc4-4b82-9332-4d0d352e3054 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:40.084108 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2f35e-2fc4-4b82-9332-4d0d352e3054 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:40.084539 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2f35e-2fc4-4b82-9332-4d0d352e3054 admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:40.087271 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc2f35e-2fc4-4b82-9332-4d0d352e3054 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:40.089901 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc2f35e-2fc4-4b82-9332-4d0d352e3054 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:40.125712 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 860/1702] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:45:40 2022] POST /identity/v3/users => generated 297 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:45:40.127494 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc2f35e-2fc4-4b82-9332-4d0d352e3054 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:40.143359 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-6875f3df-6442-48fe-9e93-343896b27528 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc082b6b20ee434895592442eb9d1c00'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:40.150441 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc2f35e-2fc4-4b82-9332-4d0d352e3054 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:40.162805 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8240d3ca-c71c-48fa-af59-2661e0c3786f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:40.163490 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240d3ca-c71c-48fa-af59-2661e0c3786f admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:40.163742 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240d3ca-c71c-48fa-af59-2661e0c3786f admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:40.164018 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240d3ca-c71c-48fa-af59-2661e0c3786f admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:40.164673 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8240d3ca-c71c-48fa-af59-2661e0c3786f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:40.170535 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8240d3ca-c71c-48fa-af59-2661e0c3786f admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:40.171423 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-6875f3df-6442-48fe-9e93-343896b27528 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc082b6b20ee434895592442eb9d1c00'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:40.172776 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-6875f3df-6442-48fe-9e93-343896b27528 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc082b6b20ee434895592442eb9d1c00'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:40.213775 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:40.219035 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-6875f3df-6442-48fe-9e93-343896b27528 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc082b6b20ee434895592442eb9d1c00'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:40.237838 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-6875f3df-6442-48fe-9e93-343896b27528 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc082b6b20ee434895592442eb9d1c00'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:40.240147 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:40.253089 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 861/1703] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:45:40 2022] POST /identity/v3/projects => generated 369 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:45:40.255497 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 843/1704] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:45:39 2022] DELETE /identity/v3/users/bc082b6b20ee434895592442eb9d1c00 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:45:40.256644 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6875f3df-6442-48fe-9e93-343896b27528 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:40.256966 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8240d3ca-c71c-48fa-af59-2661e0c3786f admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:40.259518 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-6875f3df-6442-48fe-9e93-343896b27528 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:40.265929 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-8240d3ca-c71c-48fa-af59-2661e0c3786f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:40.431932 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6875f3df-6442-48fe-9e93-343896b27528 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:40.461088 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8240d3ca-c71c-48fa-af59-2661e0c3786f admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:40.471070 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ce6b7-3875-4651-9d4c-9ef95fd3c27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:40.471741 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ce6b7-3875-4651-9d4c-9ef95fd3c27a admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:40.472010 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ce6b7-3875-4651-9d4c-9ef95fd3c27a admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:40.472289 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ce6b7-3875-4651-9d4c-9ef95fd3c27a admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:40.472951 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696ce6b7-3875-4651-9d4c-9ef95fd3c27a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:40.475307 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696ce6b7-3875-4651-9d4c-9ef95fd3c27a admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:40.522730 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 862/1705] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:45:40 2022] GET /identity/v3/roles => generated 1420 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:45:40.529282 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ce6b7-3875-4651-9d4c-9ef95fd3c27a admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:40.534785 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-696ce6b7-3875-4651-9d4c-9ef95fd3c27a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:40.573424 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ce6b7-3875-4651-9d4c-9ef95fd3c27a admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:40.575624 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dcabe9-4ee2-4a12-bac6-4b1fcc9091d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:40.576174 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dcabe9-4ee2-4a12-bac6-4b1fcc9091d4 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:40.576461 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dcabe9-4ee2-4a12-bac6-4b1fcc9091d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:40.576738 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dcabe9-4ee2-4a12-bac6-4b1fcc9091d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:40.577421 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dcabe9-4ee2-4a12-bac6-4b1fcc9091d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:40.583930 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dcabe9-4ee2-4a12-bac6-4b1fcc9091d4 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:40.588420 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad69e057-d911-4181-a3c1-f4a7193de0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:40.589055 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69e057-d911-4181-a3c1-f4a7193de0e0 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:40.589361 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69e057-d911-4181-a3c1-f4a7193de0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:40.589628 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69e057-d911-4181-a3c1-f4a7193de0e0 admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:40.590279 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad69e057-d911-4181-a3c1-f4a7193de0e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:40.592244 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad69e057-d911-4181-a3c1-f4a7193de0e0 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:40.612130 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 844/1706] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:45:40 2022] GET /identity/v3/roles => generated 1420 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:45:40.613537 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa05539-28e5-4c83-baac-fb60f7e640cd None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:40.614586 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa05539-28e5-4c83-baac-fb60f7e640cd None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:40.614888 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa05539-28e5-4c83-baac-fb60f7e640cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:40.642099 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 863/1707] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:45:40 2022] POST /identity/v3/users => generated 291 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:45:40.643496 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad69e057-d911-4181-a3c1-f4a7193de0e0 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:40.663713 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad69e057-d911-4181-a3c1-f4a7193de0e0 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:40.666753 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-ffa05539-28e5-4c83-baac-fb60f7e640cd None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:40.668019 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-ffa05539-28e5-4c83-baac-fb60f7e640cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:40.676028 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13605382-018a-40dd-82ef-4682bb6172ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:40.676873 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13605382-018a-40dd-82ef-4682bb6172ca admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:40.677204 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13605382-018a-40dd-82ef-4682bb6172ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:40.677541 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13605382-018a-40dd-82ef-4682bb6172ca admin admin] PATH_INFO: `/v3/projects/07044114ec83471e9edd43b7f3206789/users/a95d57259f094b6ab3b7af97f099a0db/roles/0c67797d444d4c929b2ccab47c468848` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:40.693885 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 845/1708] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:45:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:45:40.694817 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa05539-28e5-4c83-baac-fb60f7e640cd None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:40.734261 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa05539-28e5-4c83-baac-fb60f7e640cd None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:40.742971 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13605382-018a-40dd-82ef-4682bb6172ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=07044114ec83471e9edd43b7f3206789, user_id=a95d57259f094b6ab3b7af97f099a0db, role_id=0c67797d444d4c929b2ccab47c468848)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:40.753302 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13605382-018a-40dd-82ef-4682bb6172ca admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:40.759184 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc05798-d208-45e2-9fde-070180aba5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:40.759931 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc05798-d208-45e2-9fde-070180aba5b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:40.762486 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc05798-d208-45e2-9fde-070180aba5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:40.762809 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc05798-d208-45e2-9fde-070180aba5b3 admin admin] PATH_INFO: `/v3/projects/01fe88e0bd634886a1fb49f914cd80a2/users/3bf914e92b594610bf8bd9089bfe1e95/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:40.796847 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 864/1709] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:45:40 2022] PUT /identity/v3/projects/07044114ec83471e9edd43b7f3206789/users/a95d57259f094b6ab3b7af97f099a0db/roles/0c67797d444d4c929b2ccab47c468848 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:45:40.811296 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13605382-018a-40dd-82ef-4682bb6172ca admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:40.830153 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc05798-d208-45e2-9fde-070180aba5b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01fe88e0bd634886a1fb49f914cd80a2, user_id=3bf914e92b594610bf8bd9089bfe1e95, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:40.839002 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc05798-d208-45e2-9fde-070180aba5b3 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:40.901010 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 846/1710] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:45:40 2022] PUT /identity/v3/projects/01fe88e0bd634886a1fb49f914cd80a2/users/3bf914e92b594610bf8bd9089bfe1e95/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:45:40.901010 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc05798-d208-45e2-9fde-070180aba5b3 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:40.907598 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-1bc05798-d208-45e2-9fde-070180aba5b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:41.107646 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13605382-018a-40dd-82ef-4682bb6172ca admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:41.164966 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc05798-d208-45e2-9fde-070180aba5b3 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:41.185694 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c3719-04b5-4c1d-b135-01f832090c09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:41.186851 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c3719-04b5-4c1d-b135-01f832090c09 service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:41.187143 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c3719-04b5-4c1d-b135-01f832090c09 service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:41.187422 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c3719-04b5-4c1d-b135-01f832090c09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:41.280547 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:41.337396 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:41.368910 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6c3719-04b5-4c1d-b135-01f832090c09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:41.370873 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6c3719-04b5-4c1d-b135-01f832090c09 service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:41.374404 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da9bae3-8b43-463d-896e-28d8eb9cc1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:41.375854 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9bae3-8b43-463d-896e-28d8eb9cc1e1 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:41.375854 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9bae3-8b43-463d-896e-28d8eb9cc1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:41.375854 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9bae3-8b43-463d-896e-28d8eb9cc1e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:41.376670 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da9bae3-8b43-463d-896e-28d8eb9cc1e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:41.380279 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da9bae3-8b43-463d-896e-28d8eb9cc1e1 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:41.386722 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 847/1711] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:45:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:45:41.389212 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a187c-9e50-4587-837f-203470b396e6 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:41.391876 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a187c-9e50-4587-837f-203470b396e6 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:41.392332 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a187c-9e50-4587-837f-203470b396e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:41.442400 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 865/1712] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:45:40 2022] GET /identity/v3/roles => generated 1420 bytes in 644 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:45:41.456128 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da9bae3-8b43-463d-896e-28d8eb9cc1e1 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:41.475337 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-466a187c-9e50-4587-837f-203470b396e6 None None] MFA Rules not processed for user `a95d57259f094b6ab3b7af97f099a0db`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:41.478022 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-466a187c-9e50-4587-837f-203470b396e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:41.485289 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da9bae3-8b43-463d-896e-28d8eb9cc1e1 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:41.526928 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06fdfa2-1195-4904-92d0-dd436e63f98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:41.527079 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06fdfa2-1195-4904-92d0-dd436e63f98c admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:41.527447 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06fdfa2-1195-4904-92d0-dd436e63f98c admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:41.529885 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06fdfa2-1195-4904-92d0-dd436e63f98c admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:41.529885 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06fdfa2-1195-4904-92d0-dd436e63f98c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:41.533345 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06fdfa2-1195-4904-92d0-dd436e63f98c admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:41.559563 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 866/1713] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:45:41 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:45:41.561283 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06fdfa2-1195-4904-92d0-dd436e63f98c admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:41.607445 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06fdfa2-1195-4904-92d0-dd436e63f98c admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:41.623538 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c138e3-9db1-4553-b355-91220477c41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:41.625403 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c138e3-9db1-4553-b355-91220477c41c admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:41.625707 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c138e3-9db1-4553-b355-91220477c41c admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:41.625987 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c138e3-9db1-4553-b355-91220477c41c admin admin] PATH_INFO: `/v3/projects/5cc22c6bb1a8437b853426f643e8f71a/users/750afd26534c4e639a750db03474e58b/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:41.667249 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c138e3-9db1-4553-b355-91220477c41c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cc22c6bb1a8437b853426f643e8f71a, user_id=750afd26534c4e639a750db03474e58b, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:41.674575 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c138e3-9db1-4553-b355-91220477c41c admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:41.707006 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 848/1714] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:45:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:45:41.707213 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 867/1715] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:45:41 2022] PUT /identity/v3/projects/5cc22c6bb1a8437b853426f643e8f71a/users/750afd26534c4e639a750db03474e58b/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:45:41.707297 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d0f80-93cb-4935-a870-eaaabd1ebed7 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:41.707297 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d0f80-93cb-4935-a870-eaaabd1ebed7 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:41.707297 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d0f80-93cb-4935-a870-eaaabd1ebed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:41.711662 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c138e3-9db1-4553-b355-91220477c41c admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:41.763131 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-974d0f80-93cb-4935-a870-eaaabd1ebed7 None None] MFA Rules not processed for user `e2710a23114c4962a06886572be82b12`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:41.766023 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-974d0f80-93cb-4935-a870-eaaabd1ebed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:41.854543 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c138e3-9db1-4553-b355-91220477c41c admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:41.876253 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5472d63-988f-4ac6-9f8e-82ede0c424c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:41.876943 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5472d63-988f-4ac6-9f8e-82ede0c424c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:41.878052 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5472d63-988f-4ac6-9f8e-82ede0c424c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:41.878343 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5472d63-988f-4ac6-9f8e-82ede0c424c3 admin admin] PATH_INFO: `/v3/projects/01fe88e0bd634886a1fb49f914cd80a2/users/3bf914e92b594610bf8bd9089bfe1e95/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:41.886160 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5472d63-988f-4ac6-9f8e-82ede0c424c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01fe88e0bd634886a1fb49f914cd80a2, user_id=3bf914e92b594610bf8bd9089bfe1e95, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:41.889207 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5472d63-988f-4ac6-9f8e-82ede0c424c3 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:41.905148 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 849/1716] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:45:41 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:45:41.907986 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d0f80-93cb-4935-a870-eaaabd1ebed7 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:41.924589 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d0f80-93cb-4935-a870-eaaabd1ebed7 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:41.926874 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 868/1717] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:45:41 2022] PUT /identity/v3/projects/01fe88e0bd634886a1fb49f914cd80a2/users/3bf914e92b594610bf8bd9089bfe1e95/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:45:41.927788 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5472d63-988f-4ac6-9f8e-82ede0c424c3 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:42.022258 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:42.071903 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5472d63-988f-4ac6-9f8e-82ede0c424c3 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:42.073227 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d53216-5991-4736-a94a-bfc22f8220ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:42.075345 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d53216-5991-4736-a94a-bfc22f8220ba admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:42.075665 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d53216-5991-4736-a94a-bfc22f8220ba admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:42.077197 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d53216-5991-4736-a94a-bfc22f8220ba admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:42.077907 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d53216-5991-4736-a94a-bfc22f8220ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:42.079571 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d53216-5991-4736-a94a-bfc22f8220ba admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:42.092685 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe44f8-ce6c-4304-ad11-a4f8409bfe43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:42.093364 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe44f8-ce6c-4304-ad11-a4f8409bfe43 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:42.093643 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe44f8-ce6c-4304-ad11-a4f8409bfe43 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:42.093889 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe44f8-ce6c-4304-ad11-a4f8409bfe43 admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:42.094536 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe44f8-ce6c-4304-ad11-a4f8409bfe43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:42.099641 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe44f8-ce6c-4304-ad11-a4f8409bfe43 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:42.112734 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 850/1718] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:45:41 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:45:42.113425 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d53216-5991-4736-a94a-bfc22f8220ba admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:42.120149 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-f9d53216-5991-4736-a94a-bfc22f8220ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:42.182853 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 869/1719] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:45:41 2022] POST /identity/v3/projects => generated 365 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:45:42.184285 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8838e3cc-ef63-4490-91e5-826294d29537 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:42.184586 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8838e3cc-ef63-4490-91e5-826294d29537 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:42.184873 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8838e3cc-ef63-4490-91e5-826294d29537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:42.264550 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-8838e3cc-ef63-4490-91e5-826294d29537 None None] MFA Rules not processed for user `3bf914e92b594610bf8bd9089bfe1e95`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:42.267054 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-8838e3cc-ef63-4490-91e5-826294d29537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:42.329365 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:42.375568 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d53216-5991-4736-a94a-bfc22f8220ba admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:42.459884 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 870/1720] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:45:42 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:45:42.460753 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8838e3cc-ef63-4490-91e5-826294d29537 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:42.585092 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a33a25-6dc2-4659-b2b0-26f6b5617d59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35441c061e514b1b9341e7694ec2c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:42.587057 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a33a25-6dc2-4659-b2b0-26f6b5617d59 service nova] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:42.604014 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a33a25-6dc2-4659-b2b0-26f6b5617d59 service nova] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:42.604014 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a33a25-6dc2-4659-b2b0-26f6b5617d59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:42.650530 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8838e3cc-ef63-4490-91e5-826294d29537 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:42.670525 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c68b732-4b14-425d-be2f-7c85820a1de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:42.671601 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c68b732-4b14-425d-be2f-7c85820a1de1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:42.671601 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c68b732-4b14-425d-be2f-7c85820a1de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:42.671832 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c68b732-4b14-425d-be2f-7c85820a1de1 admin admin] PATH_INFO: `/v3/projects/5cc22c6bb1a8437b853426f643e8f71a/users/750afd26534c4e639a750db03474e58b/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:42.691990 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c68b732-4b14-425d-be2f-7c85820a1de1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cc22c6bb1a8437b853426f643e8f71a, user_id=750afd26534c4e639a750db03474e58b, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:42.695272 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c68b732-4b14-425d-be2f-7c85820a1de1 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:42.743804 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 871/1721] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:45:42 2022] PUT /identity/v3/projects/5cc22c6bb1a8437b853426f643e8f71a/users/750afd26534c4e639a750db03474e58b/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:45:42.752532 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c68b732-4b14-425d-be2f-7c85820a1de1 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:42.776175 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a33a25-6dc2-4659-b2b0-26f6b5617d59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:42.779172 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a33a25-6dc2-4659-b2b0-26f6b5617d59 service nova] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:42.793941 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 851/1722] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:45:42 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 681 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:45:42.796007 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cdf7a2-3d8f-4e51-9644-e47bacef2df3 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:42.796365 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cdf7a2-3d8f-4e51-9644-e47bacef2df3 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:42.796727 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cdf7a2-3d8f-4e51-9644-e47bacef2df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:42.823298 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:42.892975 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-c7cdf7a2-3d8f-4e51-9644-e47bacef2df3 None None] MFA Rules not processed for user `e49a4666712746d098ace9e1cb0bf07c`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:42.895708 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-c7cdf7a2-3d8f-4e51-9644-e47bacef2df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:43.018700 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c68b732-4b14-425d-be2f-7c85820a1de1 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:43.032720 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769190f8-3ad7-4b80-a851-20ad6e622133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:43.033057 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769190f8-3ad7-4b80-a851-20ad6e622133 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:43.033366 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769190f8-3ad7-4b80-a851-20ad6e622133 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:43.034795 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769190f8-3ad7-4b80-a851-20ad6e622133 admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:43.035477 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769190f8-3ad7-4b80-a851-20ad6e622133 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:43.042932 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769190f8-3ad7-4b80-a851-20ad6e622133 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:43.109947 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 872/1723] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:45:42 2022] POST /identity/v3/users => generated 289 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:45:43.111822 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769190f8-3ad7-4b80-a851-20ad6e622133 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:43.114436 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-769190f8-3ad7-4b80-a851-20ad6e622133 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:43.126951 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 852/1724] 10.222.0.47 () {58 vars in 1009 bytes} [Mon Aug 29 22:45:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:45:43.131195 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949b9ff-014d-40cc-b32f-37b507017b9c None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:43.132119 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949b9ff-014d-40cc-b32f-37b507017b9c None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:43.132765 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949b9ff-014d-40cc-b32f-37b507017b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:43.216180 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-b949b9ff-014d-40cc-b32f-37b507017b9c None None] MFA Rules not processed for user `750afd26534c4e639a750db03474e58b`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:43.234697 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-b949b9ff-014d-40cc-b32f-37b507017b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:43.235852 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:43.261856 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769190f8-3ad7-4b80-a851-20ad6e622133 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:43.280536 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f091d1-b481-4621-9878-9eded6c6eac4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:43.281353 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f091d1-b481-4621-9878-9eded6c6eac4 service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:43.281732 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f091d1-b481-4621-9878-9eded6c6eac4 service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:43.282106 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f091d1-b481-4621-9878-9eded6c6eac4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:43.491700 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f091d1-b481-4621-9878-9eded6c6eac4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:43.495324 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f091d1-b481-4621-9878-9eded6c6eac4 service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:43.527285 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 853/1725] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:45:43 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:45:43.528639 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b949b9ff-014d-40cc-b32f-37b507017b9c None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:43.556478 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 873/1726] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:45:43 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:45:43.562100 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b949b9ff-014d-40cc-b32f-37b507017b9c None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:43.571438 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f091d1-b481-4621-9878-9eded6c6eac4 service cinder] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:43.580090 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-80f091d1-b481-4621-9878-9eded6c6eac4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:43.580932 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b595694-2a63-4703-b99a-a18a68727660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:43.581893 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b595694-2a63-4703-b99a-a18a68727660 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:43.582496 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b595694-2a63-4703-b99a-a18a68727660 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:43.583417 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b595694-2a63-4703-b99a-a18a68727660 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:43.584225 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b595694-2a63-4703-b99a-a18a68727660 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:43.588079 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b595694-2a63-4703-b99a-a18a68727660 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:43.617075 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 854/1727] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:45:43 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:45:43.625589 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b595694-2a63-4703-b99a-a18a68727660 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:43.634489 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-7b595694-2a63-4703-b99a-a18a68727660 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:43.685248 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b595694-2a63-4703-b99a-a18a68727660 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:43.699861 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6334fe-2e44-4238-b411-224929358784 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:43.700492 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6334fe-2e44-4238-b411-224929358784 service cinder] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:43.700773 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6334fe-2e44-4238-b411-224929358784 service cinder] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:43.701047 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6334fe-2e44-4238-b411-224929358784 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:43.720485 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6334fe-2e44-4238-b411-224929358784 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:43.722179 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6334fe-2e44-4238-b411-224929358784 service cinder] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:43.756408 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 855/1728] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:45:43 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:45:43.757251 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6334fe-2e44-4238-b411-224929358784 service cinder] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:43.782289 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6334fe-2e44-4238-b411-224929358784 service cinder] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:43.794762 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb7ea56-ac16-4b48-8e2d-321aeb84033c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:43.795480 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7ea56-ac16-4b48-8e2d-321aeb84033c admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:43.796388 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7ea56-ac16-4b48-8e2d-321aeb84033c admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:43.796685 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7ea56-ac16-4b48-8e2d-321aeb84033c admin admin] PATH_INFO: `/v3/projects/dec96729574440ceb26794f108040d6f/users/07fc7c8d0ff742a9b0748e93b0b47957/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:43.836969 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb7ea56-ac16-4b48-8e2d-321aeb84033c admin admin] RBAC: Authorizing `identity:create_grant(project_id=dec96729574440ceb26794f108040d6f, user_id=07fc7c8d0ff742a9b0748e93b0b47957, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:43.850596 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb7ea56-ac16-4b48-8e2d-321aeb84033c admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:43.882130 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 856/1729] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:45:43 2022] PUT /identity/v3/projects/dec96729574440ceb26794f108040d6f/users/07fc7c8d0ff742a9b0748e93b0b47957/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:45:43.883032 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb7ea56-ac16-4b48-8e2d-321aeb84033c admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:43.889611 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f091d1-b481-4621-9878-9eded6c6eac4 service cinder] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:43.935507 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:44.052608 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb7ea56-ac16-4b48-8e2d-321aeb84033c admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:44.068012 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a9718-b5c0-40bb-b639-9c52dae00b80 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '388d8dea2edf4fb888d42ca878c1434d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:44.068685 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a9718-b5c0-40bb-b639-9c52dae00b80 service swift] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:44.068980 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a9718-b5c0-40bb-b639-9c52dae00b80 service swift] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:44.069269 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a9718-b5c0-40bb-b639-9c52dae00b80 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:44.073295 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245c7f92-d573-4b52-a841-9a4e1ff5a5c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:44.074990 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c7f92-d573-4b52-a841-9a4e1ff5a5c2 service cinder] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:44.078533 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c7f92-d573-4b52-a841-9a4e1ff5a5c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:44.079184 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c7f92-d573-4b52-a841-9a4e1ff5a5c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:44.090729 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-245c7f92-d573-4b52-a841-9a4e1ff5a5c2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:44.101408 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:44.213423 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000a9718-b5c0-40bb-b639-9c52dae00b80 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:44.215316 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000a9718-b5c0-40bb-b639-9c52dae00b80 service swift] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:44.229116 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 874/1730] 10.222.0.47 () {60 vars in 1384 bytes} [Mon Aug 29 22:45:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 672 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 22:45:44.231739 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a9718-b5c0-40bb-b639-9c52dae00b80 service swift] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:44.279521 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245c7f92-d573-4b52-a841-9a4e1ff5a5c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:44.283638 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245c7f92-d573-4b52-a841-9a4e1ff5a5c2 service cinder] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:44.319742 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 857/1731] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:45:43 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:45:44.439527 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a9718-b5c0-40bb-b639-9c52dae00b80 service swift] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:44.458743 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f823aa35-cd4f-4e75-a010-7e06006a6aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:44.459533 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823aa35-cd4f-4e75-a010-7e06006a6aea admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:44.459819 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823aa35-cd4f-4e75-a010-7e06006a6aea admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:44.460210 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823aa35-cd4f-4e75-a010-7e06006a6aea admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:44.460875 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f823aa35-cd4f-4e75-a010-7e06006a6aea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:44.465598 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f823aa35-cd4f-4e75-a010-7e06006a6aea admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:44.501811 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 875/1732] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:45:44 2022] GET /identity/v3/roles => generated 1420 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:45:44.506149 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245c7f92-d573-4b52-a841-9a4e1ff5a5c2 service cinder] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:44.547923 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245c7f92-d573-4b52-a841-9a4e1ff5a5c2 service cinder] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:44.565361 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e552b-d072-4078-9420-5ad623beeb16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:44.566189 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e552b-d072-4078-9420-5ad623beeb16 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:44.566375 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e552b-d072-4078-9420-5ad623beeb16 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:44.566651 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e552b-d072-4078-9420-5ad623beeb16 admin admin] PATH_INFO: `/v3/projects/dec96729574440ceb26794f108040d6f/users/07fc7c8d0ff742a9b0748e93b0b47957/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:44.568833 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92e552b-d072-4078-9420-5ad623beeb16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dec96729574440ceb26794f108040d6f, user_id=07fc7c8d0ff742a9b0748e93b0b47957, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:44.571596 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92e552b-d072-4078-9420-5ad623beeb16 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:44.585012 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 858/1733] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:45:44 2022] PUT /identity/v3/projects/dec96729574440ceb26794f108040d6f/users/07fc7c8d0ff742a9b0748e93b0b47957/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:45:44.595146 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0dea99-a753-41a1-9048-81c7577ecf7f None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:44.595861 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0dea99-a753-41a1-9048-81c7577ecf7f None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:44.596147 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0dea99-a753-41a1-9048-81c7577ecf7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:44.607319 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e552b-d072-4078-9420-5ad623beeb16 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:44.736349 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-0b0dea99-a753-41a1-9048-81c7577ecf7f None None] MFA Rules not processed for user `07fc7c8d0ff742a9b0748e93b0b47957`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:44.738539 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-0b0dea99-a753-41a1-9048-81c7577ecf7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:44.927008 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e552b-d072-4078-9420-5ad623beeb16 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:44.945431 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a76fb7-5e06-4bdf-90a3-b1edc400f1c7 tempest-VolumeQuotaClassesTest-1168418999 tempest-VolumeQuotaClassesTest-1168418999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bf914e92b594610bf8bd9089bfe1e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fe88e0bd634886a1fb49f914cd80a2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:44.946077 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a76fb7-5e06-4bdf-90a3-b1edc400f1c7 tempest-VolumeQuotaClassesTest-1168418999 tempest-VolumeQuotaClassesTest-1168418999-project-admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:44.949754 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a76fb7-5e06-4bdf-90a3-b1edc400f1c7 tempest-VolumeQuotaClassesTest-1168418999 tempest-VolumeQuotaClassesTest-1168418999-project-admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:44.950907 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a76fb7-5e06-4bdf-90a3-b1edc400f1c7 tempest-VolumeQuotaClassesTest-1168418999 tempest-VolumeQuotaClassesTest-1168418999-project-admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:44.954439 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a76fb7-5e06-4bdf-90a3-b1edc400f1c7 tempest-VolumeQuotaClassesTest-1168418999 tempest-VolumeQuotaClassesTest-1168418999-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:45:44.954766 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a76fb7-5e06-4bdf-90a3-b1edc400f1c7 tempest-VolumeQuotaClassesTest-1168418999 tempest-VolumeQuotaClassesTest-1168418999-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:44.960180 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a76fb7-5e06-4bdf-90a3-b1edc400f1c7 tempest-VolumeQuotaClassesTest-1168418999 tempest-VolumeQuotaClassesTest-1168418999-project-admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:45.023030 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 859/1734] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Aug 29 22:45:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 416 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:45:45.023989 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a76fb7-5e06-4bdf-90a3-b1edc400f1c7 tempest-VolumeQuotaClassesTest-1168418999 tempest-VolumeQuotaClassesTest-1168418999-project-admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:45.061447 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a76fb7-5e06-4bdf-90a3-b1edc400f1c7 tempest-VolumeQuotaClassesTest-1168418999 tempest-VolumeQuotaClassesTest-1168418999-project-admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:45.070360 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 876/1735] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:45:44 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 476 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:45:45.089280 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0dea99-a753-41a1-9048-81c7577ecf7f None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:45.091868 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a313e788-e847-45e2-b04c-88e3b0e147c0 tempest-VolumeQuotaClassesTest-1168418999 tempest-VolumeQuotaClassesTest-1168418999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bf914e92b594610bf8bd9089bfe1e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fe88e0bd634886a1fb49f914cd80a2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:45.097938 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a313e788-e847-45e2-b04c-88e3b0e147c0 tempest-VolumeQuotaClassesTest-1168418999 tempest-VolumeQuotaClassesTest-1168418999-project-admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:45.098872 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a313e788-e847-45e2-b04c-88e3b0e147c0 tempest-VolumeQuotaClassesTest-1168418999 tempest-VolumeQuotaClassesTest-1168418999-project-admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:45.099281 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a313e788-e847-45e2-b04c-88e3b0e147c0 tempest-VolumeQuotaClassesTest-1168418999 tempest-VolumeQuotaClassesTest-1168418999-project-admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:45.104402 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a313e788-e847-45e2-b04c-88e3b0e147c0 tempest-VolumeQuotaClassesTest-1168418999 tempest-VolumeQuotaClassesTest-1168418999-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:45.118551 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a313e788-e847-45e2-b04c-88e3b0e147c0 tempest-VolumeQuotaClassesTest-1168418999 tempest-VolumeQuotaClassesTest-1168418999-project-admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:45.289764 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 860/1736] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:45:45 2022] POST /identity/v3/projects => generated 354 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:45:45.290780 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a313e788-e847-45e2-b04c-88e3b0e147c0 tempest-VolumeQuotaClassesTest-1168418999 tempest-VolumeQuotaClassesTest-1168418999-project-admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:45.336235 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:45.406135 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0dea99-a753-41a1-9048-81c7577ecf7f None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:45.440461 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:45.530531 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a313e788-e847-45e2-b04c-88e3b0e147c0 tempest-VolumeQuotaClassesTest-1168418999 tempest-VolumeQuotaClassesTest-1168418999-project-admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:45.554733 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f7c81-7421-4fc8-bf6f-2af263978bd1 tempest-VolumeQuotaClassesTest-1168418999 tempest-VolumeQuotaClassesTest-1168418999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bf914e92b594610bf8bd9089bfe1e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fe88e0bd634886a1fb49f914cd80a2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:45.558419 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f7c81-7421-4fc8-bf6f-2af263978bd1 tempest-VolumeQuotaClassesTest-1168418999 tempest-VolumeQuotaClassesTest-1168418999-project-admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:45.558800 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f7c81-7421-4fc8-bf6f-2af263978bd1 tempest-VolumeQuotaClassesTest-1168418999 tempest-VolumeQuotaClassesTest-1168418999-project-admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:45.559089 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f7c81-7421-4fc8-bf6f-2af263978bd1 tempest-VolumeQuotaClassesTest-1168418999 tempest-VolumeQuotaClassesTest-1168418999-project-admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:45.561112 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1f7c81-7421-4fc8-bf6f-2af263978bd1 tempest-VolumeQuotaClassesTest-1168418999 tempest-VolumeQuotaClassesTest-1168418999-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:45:45.562338 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1f7c81-7421-4fc8-bf6f-2af263978bd1 tempest-VolumeQuotaClassesTest-1168418999 tempest-VolumeQuotaClassesTest-1168418999-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:45.564601 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1f7c81-7421-4fc8-bf6f-2af263978bd1 tempest-VolumeQuotaClassesTest-1168418999 tempest-VolumeQuotaClassesTest-1168418999-project-admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:45.582264 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23418dc-8c0b-4ff8-b88b-68142d466754 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:45.585996 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23418dc-8c0b-4ff8-b88b-68142d466754 service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:45.586348 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23418dc-8c0b-4ff8-b88b-68142d466754 service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:45.586630 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23418dc-8c0b-4ff8-b88b-68142d466754 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:45.618148 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 861/1737] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Aug 29 22:45:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:45:45.620706 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f7c81-7421-4fc8-bf6f-2af263978bd1 tempest-VolumeQuotaClassesTest-1168418999 tempest-VolumeQuotaClassesTest-1168418999-project-admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:45.624913 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-1b1f7c81-7421-4fc8-bf6f-2af263978bd1 tempest-VolumeQuotaClassesTest-1168418999 tempest-VolumeQuotaClassesTest-1168418999-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:45.788578 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23418dc-8c0b-4ff8-b88b-68142d466754 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:45.791864 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23418dc-8c0b-4ff8-b88b-68142d466754 service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:45.820472 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 877/1738] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:45:45 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 732 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:45:45.822626 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23418dc-8c0b-4ff8-b88b-68142d466754 service cinder] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:45.830045 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f7c81-7421-4fc8-bf6f-2af263978bd1 tempest-VolumeQuotaClassesTest-1168418999 tempest-VolumeQuotaClassesTest-1168418999-project-admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:45.843521 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b929f-3b0a-4d26-aec9-ae4f1236b020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:45.844509 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b929f-3b0a-4d26-aec9-ae4f1236b020 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:45.844916 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b929f-3b0a-4d26-aec9-ae4f1236b020 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:45.845431 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b929f-3b0a-4d26-aec9-ae4f1236b020 admin admin] PATH_INFO: `/v3/projects/ed4a1b08994140118f518b277aba1ea0` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:45.847980 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26b929f-3b0a-4d26-aec9-ae4f1236b020 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed4a1b08994140118f518b277aba1ea0)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:45.849163 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23418dc-8c0b-4ff8-b88b-68142d466754 service cinder] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:45.854104 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26b929f-3b0a-4d26-aec9-ae4f1236b020 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:45.860880 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0bb88d-8acb-43c0-8082-6fc3664ca509 tempest-VolumeQuotaClassesTest-1168418999 tempest-VolumeQuotaClassesTest-1168418999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bf914e92b594610bf8bd9089bfe1e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01fe88e0bd634886a1fb49f914cd80a2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:45.863561 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0bb88d-8acb-43c0-8082-6fc3664ca509 tempest-VolumeQuotaClassesTest-1168418999 tempest-VolumeQuotaClassesTest-1168418999-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:45.864637 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0bb88d-8acb-43c0-8082-6fc3664ca509 tempest-VolumeQuotaClassesTest-1168418999 tempest-VolumeQuotaClassesTest-1168418999-project-admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:45.867345 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0bb88d-8acb-43c0-8082-6fc3664ca509 tempest-VolumeQuotaClassesTest-1168418999 tempest-VolumeQuotaClassesTest-1168418999-project-admin] PATH_INFO: `/v3/projects/4afedcddee3746968cfc1a16434e7ba7` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:45.871785 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0bb88d-8acb-43c0-8082-6fc3664ca509 tempest-VolumeQuotaClassesTest-1168418999 tempest-VolumeQuotaClassesTest-1168418999-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4afedcddee3746968cfc1a16434e7ba7)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:45.874955 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0bb88d-8acb-43c0-8082-6fc3664ca509 tempest-VolumeQuotaClassesTest-1168418999 tempest-VolumeQuotaClassesTest-1168418999-project-admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:46.013905 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-e26b929f-3b0a-4d26-aec9-ae4f1236b020 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed4a1b08994140118f518b277aba1ea0', 'request_id': 'req-e26b929f-3b0a-4d26-aec9-ae4f1236b020'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:46.020747 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-de0bb88d-8acb-43c0-8082-6fc3664ca509 tempest-VolumeQuotaClassesTest-1168418999 tempest-VolumeQuotaClassesTest-1168418999-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4afedcddee3746968cfc1a16434e7ba7', 'request_id': 'req-de0bb88d-8acb-43c0-8082-6fc3664ca509'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:46.030620 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-de0bb88d-8acb-43c0-8082-6fc3664ca509 tempest-VolumeQuotaClassesTest-1168418999 tempest-VolumeQuotaClassesTest-1168418999-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4afedcddee3746968cfc1a16434e7ba7', 'request_id': 'req-de0bb88d-8acb-43c0-8082-6fc3664ca509'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:46.040114 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-de0bb88d-8acb-43c0-8082-6fc3664ca509 tempest-VolumeQuotaClassesTest-1168418999 tempest-VolumeQuotaClassesTest-1168418999-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4afedcddee3746968cfc1a16434e7ba7', 'request_id': 'req-de0bb88d-8acb-43c0-8082-6fc3664ca509'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:46.041737 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-e26b929f-3b0a-4d26-aec9-ae4f1236b020 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed4a1b08994140118f518b277aba1ea0', 'request_id': 'req-e26b929f-3b0a-4d26-aec9-ae4f1236b020'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:46.057649 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-e26b929f-3b0a-4d26-aec9-ae4f1236b020 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed4a1b08994140118f518b277aba1ea0', 'request_id': 'req-e26b929f-3b0a-4d26-aec9-ae4f1236b020'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:46.075952 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-de0bb88d-8acb-43c0-8082-6fc3664ca509 tempest-VolumeQuotaClassesTest-1168418999 tempest-VolumeQuotaClassesTest-1168418999-project-admin] The token cache is being invalidate because project 4afedcddee3746968cfc1a16434e7ba7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:45:46.076841 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-de0bb88d-8acb-43c0-8082-6fc3664ca509 tempest-VolumeQuotaClassesTest-1168418999 tempest-VolumeQuotaClassesTest-1168418999-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:46.077945 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-de0bb88d-8acb-43c0-8082-6fc3664ca509 tempest-VolumeQuotaClassesTest-1168418999 tempest-VolumeQuotaClassesTest-1168418999-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:46.083774 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 878/1739] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:45:45 2022] DELETE /identity/v3/projects/4afedcddee3746968cfc1a16434e7ba7 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:45:46.083774 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4c964-09f8-46e9-93fe-9cca0c12e9eb None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:46.083774 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4c964-09f8-46e9-93fe-9cca0c12e9eb None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:46.083774 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4c964-09f8-46e9-93fe-9cca0c12e9eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:46.099756 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-e26b929f-3b0a-4d26-aec9-ae4f1236b020 admin admin] The token cache is being invalidate because project ed4a1b08994140118f518b277aba1ea0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:45:46.102026 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-e26b929f-3b0a-4d26-aec9-ae4f1236b020 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:46.104295 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-e26b929f-3b0a-4d26-aec9-ae4f1236b020 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:46.107479 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 862/1740] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:45:45 2022] DELETE /identity/v3/projects/ed4a1b08994140118f518b277aba1ea0 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:45:46.111784 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b929f-3b0a-4d26-aec9-ae4f1236b020 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:46.117555 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-e26b929f-3b0a-4d26-aec9-ae4f1236b020 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:46.138045 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-dbd4c964-09f8-46e9-93fe-9cca0c12e9eb None None] MFA Rules not processed for user `21070561ca4f4b5fb621cde17195d1cc`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:46.141437 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-dbd4c964-09f8-46e9-93fe-9cca0c12e9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:46.160717 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:46.377569 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:46.406784 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b929f-3b0a-4d26-aec9-ae4f1236b020 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:46.413165 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 879/1741] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:45:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:45:46.434089 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe08d1cb-a358-4362-8082-8bb1c58504b2 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:46.434089 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe08d1cb-a358-4362-8082-8bb1c58504b2 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:46.434623 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe08d1cb-a358-4362-8082-8bb1c58504b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:46.546838 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-fe08d1cb-a358-4362-8082-8bb1c58504b2 None None] MFA Rules not processed for user `21070561ca4f4b5fb621cde17195d1cc`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:46.548198 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-fe08d1cb-a358-4362-8082-8bb1c58504b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:46.566629 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 880/1742] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:45:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:45:46.580636 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe08d1cb-a358-4362-8082-8bb1c58504b2 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:46.584598 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-fe08d1cb-a358-4362-8082-8bb1c58504b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:46.755832 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b45129-457b-4794-99ef-80bb4d806eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:46.759870 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b45129-457b-4794-99ef-80bb4d806eb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:46.760138 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b45129-457b-4794-99ef-80bb4d806eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:46.763535 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b45129-457b-4794-99ef-80bb4d806eb8 admin admin] PATH_INFO: `/v3/users/111bc92de66e4f5da3d1814cfa68eefc` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:46.766489 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b45129-457b-4794-99ef-80bb4d806eb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=111bc92de66e4f5da3d1814cfa68eefc)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:46.778668 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b45129-457b-4794-99ef-80bb4d806eb8 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:46.919366 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe08d1cb-a358-4362-8082-8bb1c58504b2 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:46.951655 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d4cb5-5bf0-46ee-9780-b7af4adae398 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35441c061e514b1b9341e7694ec2c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:46.952302 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d4cb5-5bf0-46ee-9780-b7af4adae398 service nova] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:46.952598 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d4cb5-5bf0-46ee-9780-b7af4adae398 service nova] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:46.952860 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d4cb5-5bf0-46ee-9780-b7af4adae398 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:46.955408 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-09b45129-457b-4794-99ef-80bb4d806eb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '111bc92de66e4f5da3d1814cfa68eefc'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:46.982885 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-09b45129-457b-4794-99ef-80bb4d806eb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '111bc92de66e4f5da3d1814cfa68eefc'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:46.985621 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-09b45129-457b-4794-99ef-80bb4d806eb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '111bc92de66e4f5da3d1814cfa68eefc'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:46.994874 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0d4cb5-5bf0-46ee-9780-b7af4adae398 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:46.996780 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0d4cb5-5bf0-46ee-9780-b7af4adae398 service nova] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:47.031939 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-09b45129-457b-4794-99ef-80bb4d806eb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '111bc92de66e4f5da3d1814cfa68eefc'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:47.054211 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 881/1743] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:45:46 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:45:47.062225 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d4cb5-5bf0-46ee-9780-b7af4adae398 service nova] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:47.066509 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-6b0d4cb5-5bf0-46ee-9780-b7af4adae398 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:47.067788 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-09b45129-457b-4794-99ef-80bb4d806eb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '111bc92de66e4f5da3d1814cfa68eefc'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:47.100630 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 863/1744] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:45:46 2022] DELETE /identity/v3/users/111bc92de66e4f5da3d1814cfa68eefc => generated 0 bytes in 989 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:45:47.166647 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d4cb5-5bf0-46ee-9780-b7af4adae398 service nova] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:47.420392 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d833dac2-85e5-4cb7-8d06-edea548014d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:47.421401 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d833dac2-85e5-4cb7-8d06-edea548014d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:47.421846 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d833dac2-85e5-4cb7-8d06-edea548014d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:47.422275 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d833dac2-85e5-4cb7-8d06-edea548014d7 admin admin] PATH_INFO: `/v3/users/15eef49c3021421f8e40ff94bc5fdd35` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:47.423663 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d833dac2-85e5-4cb7-8d06-edea548014d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15eef49c3021421f8e40ff94bc5fdd35)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:47.425853 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d833dac2-85e5-4cb7-8d06-edea548014d7 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:47.542732 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:47.569875 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-d833dac2-85e5-4cb7-8d06-edea548014d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15eef49c3021421f8e40ff94bc5fdd35'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:47.592844 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-d833dac2-85e5-4cb7-8d06-edea548014d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15eef49c3021421f8e40ff94bc5fdd35'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:47.596000 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-d833dac2-85e5-4cb7-8d06-edea548014d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15eef49c3021421f8e40ff94bc5fdd35'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:47.624180 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-d833dac2-85e5-4cb7-8d06-edea548014d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15eef49c3021421f8e40ff94bc5fdd35'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:47.627345 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-d833dac2-85e5-4cb7-8d06-edea548014d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15eef49c3021421f8e40ff94bc5fdd35'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:47.686529 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 882/1745] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:45:47 2022] DELETE /identity/v3/users/15eef49c3021421f8e40ff94bc5fdd35 => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:45:47.690324 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65f45e-ea07-4ca5-bdae-b740435d2965 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:47.690878 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65f45e-ea07-4ca5-bdae-b740435d2965 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:47.691478 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65f45e-ea07-4ca5-bdae-b740435d2965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:47.730682 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-ee65f45e-ea07-4ca5-bdae-b740435d2965 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:47.733607 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-ee65f45e-ea07-4ca5-bdae-b740435d2965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:47.861685 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d833dac2-85e5-4cb7-8d06-edea548014d7 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:47.870172 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-d833dac2-85e5-4cb7-8d06-edea548014d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:48.004896 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 864/1746] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:45:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:45:48.124233 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d833dac2-85e5-4cb7-8d06-edea548014d7 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:48.131670 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee65f45e-ea07-4ca5-bdae-b740435d2965 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:48.133315 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-ee65f45e-ea07-4ca5-bdae-b740435d2965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:48.168155 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eca207-f4ec-4968-9b23-879dfe15720a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:48.168826 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eca207-f4ec-4968-9b23-879dfe15720a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:48.169126 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eca207-f4ec-4968-9b23-879dfe15720a admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:48.182579 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eca207-f4ec-4968-9b23-879dfe15720a admin admin] PATH_INFO: `/v3/users/a95d57259f094b6ab3b7af97f099a0db` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:48.190197 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eca207-f4ec-4968-9b23-879dfe15720a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a95d57259f094b6ab3b7af97f099a0db)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:48.202306 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eca207-f4ec-4968-9b23-879dfe15720a admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:48.232562 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:48.355545 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee65f45e-ea07-4ca5-bdae-b740435d2965 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:48.366148 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-47eca207-f4ec-4968-9b23-879dfe15720a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a95d57259f094b6ab3b7af97f099a0db'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:48.368436 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985b22cf-39fa-4473-9590-04a662b83066 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:48.369182 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b22cf-39fa-4473-9590-04a662b83066 service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:48.369497 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b22cf-39fa-4473-9590-04a662b83066 service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:48.369954 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b22cf-39fa-4473-9590-04a662b83066 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:48.377422 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-47eca207-f4ec-4968-9b23-879dfe15720a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a95d57259f094b6ab3b7af97f099a0db'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:48.379002 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-47eca207-f4ec-4968-9b23-879dfe15720a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a95d57259f094b6ab3b7af97f099a0db'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:48.390837 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985b22cf-39fa-4473-9590-04a662b83066 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:48.392605 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985b22cf-39fa-4473-9590-04a662b83066 service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:48.409218 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-47eca207-f4ec-4968-9b23-879dfe15720a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a95d57259f094b6ab3b7af97f099a0db'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:48.410064 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-47eca207-f4ec-4968-9b23-879dfe15720a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a95d57259f094b6ab3b7af97f099a0db'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:48.424043 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 865/1747] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:45:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:45:48.427249 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280613c5-e27b-42ee-b505-47be0a0ddd5a None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:48.427249 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280613c5-e27b-42ee-b505-47be0a0ddd5a None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:48.427583 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280613c5-e27b-42ee-b505-47be0a0ddd5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:48.493040 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 883/1748] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:45:47 2022] DELETE /identity/v3/users/a95d57259f094b6ab3b7af97f099a0db => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:45:48.498482 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe83ad7-1e42-4bd1-b244-8529e3754c97 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:48.498934 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe83ad7-1e42-4bd1-b244-8529e3754c97 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:48.499223 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe83ad7-1e42-4bd1-b244-8529e3754c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:48.510793 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-280613c5-e27b-42ee-b505-47be0a0ddd5a None None] MFA Rules not processed for user `27abbf7b40e54fc091ebfe10aa6da90d`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:48.512052 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-280613c5-e27b-42ee-b505-47be0a0ddd5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:48.564498 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-bfe83ad7-1e42-4bd1-b244-8529e3754c97 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:48.566346 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-bfe83ad7-1e42-4bd1-b244-8529e3754c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:48.648782 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:48.747666 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 866/1749] 10.222.0.18 () {58 vars in 1015 bytes} [Mon Aug 29 22:45:48 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:45:48.750387 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f582bf-e506-4d9d-be7b-225b7b662421 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:48.750685 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f582bf-e506-4d9d-be7b-225b7b662421 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:48.751098 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f582bf-e506-4d9d-be7b-225b7b662421 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:48.753039 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 867/1750] 10.222.0.47 () {54 vars in 912 bytes} [Mon Aug 29 22:45:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:45:48.755042 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f582bf-e506-4d9d-be7b-225b7b662421 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:48.757451 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-c2f582bf-e506-4d9d-be7b-225b7b662421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:48.800561 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 884/1751] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:45:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:45:48.805979 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a69eb-0b25-465a-964a-b4e753493316 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:48.805979 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a69eb-0b25-465a-964a-b4e753493316 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:48.807474 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a69eb-0b25-465a-964a-b4e753493316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:48.834616 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-dd6a69eb-0b25-465a-964a-b4e753493316 None None] MFA Rules not processed for user `27abbf7b40e54fc091ebfe10aa6da90d`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:48.840415 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-dd6a69eb-0b25-465a-964a-b4e753493316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:48.856922 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 885/1752] 10.222.0.47 () {58 vars in 1009 bytes} [Mon Aug 29 22:45:48 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:45:48.858056 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6a69eb-0b25-465a-964a-b4e753493316 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:48.859589 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-dd6a69eb-0b25-465a-964a-b4e753493316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:48.872602 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6a69eb-0b25-465a-964a-b4e753493316 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:48.879860 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbe6e4c-d517-4bad-9f19-4f57ac1d9775 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:48.880731 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe6e4c-d517-4bad-9f19-4f57ac1d9775 service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:48.881113 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe6e4c-d517-4bad-9f19-4f57ac1d9775 service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:48.881587 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe6e4c-d517-4bad-9f19-4f57ac1d9775 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:48.902942 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbe6e4c-d517-4bad-9f19-4f57ac1d9775 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:48.904548 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbe6e4c-d517-4bad-9f19-4f57ac1d9775 service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:48.916556 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f582bf-e506-4d9d-be7b-225b7b662421 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:48.916862 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 886/1753] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:45:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:45:48.918162 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbe6e4c-d517-4bad-9f19-4f57ac1d9775 service neutron] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:48.925066 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc6094-47b4-43e0-876f-31351edc3aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:48.926556 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc6094-47b4-43e0-876f-31351edc3aac admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:48.927182 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc6094-47b4-43e0-876f-31351edc3aac admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:48.927633 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc6094-47b4-43e0-876f-31351edc3aac admin admin] PATH_INFO: `/v3/projects/5c7e4f8c29ce494e894058a793c218da` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:48.929573 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdc6094-47b4-43e0-876f-31351edc3aac admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c7e4f8c29ce494e894058a793c218da)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:48.938084 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdc6094-47b4-43e0-876f-31351edc3aac admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:48.947848 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbe6e4c-d517-4bad-9f19-4f57ac1d9775 service neutron] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:48.952395 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a5c73-0350-44f6-ada4-f703497bbc19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:48.953143 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a5c73-0350-44f6-ada4-f703497bbc19 service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:48.953613 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a5c73-0350-44f6-ada4-f703497bbc19 service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:48.954137 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a5c73-0350-44f6-ada4-f703497bbc19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:48.971800 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28a5c73-0350-44f6-ada4-f703497bbc19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:48.974336 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28a5c73-0350-44f6-ada4-f703497bbc19 service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:48.990761 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 887/1754] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:45:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:45:48.992088 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a5c73-0350-44f6-ada4-f703497bbc19 service neutron] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:49.004301 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a5c73-0350-44f6-ada4-f703497bbc19 service neutron] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:49.031573 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-cfdc6094-47b4-43e0-876f-31351edc3aac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c7e4f8c29ce494e894058a793c218da', 'request_id': 'req-cfdc6094-47b4-43e0-876f-31351edc3aac'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:49.051046 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-cfdc6094-47b4-43e0-876f-31351edc3aac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c7e4f8c29ce494e894058a793c218da', 'request_id': 'req-cfdc6094-47b4-43e0-876f-31351edc3aac'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:49.072676 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-cfdc6094-47b4-43e0-876f-31351edc3aac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c7e4f8c29ce494e894058a793c218da', 'request_id': 'req-cfdc6094-47b4-43e0-876f-31351edc3aac'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:49.078375 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41edb99-fc67-47be-a331-6d00d5f459d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:49.079139 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41edb99-fc67-47be-a331-6d00d5f459d2 service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:49.079534 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41edb99-fc67-47be-a331-6d00d5f459d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:49.079940 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41edb99-fc67-47be-a331-6d00d5f459d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:49.091156 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41edb99-fc67-47be-a331-6d00d5f459d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:49.093177 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41edb99-fc67-47be-a331-6d00d5f459d2 service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:49.103675 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-cfdc6094-47b4-43e0-876f-31351edc3aac admin admin] The token cache is being invalidate because project 5c7e4f8c29ce494e894058a793c218da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:45:49.105702 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-cfdc6094-47b4-43e0-876f-31351edc3aac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:49.108050 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 888/1755] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:45:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:45:49.108836 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-cfdc6094-47b4-43e0-876f-31351edc3aac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:49.118309 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 868/1756] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:45:48 2022] DELETE /identity/v3/projects/5c7e4f8c29ce494e894058a793c218da => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:45:49.124114 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029e624-df9f-4317-9b30-7991c9aae877 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:49.124684 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029e624-df9f-4317-9b30-7991c9aae877 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:49.125249 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029e624-df9f-4317-9b30-7991c9aae877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:49.165994 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-7029e624-df9f-4317-9b30-7991c9aae877 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:49.167344 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-7029e624-df9f-4317-9b30-7991c9aae877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:49.398686 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 889/1757] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:45:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:45:49.410361 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba343ed-147a-411d-81a8-a9a22b0779e0 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:49.411581 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba343ed-147a-411d-81a8-a9a22b0779e0 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:49.412297 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba343ed-147a-411d-81a8-a9a22b0779e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:49.453754 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:49.482350 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-1ba343ed-147a-411d-81a8-a9a22b0779e0 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:49.516170 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-1ba343ed-147a-411d-81a8-a9a22b0779e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:49.613185 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 869/1758] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:45:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:45:49.618470 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7029e624-df9f-4317-9b30-7991c9aae877 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:49.631174 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7029e624-df9f-4317-9b30-7991c9aae877 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:49.649704 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc69b1-bb90-4502-a975-6294e4e78bed None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:49.650196 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc69b1-bb90-4502-a975-6294e4e78bed None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:49.650631 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc69b1-bb90-4502-a975-6294e4e78bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:49.666103 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a8c1f-d5c3-4403-a826-a75d96cf08a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:49.666758 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a8c1f-d5c3-4403-a826-a75d96cf08a7 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:49.667044 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a8c1f-d5c3-4403-a826-a75d96cf08a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:49.674391 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a8c1f-d5c3-4403-a826-a75d96cf08a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:49.674391 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37a8c1f-d5c3-4403-a826-a75d96cf08a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:45:49.674391 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37a8c1f-d5c3-4403-a826-a75d96cf08a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:49.677580 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37a8c1f-d5c3-4403-a826-a75d96cf08a7 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:49.728605 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 890/1759] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Aug 29 22:45:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:45:49.729638 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a8c1f-d5c3-4403-a826-a75d96cf08a7 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:49.752955 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-03bc69b1-bb90-4502-a975-6294e4e78bed None None] MFA Rules not processed for user `50f7df9dc9f2455d9426b1737770140f`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:49.759271 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-03bc69b1-bb90-4502-a975-6294e4e78bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:49.764976 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a8c1f-d5c3-4403-a826-a75d96cf08a7 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:49.792429 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7667384-73ee-42d0-aec2-8f729c6867c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:49.793299 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7667384-73ee-42d0-aec2-8f729c6867c7 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:49.793656 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7667384-73ee-42d0-aec2-8f729c6867c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:49.793947 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7667384-73ee-42d0-aec2-8f729c6867c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:49.794668 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7667384-73ee-42d0-aec2-8f729c6867c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:49.796905 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7667384-73ee-42d0-aec2-8f729c6867c7 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:49.906275 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 891/1760] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:45:49 2022] POST /identity/v3/projects => generated 389 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:45:49.912253 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7667384-73ee-42d0-aec2-8f729c6867c7 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:49.946628 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:50.045002 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 870/1761] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:45:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:45:50.181475 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7667384-73ee-42d0-aec2-8f729c6867c7 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:50.187543 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ea7a6-5643-4962-9626-e89ac5ee6663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:50.189049 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ea7a6-5643-4962-9626-e89ac5ee6663 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:50.189521 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ea7a6-5643-4962-9626-e89ac5ee6663 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:50.189964 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ea7a6-5643-4962-9626-e89ac5ee6663 admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:50.190765 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157ea7a6-5643-4962-9626-e89ac5ee6663 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:50.193693 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157ea7a6-5643-4962-9626-e89ac5ee6663 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:50.263462 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 892/1762] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:45:49 2022] POST /identity/v3/users => generated 295 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:45:50.267906 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc69b1-bb90-4502-a975-6294e4e78bed None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:50.294771 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc69b1-bb90-4502-a975-6294e4e78bed None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:50.300236 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6028893-8024-41be-87ef-bcde88a3da2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:50.301043 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6028893-8024-41be-87ef-bcde88a3da2b admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:50.302444 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6028893-8024-41be-87ef-bcde88a3da2b admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:50.302976 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6028893-8024-41be-87ef-bcde88a3da2b admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:50.303993 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6028893-8024-41be-87ef-bcde88a3da2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:50.305887 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6028893-8024-41be-87ef-bcde88a3da2b admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:50.344843 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 871/1763] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:45:50 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:45:50.347187 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ea7a6-5643-4962-9626-e89ac5ee6663 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:50.370780 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ea7a6-5643-4962-9626-e89ac5ee6663 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:50.387123 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590a9af3-faf9-49ae-9dfd-1caf4aec84e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:50.388083 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a9af3-faf9-49ae-9dfd-1caf4aec84e1 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:50.388793 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a9af3-faf9-49ae-9dfd-1caf4aec84e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:50.389218 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a9af3-faf9-49ae-9dfd-1caf4aec84e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:50.390108 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590a9af3-faf9-49ae-9dfd-1caf4aec84e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:50.393893 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590a9af3-faf9-49ae-9dfd-1caf4aec84e1 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:50.430646 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 893/1764] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:45:50 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:45:50.432420 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6028893-8024-41be-87ef-bcde88a3da2b admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:50.449098 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6028893-8024-41be-87ef-bcde88a3da2b admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:50.465884 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba68fcb-5d61-4c96-a558-58f4a9fafa11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:50.466809 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba68fcb-5d61-4c96-a558-58f4a9fafa11 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:50.467099 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba68fcb-5d61-4c96-a558-58f4a9fafa11 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:50.467379 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba68fcb-5d61-4c96-a558-58f4a9fafa11 admin admin] PATH_INFO: `/v3/projects/986abc6cfcb54ac99a13cc15b33c50f7/users/9d6d70eabaf949d0a49d9098fa133848/roles/0c67797d444d4c929b2ccab47c468848` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:50.504180 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba68fcb-5d61-4c96-a558-58f4a9fafa11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=986abc6cfcb54ac99a13cc15b33c50f7, user_id=9d6d70eabaf949d0a49d9098fa133848, role_id=0c67797d444d4c929b2ccab47c468848)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:50.507665 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba68fcb-5d61-4c96-a558-58f4a9fafa11 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:50.551002 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 872/1765] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:45:50 2022] PUT /identity/v3/projects/986abc6cfcb54ac99a13cc15b33c50f7/users/9d6d70eabaf949d0a49d9098fa133848/roles/0c67797d444d4c929b2ccab47c468848 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:45:50.553179 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364dd416-5524-4fed-9849-fead69d45cd5 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:50.553779 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364dd416-5524-4fed-9849-fead69d45cd5 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:50.553779 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364dd416-5524-4fed-9849-fead69d45cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:50.638325 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-364dd416-5524-4fed-9849-fead69d45cd5 None None] MFA Rules not processed for user `9d6d70eabaf949d0a49d9098fa133848`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:50.639584 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-364dd416-5524-4fed-9849-fead69d45cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:50.770884 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 894/1766] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:45:50 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:45:50.774144 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba68fcb-5d61-4c96-a558-58f4a9fafa11 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:50.911632 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba68fcb-5d61-4c96-a558-58f4a9fafa11 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:50.917827 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7419bdf1-a0d6-49b5-94fd-ae866e7ee25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:50.923380 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419bdf1-a0d6-49b5-94fd-ae866e7ee25c admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:50.924092 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419bdf1-a0d6-49b5-94fd-ae866e7ee25c admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:50.925028 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419bdf1-a0d6-49b5-94fd-ae866e7ee25c admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:50.927841 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7419bdf1-a0d6-49b5-94fd-ae866e7ee25c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:50.931533 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7419bdf1-a0d6-49b5-94fd-ae866e7ee25c admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:51.025905 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364dd416-5524-4fed-9849-fead69d45cd5 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:51.027539 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-364dd416-5524-4fed-9849-fead69d45cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:51.030785 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 873/1767] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:45:50 2022] POST /identity/v3/projects => generated 389 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:45:51.031888 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7419bdf1-a0d6-49b5-94fd-ae866e7ee25c admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:51.067894 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364dd416-5524-4fed-9849-fead69d45cd5 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:51.162125 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:51.219869 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7419bdf1-a0d6-49b5-94fd-ae866e7ee25c admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:51.231666 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300e941f-a9e6-4c2c-9fbf-f331ff2ac253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:51.234327 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300e941f-a9e6-4c2c-9fbf-f331ff2ac253 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:51.234703 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300e941f-a9e6-4c2c-9fbf-f331ff2ac253 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:51.235259 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300e941f-a9e6-4c2c-9fbf-f331ff2ac253 admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:51.236291 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300e941f-a9e6-4c2c-9fbf-f331ff2ac253 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:51.240268 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300e941f-a9e6-4c2c-9fbf-f331ff2ac253 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:51.290787 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d53444f-8d74-454d-806a-3a82a4bbd824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:51.292897 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53444f-8d74-454d-806a-3a82a4bbd824 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:51.294259 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53444f-8d74-454d-806a-3a82a4bbd824 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:51.295442 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53444f-8d74-454d-806a-3a82a4bbd824 admin admin] PATH_INFO: `/v3/users/084bf355436944b9be6115ef64f34503` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:51.298126 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d53444f-8d74-454d-806a-3a82a4bbd824 admin admin] RBAC: Authorizing `identity:delete_user(user_id=084bf355436944b9be6115ef64f34503)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:51.301737 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d53444f-8d74-454d-806a-3a82a4bbd824 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:51.309269 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 874/1768] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:45:51 2022] POST /identity/v3/users => generated 301 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:45:51.310831 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300e941f-a9e6-4c2c-9fbf-f331ff2ac253 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:51.342262 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300e941f-a9e6-4c2c-9fbf-f331ff2ac253 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:51.360409 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573291a0-03aa-43e2-b6ed-014bfb1eaa5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:51.361052 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573291a0-03aa-43e2-b6ed-014bfb1eaa5c admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:51.361420 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573291a0-03aa-43e2-b6ed-014bfb1eaa5c admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:51.361696 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573291a0-03aa-43e2-b6ed-014bfb1eaa5c admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:51.362357 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573291a0-03aa-43e2-b6ed-014bfb1eaa5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:51.370703 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573291a0-03aa-43e2-b6ed-014bfb1eaa5c admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:51.391783 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:51.404125 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 875/1769] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:45:51 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:45:51.410441 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573291a0-03aa-43e2-b6ed-014bfb1eaa5c admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:51.444229 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573291a0-03aa-43e2-b6ed-014bfb1eaa5c admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:51.457369 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6543ae6-64fa-4a49-adbf-08e115621d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:51.460122 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6543ae6-64fa-4a49-adbf-08e115621d6f admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:51.461217 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6543ae6-64fa-4a49-adbf-08e115621d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:51.463408 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6543ae6-64fa-4a49-adbf-08e115621d6f admin admin] PATH_INFO: `/v3/projects/4b99b7bd802043749b865e56b3eb2cab/users/dc8a346d546f4d8fbb5ed8c39847af4e/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:51.498990 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-0d53444f-8d74-454d-806a-3a82a4bbd824 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '084bf355436944b9be6115ef64f34503'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:51.509433 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6543ae6-64fa-4a49-adbf-08e115621d6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b99b7bd802043749b865e56b3eb2cab, user_id=dc8a346d546f4d8fbb5ed8c39847af4e, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:51.515364 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6543ae6-64fa-4a49-adbf-08e115621d6f admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:51.523497 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-0d53444f-8d74-454d-806a-3a82a4bbd824 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '084bf355436944b9be6115ef64f34503'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:51.525506 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-0d53444f-8d74-454d-806a-3a82a4bbd824 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '084bf355436944b9be6115ef64f34503'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:51.549736 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 876/1770] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:45:51 2022] PUT /identity/v3/projects/4b99b7bd802043749b865e56b3eb2cab/users/dc8a346d546f4d8fbb5ed8c39847af4e/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:45:51.560789 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6543ae6-64fa-4a49-adbf-08e115621d6f admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:51.562405 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-0d53444f-8d74-454d-806a-3a82a4bbd824 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '084bf355436944b9be6115ef64f34503'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:51.567714 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-0d53444f-8d74-454d-806a-3a82a4bbd824 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '084bf355436944b9be6115ef64f34503'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:51.655729 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 895/1771] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:45:51 2022] DELETE /identity/v3/users/084bf355436944b9be6115ef64f34503 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:45:51.660404 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8568e-490d-4bc5-b50b-96156d063a66 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:51.660719 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8568e-490d-4bc5-b50b-96156d063a66 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:51.660998 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8568e-490d-4bc5-b50b-96156d063a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:51.745885 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-b2f8568e-490d-4bc5-b50b-96156d063a66 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:51.753419 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-b2f8568e-490d-4bc5-b50b-96156d063a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:51.836915 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6543ae6-64fa-4a49-adbf-08e115621d6f admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:51.953806 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 896/1772] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:45:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:45:51.978637 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f8568e-490d-4bc5-b50b-96156d063a66 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:51.981226 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-b2f8568e-490d-4bc5-b50b-96156d063a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:52.046117 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56d23d-3929-46f3-ab9b-22c7ba8e82cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:52.047094 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56d23d-3929-46f3-ab9b-22c7ba8e82cb admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:52.047500 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56d23d-3929-46f3-ab9b-22c7ba8e82cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:52.047852 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56d23d-3929-46f3-ab9b-22c7ba8e82cb admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:52.048874 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb56d23d-3929-46f3-ab9b-22c7ba8e82cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:52.052920 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb56d23d-3929-46f3-ab9b-22c7ba8e82cb admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:52.086381 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 877/1773] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:45:51 2022] GET /identity/v3/roles => generated 1420 bytes in 531 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:45:52.091657 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56d23d-3929-46f3-ab9b-22c7ba8e82cb admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:52.099468 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-cb56d23d-3929-46f3-ab9b-22c7ba8e82cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:52.131503 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56d23d-3929-46f3-ab9b-22c7ba8e82cb admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:52.149799 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffd2f76-af75-43c4-8ab7-048710966853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:52.150831 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd2f76-af75-43c4-8ab7-048710966853 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:52.151306 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd2f76-af75-43c4-8ab7-048710966853 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:52.151948 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd2f76-af75-43c4-8ab7-048710966853 admin admin] PATH_INFO: `/v3/projects/4b99b7bd802043749b865e56b3eb2cab/users/dc8a346d546f4d8fbb5ed8c39847af4e/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:52.154440 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffd2f76-af75-43c4-8ab7-048710966853 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b99b7bd802043749b865e56b3eb2cab, user_id=dc8a346d546f4d8fbb5ed8c39847af4e, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:52.160193 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffd2f76-af75-43c4-8ab7-048710966853 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:52.191151 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 878/1774] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:45:52 2022] PUT /identity/v3/projects/4b99b7bd802043749b865e56b3eb2cab/users/dc8a346d546f4d8fbb5ed8c39847af4e/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:45:52.201611 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d75091c-b2ab-40dd-8dbe-f77651d8c215 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:52.202204 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d75091c-b2ab-40dd-8dbe-f77651d8c215 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:52.202668 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d75091c-b2ab-40dd-8dbe-f77651d8c215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:52.234998 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f8568e-490d-4bc5-b50b-96156d063a66 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:52.281364 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-6d75091c-b2ab-40dd-8dbe-f77651d8c215 None None] MFA Rules not processed for user `dc8a346d546f4d8fbb5ed8c39847af4e`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:52.283275 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-6d75091c-b2ab-40dd-8dbe-f77651d8c215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:52.324997 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:52.453296 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf470d-5c58-40c5-88ba-f0cd31b3280a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:52.455707 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf470d-5c58-40c5-88ba-f0cd31b3280a service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:52.455993 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf470d-5c58-40c5-88ba-f0cd31b3280a service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:52.456268 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf470d-5c58-40c5-88ba-f0cd31b3280a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:52.476891 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 879/1775] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:45:52 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:45:52.483125 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:52.495937 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d75091c-b2ab-40dd-8dbe-f77651d8c215 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:52.500134 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-6d75091c-b2ab-40dd-8dbe-f77651d8c215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:52.706913 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d75091c-b2ab-40dd-8dbe-f77651d8c215 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:52.722443 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbf470d-5c58-40c5-88ba-f0cd31b3280a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:52.725504 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbf470d-5c58-40c5-88ba-f0cd31b3280a service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:52.739667 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a2907b-2077-43cd-be01-e875f5c93c68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:52.740601 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2907b-2077-43cd-be01-e875f5c93c68 service cinder] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:52.740777 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2907b-2077-43cd-be01-e875f5c93c68 service cinder] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:52.741048 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2907b-2077-43cd-be01-e875f5c93c68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:52.765362 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a2907b-2077-43cd-be01-e875f5c93c68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:52.766856 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a2907b-2077-43cd-be01-e875f5c93c68 service cinder] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:52.787936 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 897/1776] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:45:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 809 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:45:52.793565 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf470d-5c58-40c5-88ba-f0cd31b3280a service neutron] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:52.798003 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-2bbf470d-5c58-40c5-88ba-f0cd31b3280a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:52.825748 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 880/1777] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:45:52 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:45:53.092019 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c45a83-9827-4d54-b9ee-568229456e76 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:53.092306 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c45a83-9827-4d54-b9ee-568229456e76 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:53.092579 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c45a83-9827-4d54-b9ee-568229456e76 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:53.094145 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 881/1778] 10.222.0.47 () {54 vars in 921 bytes} [Mon Aug 29 22:45:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:45:53.109062 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c59008-dfa0-4785-8e12-bd19aa25eeca None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:53.109395 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c59008-dfa0-4785-8e12-bd19aa25eeca None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:53.109672 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c59008-dfa0-4785-8e12-bd19aa25eeca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:53.174380 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-27c59008-dfa0-4785-8e12-bd19aa25eeca None None] MFA Rules not processed for user `35441c061e514b1b9341e7694ec2c0bc`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:53.181296 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-27c59008-dfa0-4785-8e12-bd19aa25eeca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:53.190629 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf470d-5c58-40c5-88ba-f0cd31b3280a service neutron] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:53.215665 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265e776f-62b6-4966-bf03-ba015dae7ef1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35441c061e514b1b9341e7694ec2c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:53.216376 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e776f-62b6-4966-bf03-ba015dae7ef1 service nova] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:53.216732 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e776f-62b6-4966-bf03-ba015dae7ef1 service nova] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:53.217009 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e776f-62b6-4966-bf03-ba015dae7ef1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:53.219160 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-265e776f-62b6-4966-bf03-ba015dae7ef1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:53.227047 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 882/1779] 10.222.0.47 () {58 vars in 1018 bytes} [Mon Aug 29 22:45:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 29 22:45:53.228792 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c59008-dfa0-4785-8e12-bd19aa25eeca None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:53.256925 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c59008-dfa0-4785-8e12-bd19aa25eeca None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:53.278319 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e672bf-dd99-4144-b30a-f65932f4cf3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:53.279001 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e672bf-dd99-4144-b30a-f65932f4cf3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:53.279285 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e672bf-dd99-4144-b30a-f65932f4cf3f admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:53.279558 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e672bf-dd99-4144-b30a-f65932f4cf3f admin admin] PATH_INFO: `/v3/users/9d6d70eabaf949d0a49d9098fa133848` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:53.283410 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e672bf-dd99-4144-b30a-f65932f4cf3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d6d70eabaf949d0a49d9098fa133848)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:53.287121 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e672bf-dd99-4144-b30a-f65932f4cf3f admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:53.415371 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265e776f-62b6-4966-bf03-ba015dae7ef1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:53.420006 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265e776f-62b6-4966-bf03-ba015dae7ef1 service nova] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:53.420350 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-87e672bf-dd99-4144-b30a-f65932f4cf3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d6d70eabaf949d0a49d9098fa133848'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:53.437310 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-87e672bf-dd99-4144-b30a-f65932f4cf3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d6d70eabaf949d0a49d9098fa133848'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:53.439004 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-87e672bf-dd99-4144-b30a-f65932f4cf3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d6d70eabaf949d0a49d9098fa133848'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:53.454039 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 898/1780] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:45:52 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 666 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:45:53.467612 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-87e672bf-dd99-4144-b30a-f65932f4cf3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d6d70eabaf949d0a49d9098fa133848'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:53.483972 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-87e672bf-dd99-4144-b30a-f65932f4cf3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d6d70eabaf949d0a49d9098fa133848'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:53.493432 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 883/1781] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:45:53 2022] DELETE /identity/v3/users/9d6d70eabaf949d0a49d9098fa133848 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:45:53.498314 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75da74-c4a1-43c3-b3ed-94c09c2a358f None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:53.498600 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75da74-c4a1-43c3-b3ed-94c09c2a358f None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:53.499411 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75da74-c4a1-43c3-b3ed-94c09c2a358f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:53.536788 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-cb75da74-c4a1-43c3-b3ed-94c09c2a358f None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:53.538572 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-cb75da74-c4a1-43c3-b3ed-94c09c2a358f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:53.581089 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e672bf-dd99-4144-b30a-f65932f4cf3f admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:53.583697 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-87e672bf-dd99-4144-b30a-f65932f4cf3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:53.648979 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:53.656769 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:53.781457 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 899/1782] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:45:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:45:53.904277 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb75da74-c4a1-43c3-b3ed-94c09c2a358f None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:53.906234 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-cb75da74-c4a1-43c3-b3ed-94c09c2a358f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:53.952590 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e672bf-dd99-4144-b30a-f65932f4cf3f admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:53.968071 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168231dd-74d4-4967-8d6a-01e683313119 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35441c061e514b1b9341e7694ec2c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:53.969205 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168231dd-74d4-4967-8d6a-01e683313119 service nova] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:53.969205 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168231dd-74d4-4967-8d6a-01e683313119 service nova] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:53.969444 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168231dd-74d4-4967-8d6a-01e683313119 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:53.971404 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-168231dd-74d4-4967-8d6a-01e683313119 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:53.986555 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168231dd-74d4-4967-8d6a-01e683313119 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:53.988436 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168231dd-74d4-4967-8d6a-01e683313119 service nova] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:54.009931 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 884/1783] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:45:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:45:54.047861 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb75da74-c4a1-43c3-b3ed-94c09c2a358f None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:54.055071 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3d4109-b920-4994-906f-32bf762ef6b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:54.056142 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d4109-b920-4994-906f-32bf762ef6b4 service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:54.056967 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d4109-b920-4994-906f-32bf762ef6b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:54.057607 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d4109-b920-4994-906f-32bf762ef6b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:54.073147 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3d4109-b920-4994-906f-32bf762ef6b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:54.076217 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3d4109-b920-4994-906f-32bf762ef6b4 service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:54.092968 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 900/1784] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:45:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:45:54.219615 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168231dd-74d4-4967-8d6a-01e683313119 service nova] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:54.226334 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-168231dd-74d4-4967-8d6a-01e683313119 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:54.294265 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3d4109-b920-4994-906f-32bf762ef6b4 service neutron] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:54.296247 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-2c3d4109-b920-4994-906f-32bf762ef6b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:54.330902 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168231dd-74d4-4967-8d6a-01e683313119 service nova] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:54.377528 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4681d93d-b699-4b2a-88fc-1330ed9f4c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:54.382559 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681d93d-b699-4b2a-88fc-1330ed9f4c38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:54.383209 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681d93d-b699-4b2a-88fc-1330ed9f4c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:54.385721 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681d93d-b699-4b2a-88fc-1330ed9f4c38 admin admin] PATH_INFO: `/v3/projects/07044114ec83471e9edd43b7f3206789` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:54.387693 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3d4109-b920-4994-906f-32bf762ef6b4 service neutron] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:54.390668 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4681d93d-b699-4b2a-88fc-1330ed9f4c38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07044114ec83471e9edd43b7f3206789)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:54.398243 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4681d93d-b699-4b2a-88fc-1330ed9f4c38 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:54.406080 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fa69c6-ed00-4224-b0e1-37961039b353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:54.406660 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa69c6-ed00-4224-b0e1-37961039b353 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:54.406940 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa69c6-ed00-4224-b0e1-37961039b353 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:54.407213 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa69c6-ed00-4224-b0e1-37961039b353 admin admin] PATH_INFO: `/v3/projects/efe842bc43164957826da6493b10caba` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:54.427114 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fa69c6-ed00-4224-b0e1-37961039b353 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efe842bc43164957826da6493b10caba)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:54.448379 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fa69c6-ed00-4224-b0e1-37961039b353 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:54.580445 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-4681d93d-b699-4b2a-88fc-1330ed9f4c38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07044114ec83471e9edd43b7f3206789', 'request_id': 'req-4681d93d-b699-4b2a-88fc-1330ed9f4c38'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:54.598643 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-4681d93d-b699-4b2a-88fc-1330ed9f4c38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07044114ec83471e9edd43b7f3206789', 'request_id': 'req-4681d93d-b699-4b2a-88fc-1330ed9f4c38'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:54.624080 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-4681d93d-b699-4b2a-88fc-1330ed9f4c38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07044114ec83471e9edd43b7f3206789', 'request_id': 'req-4681d93d-b699-4b2a-88fc-1330ed9f4c38'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:54.651362 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-4681d93d-b699-4b2a-88fc-1330ed9f4c38 admin admin] The token cache is being invalidate because project 07044114ec83471e9edd43b7f3206789 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:45:54.652583 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-4681d93d-b699-4b2a-88fc-1330ed9f4c38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:54.654047 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-4681d93d-b699-4b2a-88fc-1330ed9f4c38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:54.672511 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 885/1785] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:45:54 2022] DELETE /identity/v3/projects/07044114ec83471e9edd43b7f3206789 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:45:54.672511 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4681d93d-b699-4b2a-88fc-1330ed9f4c38 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:54.675008 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-4681d93d-b699-4b2a-88fc-1330ed9f4c38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:54.709246 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-53fa69c6-ed00-4224-b0e1-37961039b353 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efe842bc43164957826da6493b10caba', 'request_id': 'req-53fa69c6-ed00-4224-b0e1-37961039b353'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:54.737528 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-53fa69c6-ed00-4224-b0e1-37961039b353 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efe842bc43164957826da6493b10caba', 'request_id': 'req-53fa69c6-ed00-4224-b0e1-37961039b353'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:54.772071 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-53fa69c6-ed00-4224-b0e1-37961039b353 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efe842bc43164957826da6493b10caba', 'request_id': 'req-53fa69c6-ed00-4224-b0e1-37961039b353'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:54.840690 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-53fa69c6-ed00-4224-b0e1-37961039b353 admin admin] The token cache is being invalidate because project efe842bc43164957826da6493b10caba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:45:54.841080 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-53fa69c6-ed00-4224-b0e1-37961039b353 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:54.843332 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-53fa69c6-ed00-4224-b0e1-37961039b353 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:54.860422 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 901/1786] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:45:54 2022] DELETE /identity/v3/projects/efe842bc43164957826da6493b10caba => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:45:54.862107 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fa69c6-ed00-4224-b0e1-37961039b353 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:54.875380 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-53fa69c6-ed00-4224-b0e1-37961039b353 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:54.972257 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4681d93d-b699-4b2a-88fc-1330ed9f4c38 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:55.064615 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fa69c6-ed00-4224-b0e1-37961039b353 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:55.083986 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30313fb1-528e-4f70-ac8d-b66cc6d059e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:55.084729 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:55.087873 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30313fb1-528e-4f70-ac8d-b66cc6d059e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:55.091387 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30313fb1-528e-4f70-ac8d-b66cc6d059e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:55.092429 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30313fb1-528e-4f70-ac8d-b66cc6d059e1 admin admin] PATH_INFO: `/v3/users/3bf914e92b594610bf8bd9089bfe1e95` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:55.100390 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30313fb1-528e-4f70-ac8d-b66cc6d059e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bf914e92b594610bf8bd9089bfe1e95)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:55.102618 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30313fb1-528e-4f70-ac8d-b66cc6d059e1 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:55.130782 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:55.169042 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e48ea4-d92a-471e-a319-7276e34afeae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:55.169824 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e48ea4-d92a-471e-a319-7276e34afeae admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:55.170113 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e48ea4-d92a-471e-a319-7276e34afeae admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:55.170381 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e48ea4-d92a-471e-a319-7276e34afeae admin admin] PATH_INFO: `/v3/users/07fc7c8d0ff742a9b0748e93b0b47957` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:55.173886 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e48ea4-d92a-471e-a319-7276e34afeae admin admin] RBAC: Authorizing `identity:delete_user(user_id=07fc7c8d0ff742a9b0748e93b0b47957)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:55.175930 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e48ea4-d92a-471e-a319-7276e34afeae admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:55.232981 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-30313fb1-528e-4f70-ac8d-b66cc6d059e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bf914e92b594610bf8bd9089bfe1e95'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:55.243483 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-30313fb1-528e-4f70-ac8d-b66cc6d059e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bf914e92b594610bf8bd9089bfe1e95'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:55.256674 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-30313fb1-528e-4f70-ac8d-b66cc6d059e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bf914e92b594610bf8bd9089bfe1e95'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:55.285043 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-30313fb1-528e-4f70-ac8d-b66cc6d059e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bf914e92b594610bf8bd9089bfe1e95'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:55.286508 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-30313fb1-528e-4f70-ac8d-b66cc6d059e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bf914e92b594610bf8bd9089bfe1e95'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:55.342876 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 902/1787] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:45:54 2022] DELETE /identity/v3/users/3bf914e92b594610bf8bd9089bfe1e95 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:45:55.366751 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-65e48ea4-d92a-471e-a319-7276e34afeae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07fc7c8d0ff742a9b0748e93b0b47957'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:55.390389 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-65e48ea4-d92a-471e-a319-7276e34afeae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07fc7c8d0ff742a9b0748e93b0b47957'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:55.392308 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-65e48ea4-d92a-471e-a319-7276e34afeae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07fc7c8d0ff742a9b0748e93b0b47957'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:55.439005 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-65e48ea4-d92a-471e-a319-7276e34afeae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07fc7c8d0ff742a9b0748e93b0b47957'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:55.464511 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-65e48ea4-d92a-471e-a319-7276e34afeae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07fc7c8d0ff742a9b0748e93b0b47957'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:55.472050 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 886/1788] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:45:54 2022] DELETE /identity/v3/users/07fc7c8d0ff742a9b0748e93b0b47957 => generated 0 bytes in 805 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:45:56.117925 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30313fb1-528e-4f70-ac8d-b66cc6d059e1 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:56.123526 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-30313fb1-528e-4f70-ac8d-b66cc6d059e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:56.327968 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73f3ad-6e8a-4a96-89aa-1d7960d13bff None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:56.328398 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73f3ad-6e8a-4a96-89aa-1d7960d13bff None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:56.328677 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73f3ad-6e8a-4a96-89aa-1d7960d13bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:56.356536 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30313fb1-528e-4f70-ac8d-b66cc6d059e1 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:56.410953 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-be73f3ad-6e8a-4a96-89aa-1d7960d13bff None None] MFA Rules not processed for user `e2710a23114c4962a06886572be82b12`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:56.422801 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-be73f3ad-6e8a-4a96-89aa-1d7960d13bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:56.560094 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec9dec-35e1-44e4-92e2-7ff8214fb8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:56.561226 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec9dec-35e1-44e4-92e2-7ff8214fb8e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:56.561691 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec9dec-35e1-44e4-92e2-7ff8214fb8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:56.562090 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec9dec-35e1-44e4-92e2-7ff8214fb8e4 admin admin] PATH_INFO: `/v3/projects/9f6a492ce4194dcdaa9636671278c24b` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:56.564348 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ec9dec-35e1-44e4-92e2-7ff8214fb8e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f6a492ce4194dcdaa9636671278c24b)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:56.567189 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ec9dec-35e1-44e4-92e2-7ff8214fb8e4 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:56.646439 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 887/1789] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:45:56 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:45:56.670311 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:56.695128 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-b2ec9dec-35e1-44e4-92e2-7ff8214fb8e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f6a492ce4194dcdaa9636671278c24b', 'request_id': 'req-b2ec9dec-35e1-44e4-92e2-7ff8214fb8e4'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:56.704780 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-b2ec9dec-35e1-44e4-92e2-7ff8214fb8e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f6a492ce4194dcdaa9636671278c24b', 'request_id': 'req-b2ec9dec-35e1-44e4-92e2-7ff8214fb8e4'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:56.725879 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-b2ec9dec-35e1-44e4-92e2-7ff8214fb8e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f6a492ce4194dcdaa9636671278c24b', 'request_id': 'req-b2ec9dec-35e1-44e4-92e2-7ff8214fb8e4'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:56.743058 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-b2ec9dec-35e1-44e4-92e2-7ff8214fb8e4 admin admin] The token cache is being invalidate because project 9f6a492ce4194dcdaa9636671278c24b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:45:56.743469 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-b2ec9dec-35e1-44e4-92e2-7ff8214fb8e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:56.745430 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-b2ec9dec-35e1-44e4-92e2-7ff8214fb8e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:56.747020 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 903/1790] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:45:56 2022] DELETE /identity/v3/projects/9f6a492ce4194dcdaa9636671278c24b => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:45:56.751266 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be73f3ad-6e8a-4a96-89aa-1d7960d13bff None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:56.752848 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-be73f3ad-6e8a-4a96-89aa-1d7960d13bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:56.803975 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be73f3ad-6e8a-4a96-89aa-1d7960d13bff None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:57.055336 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:57.089739 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf663f-e7e7-44a3-8eed-c84378773cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:57.095884 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf663f-e7e7-44a3-8eed-c84378773cf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:57.096286 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf663f-e7e7-44a3-8eed-c84378773cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:57.099341 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf663f-e7e7-44a3-8eed-c84378773cf5 admin admin] PATH_INFO: `/v3/users/750afd26534c4e639a750db03474e58b` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:57.104600 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cf663f-e7e7-44a3-8eed-c84378773cf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=750afd26534c4e639a750db03474e58b)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:57.108543 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cf663f-e7e7-44a3-8eed-c84378773cf5 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:57.260883 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-83cf663f-e7e7-44a3-8eed-c84378773cf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '750afd26534c4e639a750db03474e58b'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:57.291938 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-83cf663f-e7e7-44a3-8eed-c84378773cf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '750afd26534c4e639a750db03474e58b'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:57.293341 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-83cf663f-e7e7-44a3-8eed-c84378773cf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '750afd26534c4e639a750db03474e58b'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:57.340251 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-83cf663f-e7e7-44a3-8eed-c84378773cf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '750afd26534c4e639a750db03474e58b'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:57.370871 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-83cf663f-e7e7-44a3-8eed-c84378773cf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '750afd26534c4e639a750db03474e58b'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:57.392407 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 888/1791] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:45:56 2022] DELETE /identity/v3/users/750afd26534c4e639a750db03474e58b => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:45:57.550934 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec9dec-35e1-44e4-92e2-7ff8214fb8e4 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:57.552540 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-b2ec9dec-35e1-44e4-92e2-7ff8214fb8e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:57.581880 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec9dec-35e1-44e4-92e2-7ff8214fb8e4 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:57.619775 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf663f-e7e7-44a3-8eed-c84378773cf5 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:57.624381 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-83cf663f-e7e7-44a3-8eed-c84378773cf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:57.821758 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2245dd0-578c-4581-a14a-772779cd8166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:57.825257 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2245dd0-578c-4581-a14a-772779cd8166 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:57.825629 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2245dd0-578c-4581-a14a-772779cd8166 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:57.825956 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2245dd0-578c-4581-a14a-772779cd8166 admin admin] PATH_INFO: `/v3/projects/01fe88e0bd634886a1fb49f914cd80a2` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:57.830624 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2245dd0-578c-4581-a14a-772779cd8166 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01fe88e0bd634886a1fb49f914cd80a2)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:57.838548 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2245dd0-578c-4581-a14a-772779cd8166 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:57.855297 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf663f-e7e7-44a3-8eed-c84378773cf5 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:57.873561 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e314e-0327-4977-adf0-a6d251a66ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:57.876590 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e314e-0327-4977-adf0-a6d251a66ae0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:57.876884 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e314e-0327-4977-adf0-a6d251a66ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:57.877169 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e314e-0327-4977-adf0-a6d251a66ae0 admin admin] PATH_INFO: `/v3/projects/986abc6cfcb54ac99a13cc15b33c50f7` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:57.882598 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6e314e-0327-4977-adf0-a6d251a66ae0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=986abc6cfcb54ac99a13cc15b33c50f7)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:57.890128 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6e314e-0327-4977-adf0-a6d251a66ae0 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:58.012429 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-e2245dd0-578c-4581-a14a-772779cd8166 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01fe88e0bd634886a1fb49f914cd80a2', 'request_id': 'req-e2245dd0-578c-4581-a14a-772779cd8166'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:58.025189 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-da6e314e-0327-4977-adf0-a6d251a66ae0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '986abc6cfcb54ac99a13cc15b33c50f7', 'request_id': 'req-da6e314e-0327-4977-adf0-a6d251a66ae0'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:58.029323 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-e2245dd0-578c-4581-a14a-772779cd8166 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01fe88e0bd634886a1fb49f914cd80a2', 'request_id': 'req-e2245dd0-578c-4581-a14a-772779cd8166'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:58.040453 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-da6e314e-0327-4977-adf0-a6d251a66ae0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '986abc6cfcb54ac99a13cc15b33c50f7', 'request_id': 'req-da6e314e-0327-4977-adf0-a6d251a66ae0'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:58.045165 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-e2245dd0-578c-4581-a14a-772779cd8166 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01fe88e0bd634886a1fb49f914cd80a2', 'request_id': 'req-e2245dd0-578c-4581-a14a-772779cd8166'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:58.054360 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-da6e314e-0327-4977-adf0-a6d251a66ae0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '986abc6cfcb54ac99a13cc15b33c50f7', 'request_id': 'req-da6e314e-0327-4977-adf0-a6d251a66ae0'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:58.077747 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-e2245dd0-578c-4581-a14a-772779cd8166 admin admin] The token cache is being invalidate because project 01fe88e0bd634886a1fb49f914cd80a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:45:58.078177 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-e2245dd0-578c-4581-a14a-772779cd8166 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:58.084704 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-e2245dd0-578c-4581-a14a-772779cd8166 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:58.086681 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 904/1792] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:45:57 2022] DELETE /identity/v3/projects/01fe88e0bd634886a1fb49f914cd80a2 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:45:58.099028 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f646a-38c2-48ae-8d58-12debb9fc779 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:58.099354 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f646a-38c2-48ae-8d58-12debb9fc779 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:58.101197 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-da6e314e-0327-4977-adf0-a6d251a66ae0 admin admin] The token cache is being invalidate because project 986abc6cfcb54ac99a13cc15b33c50f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:45:58.101633 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-da6e314e-0327-4977-adf0-a6d251a66ae0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:58.102209 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f646a-38c2-48ae-8d58-12debb9fc779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:58.103096 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-da6e314e-0327-4977-adf0-a6d251a66ae0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:58.107278 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 889/1793] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:45:57 2022] DELETE /identity/v3/projects/986abc6cfcb54ac99a13cc15b33c50f7 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:45:58.111482 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e314e-0327-4977-adf0-a6d251a66ae0 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:58.145885 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-da6e314e-0327-4977-adf0-a6d251a66ae0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:58.175711 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-035f646a-38c2-48ae-8d58-12debb9fc779 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:58.176785 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:58.177139 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-035f646a-38c2-48ae-8d58-12debb9fc779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:58.346581 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e314e-0327-4977-adf0-a6d251a66ae0 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:58.360320 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c032830-8316-437f-93dc-75889167208b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:58.361180 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c032830-8316-437f-93dc-75889167208b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:58.361585 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c032830-8316-437f-93dc-75889167208b admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:58.362486 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c032830-8316-437f-93dc-75889167208b admin admin] PATH_INFO: `/v3/users/dc8a346d546f4d8fbb5ed8c39847af4e` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:58.364872 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c032830-8316-437f-93dc-75889167208b admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc8a346d546f4d8fbb5ed8c39847af4e)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:58.369092 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c032830-8316-437f-93dc-75889167208b admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:58.372435 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:58.457149 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 905/1794] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:45:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:45:58.468166 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd356e-5efd-42fa-bf89-5cb3f1bf4c96 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:58.468454 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd356e-5efd-42fa-bf89-5cb3f1bf4c96 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:58.468785 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd356e-5efd-42fa-bf89-5cb3f1bf4c96 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:58.470205 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 906/1795] 10.222.0.47 () {54 vars in 921 bytes} [Mon Aug 29 22:45:58 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:45:58.471311 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0869d8df-eb3e-493e-bb9f-505c4d0e61d2 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:58.471593 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0869d8df-eb3e-493e-bb9f-505c4d0e61d2 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:58.471862 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0869d8df-eb3e-493e-bb9f-505c4d0e61d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:58.560957 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-0869d8df-eb3e-493e-bb9f-505c4d0e61d2 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:58.567794 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-0869d8df-eb3e-493e-bb9f-505c4d0e61d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:58.586487 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-7c032830-8316-437f-93dc-75889167208b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc8a346d546f4d8fbb5ed8c39847af4e'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:58.605581 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 907/1796] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:45:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:45:58.611829 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a7821a-a589-4d53-87d1-28371d9b9496 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:58.613832 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a7821a-a589-4d53-87d1-28371d9b9496 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:58.614985 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a7821a-a589-4d53-87d1-28371d9b9496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:58.620765 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-7c032830-8316-437f-93dc-75889167208b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc8a346d546f4d8fbb5ed8c39847af4e'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:58.621617 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-7c032830-8316-437f-93dc-75889167208b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc8a346d546f4d8fbb5ed8c39847af4e'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:58.668913 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-7c032830-8316-437f-93dc-75889167208b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc8a346d546f4d8fbb5ed8c39847af4e'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:58.691865 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-7c032830-8316-437f-93dc-75889167208b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc8a346d546f4d8fbb5ed8c39847af4e'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:58.719099 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 890/1797] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:45:58 2022] DELETE /identity/v3/users/dc8a346d546f4d8fbb5ed8c39847af4e => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:45:58.719099 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c032830-8316-437f-93dc-75889167208b admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:58.735177 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-7c032830-8316-437f-93dc-75889167208b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:58.746567 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-f7a7821a-a589-4d53-87d1-28371d9b9496 None None] MFA Rules not processed for user `35441c061e514b1b9341e7694ec2c0bc`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:58.754200 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-f7a7821a-a589-4d53-87d1-28371d9b9496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:58.983659 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c032830-8316-437f-93dc-75889167208b admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:58.997253 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc8a0c-82aa-400f-9082-058b844304ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:58.997918 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc8a0c-82aa-400f-9082-058b844304ac admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:58.999258 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc8a0c-82aa-400f-9082-058b844304ac admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:58.999555 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc8a0c-82aa-400f-9082-058b844304ac admin admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:59.003548 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdc8a0c-82aa-400f-9082-058b844304ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:45:59.007215 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdc8a0c-82aa-400f-9082-058b844304ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:59.009590 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdc8a0c-82aa-400f-9082-058b844304ac admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:59.047683 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 891/1798] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Aug 29 22:45:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:45:59.051049 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc8a0c-82aa-400f-9082-058b844304ac admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:59.060886 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-cfdc8a0c-82aa-400f-9082-058b844304ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:59.074153 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 908/1799] 10.222.0.47 () {58 vars in 1018 bytes} [Mon Aug 29 22:45:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 467 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:45:59.077639 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a7821a-a589-4d53-87d1-28371d9b9496 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:59.115084 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc8a0c-82aa-400f-9082-058b844304ac admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:59.122727 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a7821a-a589-4d53-87d1-28371d9b9496 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:59.135357 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8554f85e-3ada-423f-922f-54eb24ee77de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:59.137287 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554f85e-3ada-423f-922f-54eb24ee77de admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:59.138528 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554f85e-3ada-423f-922f-54eb24ee77de admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:59.141164 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ecf08-96a5-41c4-892f-1d11265e0b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:59.141454 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554f85e-3ada-423f-922f-54eb24ee77de admin admin] PATH_INFO: `/v3/projects/dec96729574440ceb26794f108040d6f` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:59.143030 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ecf08-96a5-41c4-892f-1d11265e0b6f admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:59.144032 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8554f85e-3ada-423f-922f-54eb24ee77de admin admin] RBAC: Authorizing `identity:delete_project(project_id=dec96729574440ceb26794f108040d6f)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:59.144530 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ecf08-96a5-41c4-892f-1d11265e0b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:59.145096 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ecf08-96a5-41c4-892f-1d11265e0b6f admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:59.148322 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8554f85e-3ada-423f-922f-54eb24ee77de admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:59.149777 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02ecf08-96a5-41c4-892f-1d11265e0b6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:59.154050 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02ecf08-96a5-41c4-892f-1d11265e0b6f admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:59.178747 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:59.225411 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 909/1800] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:45:59 2022] POST /identity/v3/projects => generated 401 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:45:59.229991 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ecf08-96a5-41c4-892f-1d11265e0b6f admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:59.269105 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-8554f85e-3ada-423f-922f-54eb24ee77de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dec96729574440ceb26794f108040d6f', 'request_id': 'req-8554f85e-3ada-423f-922f-54eb24ee77de'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:59.286170 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-8554f85e-3ada-423f-922f-54eb24ee77de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dec96729574440ceb26794f108040d6f', 'request_id': 'req-8554f85e-3ada-423f-922f-54eb24ee77de'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:59.316986 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-8554f85e-3ada-423f-922f-54eb24ee77de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dec96729574440ceb26794f108040d6f', 'request_id': 'req-8554f85e-3ada-423f-922f-54eb24ee77de'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:59.363171 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-8554f85e-3ada-423f-922f-54eb24ee77de admin admin] The token cache is being invalidate because project dec96729574440ceb26794f108040d6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:45:59.363885 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-8554f85e-3ada-423f-922f-54eb24ee77de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:59.365481 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-8554f85e-3ada-423f-922f-54eb24ee77de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:59.372631 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ecf08-96a5-41c4-892f-1d11265e0b6f admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:59.373373 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 892/1801] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:45:59 2022] DELETE /identity/v3/projects/dec96729574440ceb26794f108040d6f => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:45:59.380208 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7074f3-8a5d-40b9-81df-688c1d527b14 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:59.380929 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7074f3-8a5d-40b9-81df-688c1d527b14 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:59.381518 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7074f3-8a5d-40b9-81df-688c1d527b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:59.430888 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-ff7074f3-8a5d-40b9-81df-688c1d527b14 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:59.432344 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-ff7074f3-8a5d-40b9-81df-688c1d527b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:59.586044 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf468c6-4bcf-4a69-a209-0028462f87c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:59.587606 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf468c6-4bcf-4a69-a209-0028462f87c6 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:59.588033 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf468c6-4bcf-4a69-a209-0028462f87c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:59.588598 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf468c6-4bcf-4a69-a209-0028462f87c6 admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:59.589501 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf468c6-4bcf-4a69-a209-0028462f87c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:59.594526 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf468c6-4bcf-4a69-a209-0028462f87c6 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:59.628768 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 893/1802] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:45:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:45:59.637269 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71655cf-a5d7-438b-b023-77f0dea28a15 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:59.638006 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71655cf-a5d7-438b-b023-77f0dea28a15 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:59.638506 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71655cf-a5d7-438b-b023-77f0dea28a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:59.648235 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:59.670764 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-e71655cf-a5d7-438b-b023-77f0dea28a15 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:45:59.672665 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-e71655cf-a5d7-438b-b023-77f0dea28a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:59.693287 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 910/1803] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:45:59 2022] POST /identity/v3/users => generated 301 bytes in 462 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:45:59.697283 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf468c6-4bcf-4a69-a209-0028462f87c6 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:59.702443 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-3cf468c6-4bcf-4a69-a209-0028462f87c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:59.708701 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 894/1804] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:45:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:45:59.710259 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71655cf-a5d7-438b-b023-77f0dea28a15 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:59.725556 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71655cf-a5d7-438b-b023-77f0dea28a15 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:59.740063 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf468c6-4bcf-4a69-a209-0028462f87c6 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:59.753081 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc2b2c-db55-4035-8a2e-f5bdbc19f4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:59.757481 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc2b2c-db55-4035-8a2e-f5bdbc19f4d1 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:59.757481 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc2b2c-db55-4035-8a2e-f5bdbc19f4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:59.757481 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc2b2c-db55-4035-8a2e-f5bdbc19f4d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:59.758603 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabc2b2c-db55-4035-8a2e-f5bdbc19f4d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:45:59.759077 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabc2b2c-db55-4035-8a2e-f5bdbc19f4d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:59.763630 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcc28b3-aed2-4b5f-936d-3d4412dc9488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:59.764316 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc28b3-aed2-4b5f-936d-3d4412dc9488 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:59.764599 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc28b3-aed2-4b5f-936d-3d4412dc9488 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:59.764888 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc28b3-aed2-4b5f-936d-3d4412dc9488 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:59.765602 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcc28b3-aed2-4b5f-936d-3d4412dc9488 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:59.767372 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabc2b2c-db55-4035-8a2e-f5bdbc19f4d1 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:59.772016 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcc28b3-aed2-4b5f-936d-3d4412dc9488 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:59.811388 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 895/1805] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Aug 29 22:45:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:45:59.814955 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc2b2c-db55-4035-8a2e-f5bdbc19f4d1 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:59.818869 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 911/1806] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:45:59.820764 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcc28b3-aed2-4b5f-936d-3d4412dc9488 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:45:59.823232 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-fabc2b2c-db55-4035-8a2e-f5bdbc19f4d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:45:59.879673 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcc28b3-aed2-4b5f-936d-3d4412dc9488 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:59.889000 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc2b2c-db55-4035-8a2e-f5bdbc19f4d1 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:45:59.899909 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0627ab-9786-46cd-89b4-9a90f6ae80df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:59.900545 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0627ab-9786-46cd-89b4-9a90f6ae80df admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:59.900820 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0627ab-9786-46cd-89b4-9a90f6ae80df admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:59.901095 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0627ab-9786-46cd-89b4-9a90f6ae80df admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:59.901771 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0627ab-9786-46cd-89b4-9a90f6ae80df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:59.907852 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0627ab-9786-46cd-89b4-9a90f6ae80df admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:59.912338 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e72894-7501-484f-bdfe-49358160a5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:45:59.912996 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e72894-7501-484f-bdfe-49358160a5dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:45:59.913284 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e72894-7501-484f-bdfe-49358160a5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:45:59.914209 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e72894-7501-484f-bdfe-49358160a5dd admin admin] PATH_INFO: `/v3/projects/5cc22c6bb1a8437b853426f643e8f71a` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:45:59.915099 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e72894-7501-484f-bdfe-49358160a5dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cc22c6bb1a8437b853426f643e8f71a)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:45:59.917022 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e72894-7501-484f-bdfe-49358160a5dd admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:45:59.996769 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-65e72894-7501-484f-bdfe-49358160a5dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cc22c6bb1a8437b853426f643e8f71a', 'request_id': 'req-65e72894-7501-484f-bdfe-49358160a5dd'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:45:59.998119 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 912/1807] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:45:59 2022] POST /identity/v3/projects => generated 405 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:45:59.999038 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0627ab-9786-46cd-89b4-9a90f6ae80df admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:00.016842 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-65e72894-7501-484f-bdfe-49358160a5dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cc22c6bb1a8437b853426f643e8f71a', 'request_id': 'req-65e72894-7501-484f-bdfe-49358160a5dd'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:00.024208 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-65e72894-7501-484f-bdfe-49358160a5dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cc22c6bb1a8437b853426f643e8f71a', 'request_id': 'req-65e72894-7501-484f-bdfe-49358160a5dd'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:00.057245 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-65e72894-7501-484f-bdfe-49358160a5dd admin admin] The token cache is being invalidate because project 5cc22c6bb1a8437b853426f643e8f71a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:46:00.057869 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-65e72894-7501-484f-bdfe-49358160a5dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:00.058782 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-65e72894-7501-484f-bdfe-49358160a5dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:00.065134 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 896/1808] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:45:59 2022] DELETE /identity/v3/projects/5cc22c6bb1a8437b853426f643e8f71a => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:00.066349 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e72894-7501-484f-bdfe-49358160a5dd admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:00.069121 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-65e72894-7501-484f-bdfe-49358160a5dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:00.079932 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:00.168137 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e72894-7501-484f-bdfe-49358160a5dd admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:00.173179 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a678fe-3124-4eee-9aa0-51de38edfa96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:00.173864 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a678fe-3124-4eee-9aa0-51de38edfa96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:00.174145 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a678fe-3124-4eee-9aa0-51de38edfa96 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:00.174421 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a678fe-3124-4eee-9aa0-51de38edfa96 admin admin] PATH_INFO: `/v3/projects/4b99b7bd802043749b865e56b3eb2cab` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:00.175623 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a678fe-3124-4eee-9aa0-51de38edfa96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b99b7bd802043749b865e56b3eb2cab)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:00.178101 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a678fe-3124-4eee-9aa0-51de38edfa96 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:00.183085 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0627ab-9786-46cd-89b4-9a90f6ae80df admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:00.199433 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d98c21c-1be4-4450-a7c6-3b497146453a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:00.199992 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98c21c-1be4-4450-a7c6-3b497146453a admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:00.200305 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98c21c-1be4-4450-a7c6-3b497146453a admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:00.200584 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98c21c-1be4-4450-a7c6-3b497146453a admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:00.202417 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d98c21c-1be4-4450-a7c6-3b497146453a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:00.203855 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d98c21c-1be4-4450-a7c6-3b497146453a admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:00.216180 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 913/1809] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:46:00.216508 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d98c21c-1be4-4450-a7c6-3b497146453a admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:00.219718 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-5d98c21c-1be4-4450-a7c6-3b497146453a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:00.241934 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d98c21c-1be4-4450-a7c6-3b497146453a admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:00.266817 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-95a678fe-3124-4eee-9aa0-51de38edfa96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b99b7bd802043749b865e56b3eb2cab', 'request_id': 'req-95a678fe-3124-4eee-9aa0-51de38edfa96'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:00.284572 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-95a678fe-3124-4eee-9aa0-51de38edfa96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b99b7bd802043749b865e56b3eb2cab', 'request_id': 'req-95a678fe-3124-4eee-9aa0-51de38edfa96'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:00.297046 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-95a678fe-3124-4eee-9aa0-51de38edfa96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b99b7bd802043749b865e56b3eb2cab', 'request_id': 'req-95a678fe-3124-4eee-9aa0-51de38edfa96'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:00.326754 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-95a678fe-3124-4eee-9aa0-51de38edfa96 admin admin] The token cache is being invalidate because project 4b99b7bd802043749b865e56b3eb2cab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:46:00.327057 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-95a678fe-3124-4eee-9aa0-51de38edfa96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:00.329817 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-95a678fe-3124-4eee-9aa0-51de38edfa96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:00.337472 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 897/1810] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:46:00 2022] DELETE /identity/v3/projects/4b99b7bd802043749b865e56b3eb2cab => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:00.339090 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ca8f3-7b08-4f34-b578-2986eac639eb None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:00.339309 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ca8f3-7b08-4f34-b578-2986eac639eb None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:00.339588 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ca8f3-7b08-4f34-b578-2986eac639eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:00.373065 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b371c1-f179-49b1-bf63-f90c158588ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:00.373810 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b371c1-f179-49b1-bf63-f90c158588ec admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:00.374248 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b371c1-f179-49b1-bf63-f90c158588ec admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:00.374527 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b371c1-f179-49b1-bf63-f90c158588ec admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:00.375254 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b371c1-f179-49b1-bf63-f90c158588ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:00.378647 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b371c1-f179-49b1-bf63-f90c158588ec admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:00.392386 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-359ca8f3-7b08-4f34-b578-2986eac639eb None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:00.393818 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-359ca8f3-7b08-4f34-b578-2986eac639eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:00.415885 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 914/1811] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:46:00 2022] POST /identity/v3/users => generated 303 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:46:00.415885 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b371c1-f179-49b1-bf63-f90c158588ec admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:00.417625 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 898/1812] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:46:00.419151 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-02b371c1-f179-49b1-bf63-f90c158588ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:00.421965 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70668ca3-a122-4071-9a81-8a81e952d020 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:00.422253 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70668ca3-a122-4071-9a81-8a81e952d020 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:00.424758 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70668ca3-a122-4071-9a81-8a81e952d020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:00.446277 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b371c1-f179-49b1-bf63-f90c158588ec admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:00.451453 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de35cacb-ba7b-4062-b899-952d14d79eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:00.452294 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35cacb-ba7b-4062-b899-952d14d79eb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:00.452422 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35cacb-ba7b-4062-b899-952d14d79eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:00.452599 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35cacb-ba7b-4062-b899-952d14d79eb3 admin admin] PATH_INFO: `/v3/projects/b3f47c993d5140b6a7018ce33d4ba1cf/users/ccf8ad42150d47e6b8667e4c02f38bc2/roles/0c67797d444d4c929b2ccab47c468848` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:00.466972 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-70668ca3-a122-4071-9a81-8a81e952d020 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:00.468543 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-70668ca3-a122-4071-9a81-8a81e952d020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:00.481414 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 899/1813] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:46:00.482508 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70668ca3-a122-4071-9a81-8a81e952d020 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:00.483130 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de35cacb-ba7b-4062-b899-952d14d79eb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3f47c993d5140b6a7018ce33d4ba1cf, user_id=ccf8ad42150d47e6b8667e4c02f38bc2, role_id=0c67797d444d4c929b2ccab47c468848)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:00.487831 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de35cacb-ba7b-4062-b899-952d14d79eb3 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:00.488658 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-70668ca3-a122-4071-9a81-8a81e952d020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:00.524924 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 915/1814] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:46:00 2022] PUT /identity/v3/projects/b3f47c993d5140b6a7018ce33d4ba1cf/users/ccf8ad42150d47e6b8667e4c02f38bc2/roles/0c67797d444d4c929b2ccab47c468848 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:00.526142 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de35cacb-ba7b-4062-b899-952d14d79eb3 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:00.528866 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-de35cacb-ba7b-4062-b899-952d14d79eb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:00.643227 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:00.695160 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70668ca3-a122-4071-9a81-8a81e952d020 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:00.740069 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:00.777289 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de35cacb-ba7b-4062-b899-952d14d79eb3 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:00.792439 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e5f09e-544a-4408-b888-89e5bde2504d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:00.797446 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5f09e-544a-4408-b888-89e5bde2504d admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:00.798188 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5f09e-544a-4408-b888-89e5bde2504d admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:00.798615 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5f09e-544a-4408-b888-89e5bde2504d admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:00.799489 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e5f09e-544a-4408-b888-89e5bde2504d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:00.815672 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e5f09e-544a-4408-b888-89e5bde2504d admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:00.831385 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c0a5d-7ebf-4735-b6ce-a4aee7a7c7dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35441c061e514b1b9341e7694ec2c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:00.833085 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c0a5d-7ebf-4735-b6ce-a4aee7a7c7dc service nova] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:00.835884 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c0a5d-7ebf-4735-b6ce-a4aee7a7c7dc service nova] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:00.836754 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c0a5d-7ebf-4735-b6ce-a4aee7a7c7dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:00.842011 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-3c6c0a5d-7ebf-4735-b6ce-a4aee7a7c7dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:00.867308 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 916/1815] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:46:00 2022] GET /identity/v3/roles => generated 1420 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:46:00.874270 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b13a07-efd9-459d-9c47-4eb5fabb7fe6 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:00.874577 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b13a07-efd9-459d-9c47-4eb5fabb7fe6 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:00.874820 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b13a07-efd9-459d-9c47-4eb5fabb7fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:00.887602 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6c0a5d-7ebf-4735-b6ce-a4aee7a7c7dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:00.890363 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6c0a5d-7ebf-4735-b6ce-a4aee7a7c7dc service nova] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:00.913882 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-e7b13a07-efd9-459d-9c47-4eb5fabb7fe6 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:00.915231 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-e7b13a07-efd9-459d-9c47-4eb5fabb7fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:00.917309 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 900/1816] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:46:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:46:00.919057 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1362c1e-bbb5-4a6a-9a50-e16dd685a92f None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:00.919582 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1362c1e-bbb5-4a6a-9a50-e16dd685a92f None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:00.920109 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1362c1e-bbb5-4a6a-9a50-e16dd685a92f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:00.934267 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 917/1817] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:46:00.935484 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbefc037-49f5-4db8-9049-c6f6af8191af None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:00.935770 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbefc037-49f5-4db8-9049-c6f6af8191af None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:00.936040 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbefc037-49f5-4db8-9049-c6f6af8191af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:00.975231 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-c1362c1e-bbb5-4a6a-9a50-e16dd685a92f None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:00.984010 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-c1362c1e-bbb5-4a6a-9a50-e16dd685a92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:00.998723 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-cbefc037-49f5-4db8-9049-c6f6af8191af None None] MFA Rules not processed for user `ccf8ad42150d47e6b8667e4c02f38bc2`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:01.000403 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-cbefc037-49f5-4db8-9049-c6f6af8191af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:01.004317 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 901/1818] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:46:01.009285 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1362c1e-bbb5-4a6a-9a50-e16dd685a92f None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:01.031070 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1362c1e-bbb5-4a6a-9a50-e16dd685a92f None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:01.062597 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0071adad-0b2f-430f-b82d-dcb808b13f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:01.063946 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0071adad-0b2f-430f-b82d-dcb808b13f88 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:01.064329 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0071adad-0b2f-430f-b82d-dcb808b13f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:01.064705 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0071adad-0b2f-430f-b82d-dcb808b13f88 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:01.065521 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0071adad-0b2f-430f-b82d-dcb808b13f88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:01.067369 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0071adad-0b2f-430f-b82d-dcb808b13f88 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:01.091348 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 902/1819] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:46:01 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:46:01.092911 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0071adad-0b2f-430f-b82d-dcb808b13f88 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:01.125683 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0071adad-0b2f-430f-b82d-dcb808b13f88 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:01.138016 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b239934f-806f-4055-81ad-517d69aa607b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:01.138780 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239934f-806f-4055-81ad-517d69aa607b admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:01.139230 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239934f-806f-4055-81ad-517d69aa607b admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:01.139559 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239934f-806f-4055-81ad-517d69aa607b admin admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:01.140358 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b239934f-806f-4055-81ad-517d69aa607b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:46:01.140755 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b239934f-806f-4055-81ad-517d69aa607b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:01.142751 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b239934f-806f-4055-81ad-517d69aa607b admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:01.173791 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 903/1820] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Aug 29 22:46:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:46:01.174938 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b239934f-806f-4055-81ad-517d69aa607b admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:01.178841 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 918/1821] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:00 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:46:01.181310 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbefc037-49f5-4db8-9049-c6f6af8191af None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:01.214204 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbefc037-49f5-4db8-9049-c6f6af8191af None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:01.214716 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b239934f-806f-4055-81ad-517d69aa607b admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:01.225821 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19c2ec6-554b-486e-9aeb-0ecb7671497b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:01.227108 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c2ec6-554b-486e-9aeb-0ecb7671497b admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:01.227726 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c2ec6-554b-486e-9aeb-0ecb7671497b admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:01.228171 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c2ec6-554b-486e-9aeb-0ecb7671497b admin admin] PATH_INFO: `/v3/projects/d5af490cf6cd4b7ca8ee747cce5a011a/users/190e735d158b49e888f355b9f26e80e6/roles/0c67797d444d4c929b2ccab47c468848` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:01.252978 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb21ad0b-5f33-4c39-b8e8-1a13303448d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:01.253882 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb21ad0b-5f33-4c39-b8e8-1a13303448d6 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:01.257390 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb21ad0b-5f33-4c39-b8e8-1a13303448d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:01.257840 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb21ad0b-5f33-4c39-b8e8-1a13303448d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:01.258625 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb21ad0b-5f33-4c39-b8e8-1a13303448d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:46:01.260422 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb21ad0b-5f33-4c39-b8e8-1a13303448d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:01.267856 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb21ad0b-5f33-4c39-b8e8-1a13303448d6 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:01.294893 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19c2ec6-554b-486e-9aeb-0ecb7671497b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5af490cf6cd4b7ca8ee747cce5a011a, user_id=190e735d158b49e888f355b9f26e80e6, role_id=0c67797d444d4c929b2ccab47c468848)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:01.298465 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19c2ec6-554b-486e-9aeb-0ecb7671497b admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:01.314375 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 904/1822] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Aug 29 22:46:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:46:01.316644 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb21ad0b-5f33-4c39-b8e8-1a13303448d6 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:01.334139 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb21ad0b-5f33-4c39-b8e8-1a13303448d6 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:01.345091 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 919/1823] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:46:01 2022] PUT /identity/v3/projects/d5af490cf6cd4b7ca8ee747cce5a011a/users/190e735d158b49e888f355b9f26e80e6/roles/0c67797d444d4c929b2ccab47c468848 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:01.348667 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19c2ec6-554b-486e-9aeb-0ecb7671497b admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:01.466496 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b86ccc-512b-4e8a-a0cf-246b2d2a0dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:01.467134 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b86ccc-512b-4e8a-a0cf-246b2d2a0dd3 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:01.467420 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b86ccc-512b-4e8a-a0cf-246b2d2a0dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:01.467697 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b86ccc-512b-4e8a-a0cf-246b2d2a0dd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:01.468549 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b86ccc-512b-4e8a-a0cf-246b2d2a0dd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:01.470696 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b86ccc-512b-4e8a-a0cf-246b2d2a0dd3 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:01.516715 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 905/1824] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:46:01 2022] POST /identity/v3/projects => generated 379 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:46:01.532666 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b86ccc-512b-4e8a-a0cf-246b2d2a0dd3 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:01.534047 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19c2ec6-554b-486e-9aeb-0ecb7671497b admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:01.588820 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:01.646995 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:01.690010 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b86ccc-512b-4e8a-a0cf-246b2d2a0dd3 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:01.696659 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e339bb-cf85-4ede-9bee-a35a570b046d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:01.697520 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e339bb-cf85-4ede-9bee-a35a570b046d admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:01.697975 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e339bb-cf85-4ede-9bee-a35a570b046d admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:01.698261 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e339bb-cf85-4ede-9bee-a35a570b046d admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:01.699020 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e339bb-cf85-4ede-9bee-a35a570b046d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:01.701249 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e339bb-cf85-4ede-9bee-a35a570b046d admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:01.713940 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a62c6a-72d4-4f64-9512-0f940fc214a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:01.714634 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a62c6a-72d4-4f64-9512-0f940fc214a3 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:01.715017 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a62c6a-72d4-4f64-9512-0f940fc214a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:01.715390 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a62c6a-72d4-4f64-9512-0f940fc214a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:01.719358 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a62c6a-72d4-4f64-9512-0f940fc214a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:01.726697 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a62c6a-72d4-4f64-9512-0f940fc214a3 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:01.781828 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 906/1825] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:46:01 2022] POST /identity/v3/projects => generated 387 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:46:01.793138 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780aaff3-77b4-49f2-bcf3-e27f84d664d4 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:01.793442 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780aaff3-77b4-49f2-bcf3-e27f84d664d4 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:01.793772 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780aaff3-77b4-49f2-bcf3-e27f84d664d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:01.836627 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 920/1826] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:46:01 2022] POST /identity/v3/projects => generated 399 bytes in 478 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:46:01.836627 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a62c6a-72d4-4f64-9512-0f940fc214a3 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:01.886720 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-780aaff3-77b4-49f2-bcf3-e27f84d664d4 None None] MFA Rules not processed for user `190e735d158b49e888f355b9f26e80e6`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:01.892637 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-780aaff3-77b4-49f2-bcf3-e27f84d664d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:02.062515 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a62c6a-72d4-4f64-9512-0f940fc214a3 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:02.072485 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f55c42f-80f2-41df-9721-444208b52b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:02.074228 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f55c42f-80f2-41df-9721-444208b52b52 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:02.077834 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f55c42f-80f2-41df-9721-444208b52b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:02.078121 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f55c42f-80f2-41df-9721-444208b52b52 admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:02.078828 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f55c42f-80f2-41df-9721-444208b52b52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:02.084009 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f55c42f-80f2-41df-9721-444208b52b52 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:02.094415 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 907/1827] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:01 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:46:02.095148 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780aaff3-77b4-49f2-bcf3-e27f84d664d4 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:02.125641 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780aaff3-77b4-49f2-bcf3-e27f84d664d4 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:02.158374 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 921/1828] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:46:01 2022] POST /identity/v3/users => generated 290 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:46:02.158374 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f55c42f-80f2-41df-9721-444208b52b52 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:02.171587 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8ee3dd-9228-4ec6-9bc2-8ea4fb0e5ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:02.172895 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ee3dd-9228-4ec6-9bc2-8ea4fb0e5ae7 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:02.173119 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ee3dd-9228-4ec6-9bc2-8ea4fb0e5ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:02.173632 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ee3dd-9228-4ec6-9bc2-8ea4fb0e5ae7 admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:02.174760 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8ee3dd-9228-4ec6-9bc2-8ea4fb0e5ae7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:02.178507 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8ee3dd-9228-4ec6-9bc2-8ea4fb0e5ae7 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:02.191417 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f55c42f-80f2-41df-9721-444208b52b52 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:02.197951 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7af2c7-fb53-4a5c-9cb3-424649fa6318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:02.198699 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7af2c7-fb53-4a5c-9cb3-424649fa6318 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:02.198982 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7af2c7-fb53-4a5c-9cb3-424649fa6318 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:02.199495 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7af2c7-fb53-4a5c-9cb3-424649fa6318 admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:02.200333 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7af2c7-fb53-4a5c-9cb3-424649fa6318 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:02.202612 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7af2c7-fb53-4a5c-9cb3-424649fa6318 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:02.205375 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 908/1829] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:46:02 2022] POST /identity/v3/users => generated 294 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:46:02.206510 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8ee3dd-9228-4ec6-9bc2-8ea4fb0e5ae7 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:02.220571 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8ee3dd-9228-4ec6-9bc2-8ea4fb0e5ae7 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:02.226266 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62818ece-a8c6-4214-a662-8abc9e99eb7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:02.227041 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62818ece-a8c6-4214-a662-8abc9e99eb7a admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:02.227425 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62818ece-a8c6-4214-a662-8abc9e99eb7a admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:02.227745 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62818ece-a8c6-4214-a662-8abc9e99eb7a admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:02.228390 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62818ece-a8c6-4214-a662-8abc9e99eb7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:02.232567 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 922/1830] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:46:02 2022] POST /identity/v3/users => generated 306 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:46:02.232728 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62818ece-a8c6-4214-a662-8abc9e99eb7a admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:02.232820 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7af2c7-fb53-4a5c-9cb3-424649fa6318 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:02.244926 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7af2c7-fb53-4a5c-9cb3-424649fa6318 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:02.250811 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bd1e7a-7641-492d-93c0-780da5c415de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:02.251544 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd1e7a-7641-492d-93c0-780da5c415de admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:02.251935 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd1e7a-7641-492d-93c0-780da5c415de admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:02.252275 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd1e7a-7641-492d-93c0-780da5c415de admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:02.252997 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bd1e7a-7641-492d-93c0-780da5c415de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:02.255578 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bd1e7a-7641-492d-93c0-780da5c415de admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:02.269952 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 923/1831] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:46:02 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:46:02.271584 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bd1e7a-7641-492d-93c0-780da5c415de admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:02.281066 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 909/1832] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:46:02 2022] POST /identity/v3/projects => generated 409 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:46:02.282610 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62818ece-a8c6-4214-a662-8abc9e99eb7a admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:02.291697 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bd1e7a-7641-492d-93c0-780da5c415de admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:02.385901 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62818ece-a8c6-4214-a662-8abc9e99eb7a admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:02.391542 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c469780a-ec59-4f16-95f1-575836f34706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:02.392273 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c469780a-ec59-4f16-95f1-575836f34706 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:02.392646 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c469780a-ec59-4f16-95f1-575836f34706 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:02.393244 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c469780a-ec59-4f16-95f1-575836f34706 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:02.394324 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c469780a-ec59-4f16-95f1-575836f34706 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:02.396570 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c469780a-ec59-4f16-95f1-575836f34706 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:02.401624 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a112f6a-1144-4fdb-927f-298e2de0ad9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:02.402893 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a112f6a-1144-4fdb-927f-298e2de0ad9f admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:02.403247 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a112f6a-1144-4fdb-927f-298e2de0ad9f admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:02.403584 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a112f6a-1144-4fdb-927f-298e2de0ad9f admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:02.404298 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a112f6a-1144-4fdb-927f-298e2de0ad9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:02.406258 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a112f6a-1144-4fdb-927f-298e2de0ad9f admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:02.409489 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 910/1833] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:46:02 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:46:02.409489 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c469780a-ec59-4f16-95f1-575836f34706 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:02.419712 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 924/1834] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:46:02 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:46:02.420850 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a112f6a-1144-4fdb-927f-298e2de0ad9f admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:02.421168 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c469780a-ec59-4f16-95f1-575836f34706 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:02.429209 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2ff5fc-377e-47b3-9341-0fc339881764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:02.429962 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ff5fc-377e-47b3-9341-0fc339881764 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:02.430319 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ff5fc-377e-47b3-9341-0fc339881764 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:02.430668 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ff5fc-377e-47b3-9341-0fc339881764 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:02.431386 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2ff5fc-377e-47b3-9341-0fc339881764 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:02.433060 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2ff5fc-377e-47b3-9341-0fc339881764 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:02.433912 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a112f6a-1144-4fdb-927f-298e2de0ad9f admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:02.438753 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e30290-ba2f-4d3c-b846-487b5d545153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:02.439371 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e30290-ba2f-4d3c-b846-487b5d545153 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:02.439625 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e30290-ba2f-4d3c-b846-487b5d545153 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:02.439893 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e30290-ba2f-4d3c-b846-487b5d545153 admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:02.440521 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e30290-ba2f-4d3c-b846-487b5d545153 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:02.442641 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e30290-ba2f-4d3c-b846-487b5d545153 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:02.444709 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 911/1835] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:46:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:46:02.446290 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc440506-7dff-40c9-bed0-fe7994d2f41c None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:02.446650 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc440506-7dff-40c9-bed0-fe7994d2f41c None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:02.447019 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc440506-7dff-40c9-bed0-fe7994d2f41c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:02.451306 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:02.470865 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 925/1836] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:46:02 2022] POST /identity/v3/users => generated 311 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:46:02.471474 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e30290-ba2f-4d3c-b846-487b5d545153 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:02.475159 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-fc440506-7dff-40c9-bed0-fe7994d2f41c None None] MFA Rules not processed for user `50f7df9dc9f2455d9426b1737770140f`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:02.476790 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-fc440506-7dff-40c9-bed0-fe7994d2f41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:02.481315 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:02.493405 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e30290-ba2f-4d3c-b846-487b5d545153 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:02.503491 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f477cc-c811-4d28-bdba-de9c1d74920a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:02.504560 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f477cc-c811-4d28-bdba-de9c1d74920a admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:02.505241 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f477cc-c811-4d28-bdba-de9c1d74920a admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:02.505600 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f477cc-c811-4d28-bdba-de9c1d74920a admin admin] PATH_INFO: `/v3/projects/ac929a86692e43da835850b982ab8800/users/8b9382230d404e6ea333cf22f221b837/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:02.532975 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f477cc-c811-4d28-bdba-de9c1d74920a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac929a86692e43da835850b982ab8800, user_id=8b9382230d404e6ea333cf22f221b837, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:02.538949 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f477cc-c811-4d28-bdba-de9c1d74920a admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:02.545936 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 912/1837] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:46:02.546891 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc440506-7dff-40c9-bed0-fe7994d2f41c None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:02.570619 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc440506-7dff-40c9-bed0-fe7994d2f41c None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:02.576811 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 926/1838] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:46:02 2022] PUT /identity/v3/projects/ac929a86692e43da835850b982ab8800/users/8b9382230d404e6ea333cf22f221b837/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:02.578301 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f477cc-c811-4d28-bdba-de9c1d74920a admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:02.679506 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfec393-4b31-458b-9e2f-0bf92dd3ad52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:02.680145 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfec393-4b31-458b-9e2f-0bf92dd3ad52 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:02.681999 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfec393-4b31-458b-9e2f-0bf92dd3ad52 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:02.681999 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfec393-4b31-458b-9e2f-0bf92dd3ad52 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:02.682602 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfec393-4b31-458b-9e2f-0bf92dd3ad52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:02.685168 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfec393-4b31-458b-9e2f-0bf92dd3ad52 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:02.711988 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f477cc-c811-4d28-bdba-de9c1d74920a admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:02.714129 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 913/1839] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:46:02 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:46:02.715227 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfec393-4b31-458b-9e2f-0bf92dd3ad52 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:02.722972 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054f1f5-0753-4407-a2cd-74fc866f5d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:02.725925 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054f1f5-0753-4407-a2cd-74fc866f5d6a admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:02.726207 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054f1f5-0753-4407-a2cd-74fc866f5d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:02.726485 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054f1f5-0753-4407-a2cd-74fc866f5d6a admin admin] PATH_INFO: `/v3/projects/933ea8647f9f4bc6a4e88a82b3f745d5/users/0cdcacea3e9041b0b46232d866e52134/roles/0c67797d444d4c929b2ccab47c468848` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:02.743757 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfec393-4b31-458b-9e2f-0bf92dd3ad52 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:02.754244 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4094eb3c-7fe6-4a69-b940-02c0867c4bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:02.755816 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094eb3c-7fe6-4a69-b940-02c0867c4bbe admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:02.756532 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094eb3c-7fe6-4a69-b940-02c0867c4bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:02.756532 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094eb3c-7fe6-4a69-b940-02c0867c4bbe admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:02.759085 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4094eb3c-7fe6-4a69-b940-02c0867c4bbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:02.763170 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4094eb3c-7fe6-4a69-b940-02c0867c4bbe admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:02.765687 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a054f1f5-0753-4407-a2cd-74fc866f5d6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=933ea8647f9f4bc6a4e88a82b3f745d5, user_id=0cdcacea3e9041b0b46232d866e52134, role_id=0c67797d444d4c929b2ccab47c468848)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:02.771193 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a054f1f5-0753-4407-a2cd-74fc866f5d6a admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:02.783447 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 914/1840] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:46:02 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:46:02.784456 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4094eb3c-7fe6-4a69-b940-02c0867c4bbe admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:02.821761 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 927/1841] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:46:02 2022] PUT /identity/v3/projects/933ea8647f9f4bc6a4e88a82b3f745d5/users/0cdcacea3e9041b0b46232d866e52134/roles/0c67797d444d4c929b2ccab47c468848 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:02.821761 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054f1f5-0753-4407-a2cd-74fc866f5d6a admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:02.826588 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4094eb3c-7fe6-4a69-b940-02c0867c4bbe admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:02.946719 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526c0bc-7865-412d-a839-d7a30de0c1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:02.947442 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526c0bc-7865-412d-a839-d7a30de0c1a7 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:02.947931 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526c0bc-7865-412d-a839-d7a30de0c1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:02.948180 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526c0bc-7865-412d-a839-d7a30de0c1a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:02.957078 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5526c0bc-7865-412d-a839-d7a30de0c1a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:02.959553 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5526c0bc-7865-412d-a839-d7a30de0c1a7 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:02.982534 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 915/1842] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:46:02 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:46:02.986484 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526c0bc-7865-412d-a839-d7a30de0c1a7 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:03.008610 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526c0bc-7865-412d-a839-d7a30de0c1a7 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:03.020465 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9450d4-9831-4bd3-b383-ff2bf5e1068b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:03.021837 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9450d4-9831-4bd3-b383-ff2bf5e1068b admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:03.021837 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9450d4-9831-4bd3-b383-ff2bf5e1068b admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:03.021837 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9450d4-9831-4bd3-b383-ff2bf5e1068b admin admin] PATH_INFO: `/v3/projects/0837dedb7b3f4af08d340cc62320c2b1/users/2d4e218f099d4a1aaa8f672b764dfe9a/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:03.062787 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9450d4-9831-4bd3-b383-ff2bf5e1068b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0837dedb7b3f4af08d340cc62320c2b1, user_id=2d4e218f099d4a1aaa8f672b764dfe9a, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:03.068262 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9450d4-9831-4bd3-b383-ff2bf5e1068b admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:03.093090 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054f1f5-0753-4407-a2cd-74fc866f5d6a admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:03.105476 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f97be4-fe87-406b-baf6-84653194de1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:03.108499 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f97be4-fe87-406b-baf6-84653194de1d admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:03.109090 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 916/1843] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:46:02 2022] PUT /identity/v3/projects/0837dedb7b3f4af08d340cc62320c2b1/users/2d4e218f099d4a1aaa8f672b764dfe9a/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:03.113928 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860c426-b832-4b61-ae05-4fb2c80e5110 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:03.115021 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860c426-b832-4b61-ae05-4fb2c80e5110 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:03.115133 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860c426-b832-4b61-ae05-4fb2c80e5110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:03.116284 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f97be4-fe87-406b-baf6-84653194de1d admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:03.117461 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f97be4-fe87-406b-baf6-84653194de1d admin admin] PATH_INFO: `/v3/projects/fd6b58b41a134400ac330af53151d679/users/b5edea2e8b93414680992daa27499303/roles/0c67797d444d4c929b2ccab47c468848` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:03.156908 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f97be4-fe87-406b-baf6-84653194de1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd6b58b41a134400ac330af53151d679, user_id=b5edea2e8b93414680992daa27499303, role_id=0c67797d444d4c929b2ccab47c468848)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:03.164360 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:03.168762 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f97be4-fe87-406b-baf6-84653194de1d admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:03.182848 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-5860c426-b832-4b61-ae05-4fb2c80e5110 None None] MFA Rules not processed for user `0cdcacea3e9041b0b46232d866e52134`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:03.184389 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-5860c426-b832-4b61-ae05-4fb2c80e5110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:03.217633 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 928/1844] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:46:02 2022] PUT /identity/v3/projects/fd6b58b41a134400ac330af53151d679/users/b5edea2e8b93414680992daa27499303/roles/0c67797d444d4c929b2ccab47c468848 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:03.221222 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f97be4-fe87-406b-baf6-84653194de1d admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:03.299199 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:03.328063 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f97be4-fe87-406b-baf6-84653194de1d admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:03.334692 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa2a913-ee47-436d-98a2-4492e4d2b5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:03.336447 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2a913-ee47-436d-98a2-4492e4d2b5a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:03.336843 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2a913-ee47-436d-98a2-4492e4d2b5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:03.337150 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2a913-ee47-436d-98a2-4492e4d2b5a6 admin admin] PATH_INFO: `/v3/projects/ac929a86692e43da835850b982ab8800/users/8b9382230d404e6ea333cf22f221b837/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:03.339428 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa2a913-ee47-436d-98a2-4492e4d2b5a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac929a86692e43da835850b982ab8800, user_id=8b9382230d404e6ea333cf22f221b837, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:03.342295 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa2a913-ee47-436d-98a2-4492e4d2b5a6 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:03.344562 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 917/1845] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:46:03.345661 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5860c426-b832-4b61-ae05-4fb2c80e5110 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:03.357002 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 929/1846] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:46:03 2022] PUT /identity/v3/projects/ac929a86692e43da835850b982ab8800/users/8b9382230d404e6ea333cf22f221b837/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:03.358548 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98284b-af77-4536-9e44-e9909168ca75 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:03.358914 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98284b-af77-4536-9e44-e9909168ca75 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:03.359095 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5860c426-b832-4b61-ae05-4fb2c80e5110 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:03.359323 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98284b-af77-4536-9e44-e9909168ca75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:03.397786 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-5d98284b-af77-4536-9e44-e9909168ca75 None None] MFA Rules not processed for user `b5edea2e8b93414680992daa27499303`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:03.399435 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-5d98284b-af77-4536-9e44-e9909168ca75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:03.437118 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c59e45-69e4-4bab-9fd8-301dce4c731d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:03.437872 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c59e45-69e4-4bab-9fd8-301dce4c731d admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:03.438162 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c59e45-69e4-4bab-9fd8-301dce4c731d admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:03.438585 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c59e45-69e4-4bab-9fd8-301dce4c731d admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:03.439305 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c59e45-69e4-4bab-9fd8-301dce4c731d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:03.442857 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c59e45-69e4-4bab-9fd8-301dce4c731d admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:03.455907 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 918/1847] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:46:03 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:46:03.456914 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c59e45-69e4-4bab-9fd8-301dce4c731d admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:03.468933 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c59e45-69e4-4bab-9fd8-301dce4c731d admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:03.474048 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b98eb3c-6996-43fb-9740-f774e89a831f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:03.475412 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b98eb3c-6996-43fb-9740-f774e89a831f admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:03.475412 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b98eb3c-6996-43fb-9740-f774e89a831f admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:03.475412 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b98eb3c-6996-43fb-9740-f774e89a831f admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:03.476234 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b98eb3c-6996-43fb-9740-f774e89a831f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:03.478516 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b98eb3c-6996-43fb-9740-f774e89a831f admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:03.492411 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 930/1848] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:03 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:46:03.494665 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b5922-fa23-42e0-b5ce-507074c1dce8 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:03.495349 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b5922-fa23-42e0-b5ce-507074c1dce8 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:03.495762 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b5922-fa23-42e0-b5ce-507074c1dce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:03.514184 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 919/1849] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:46:03 2022] POST /identity/v3/projects => generated 379 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:46:03.515232 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b98eb3c-6996-43fb-9740-f774e89a831f admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:03.599621 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b98eb3c-6996-43fb-9740-f774e89a831f admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:03.605975 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67324cc-9359-45cc-b38d-3059f31ed82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:03.606329 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-ee9b5922-fa23-42e0-b5ce-507074c1dce8 None None] MFA Rules not processed for user `8b9382230d404e6ea333cf22f221b837`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:03.607630 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-ee9b5922-fa23-42e0-b5ce-507074c1dce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:03.607740 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67324cc-9359-45cc-b38d-3059f31ed82c admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:03.608426 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67324cc-9359-45cc-b38d-3059f31ed82c admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:03.608783 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67324cc-9359-45cc-b38d-3059f31ed82c admin admin] PATH_INFO: `/v3/projects/0837dedb7b3f4af08d340cc62320c2b1/users/2d4e218f099d4a1aaa8f672b764dfe9a/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:03.612265 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67324cc-9359-45cc-b38d-3059f31ed82c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0837dedb7b3f4af08d340cc62320c2b1, user_id=2d4e218f099d4a1aaa8f672b764dfe9a, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:03.633425 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67324cc-9359-45cc-b38d-3059f31ed82c admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:03.653543 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 920/1850] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:46:03 2022] PUT /identity/v3/projects/0837dedb7b3f4af08d340cc62320c2b1/users/2d4e218f099d4a1aaa8f672b764dfe9a/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:03.654555 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67324cc-9359-45cc-b38d-3059f31ed82c admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:03.677344 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:03.788140 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 931/1851] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:03 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:46:03.793070 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9b5922-fa23-42e0-b5ce-507074c1dce8 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:03.807575 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9b5922-fa23-42e0-b5ce-507074c1dce8 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:03.877089 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:03.890918 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67324cc-9359-45cc-b38d-3059f31ed82c admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:03.905185 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed587b-52a3-4a3e-a480-f8db24e6cddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:03.906201 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed587b-52a3-4a3e-a480-f8db24e6cddd admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:03.906682 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed587b-52a3-4a3e-a480-f8db24e6cddd admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:03.907034 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed587b-52a3-4a3e-a480-f8db24e6cddd admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:03.907785 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ed587b-52a3-4a3e-a480-f8db24e6cddd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:03.909844 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ed587b-52a3-4a3e-a480-f8db24e6cddd admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:03.927890 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7fe765-6376-424e-80c9-dea2fdad63b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:03.928633 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7fe765-6376-424e-80c9-dea2fdad63b2 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:03.928960 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7fe765-6376-424e-80c9-dea2fdad63b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:03.929233 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7fe765-6376-424e-80c9-dea2fdad63b2 admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:03.931005 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7fe765-6376-424e-80c9-dea2fdad63b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:03.934555 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7fe765-6376-424e-80c9-dea2fdad63b2 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:03.969535 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 932/1852] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:46:03 2022] POST /identity/v3/users => generated 296 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:46:03.974965 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb584e63-881f-4f27-982c-d5fc1b6060ac None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:03.975228 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb584e63-881f-4f27-982c-d5fc1b6060ac None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:03.980801 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 921/1853] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:46:03 2022] POST /identity/v3/projects => generated 387 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:46:03.982189 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed587b-52a3-4a3e-a480-f8db24e6cddd admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:03.982312 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb584e63-881f-4f27-982c-d5fc1b6060ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:03.987102 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-e8ed587b-52a3-4a3e-a480-f8db24e6cddd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:04.069942 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-bb584e63-881f-4f27-982c-d5fc1b6060ac None None] MFA Rules not processed for user `2d4e218f099d4a1aaa8f672b764dfe9a`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:04.071652 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-bb584e63-881f-4f27-982c-d5fc1b6060ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:04.180231 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed587b-52a3-4a3e-a480-f8db24e6cddd admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:04.191903 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d09cb1d-b7db-4536-8790-42130f2d21ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:04.192984 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09cb1d-b7db-4536-8790-42130f2d21ac service cinder] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:04.193657 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09cb1d-b7db-4536-8790-42130f2d21ac service cinder] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:04.194118 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09cb1d-b7db-4536-8790-42130f2d21ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:04.284943 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 933/1854] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:03 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:46:04.285985 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb584e63-881f-4f27-982c-d5fc1b6060ac None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:04.364250 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d09cb1d-b7db-4536-8790-42130f2d21ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:04.367376 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d09cb1d-b7db-4536-8790-42130f2d21ac service cinder] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:04.379214 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb584e63-881f-4f27-982c-d5fc1b6060ac None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:04.384998 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e796b7-7d97-4258-a1d5-05c3e8ab0887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:04.385737 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e796b7-7d97-4258-a1d5-05c3e8ab0887 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:04.386093 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e796b7-7d97-4258-a1d5-05c3e8ab0887 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:04.386438 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e796b7-7d97-4258-a1d5-05c3e8ab0887 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:04.387167 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e796b7-7d97-4258-a1d5-05c3e8ab0887 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:04.388854 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e796b7-7d97-4258-a1d5-05c3e8ab0887 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:04.397174 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 922/1855] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:46:03 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:46:04.398218 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d09cb1d-b7db-4536-8790-42130f2d21ac service cinder] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:04.401766 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 934/1856] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:46:04 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:46:04.403850 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e796b7-7d97-4258-a1d5-05c3e8ab0887 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:04.406825 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-c7e796b7-7d97-4258-a1d5-05c3e8ab0887 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:04.418904 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d09cb1d-b7db-4536-8790-42130f2d21ac service cinder] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:04.426277 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e796b7-7d97-4258-a1d5-05c3e8ab0887 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:04.426936 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2779565-c123-4a00-a8ba-c5894d64b889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:04.428963 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2779565-c123-4a00-a8ba-c5894d64b889 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:04.429510 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2779565-c123-4a00-a8ba-c5894d64b889 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:04.430064 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2779565-c123-4a00-a8ba-c5894d64b889 admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:04.431708 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2779565-c123-4a00-a8ba-c5894d64b889 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:04.434173 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2779565-c123-4a00-a8ba-c5894d64b889 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:04.446898 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6c5799-2cd1-4d5a-9e62-b73e0319b4af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:04.449017 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c5799-2cd1-4d5a-9e62-b73e0319b4af service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:04.450256 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c5799-2cd1-4d5a-9e62-b73e0319b4af service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:04.450990 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c5799-2cd1-4d5a-9e62-b73e0319b4af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:04.481049 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 923/1857] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:46:04 2022] POST /identity/v3/users => generated 300 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:46:04.481614 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2779565-c123-4a00-a8ba-c5894d64b889 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:04.491704 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6c5799-2cd1-4d5a-9e62-b73e0319b4af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:04.497942 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6c5799-2cd1-4d5a-9e62-b73e0319b4af service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:04.513884 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2779565-c123-4a00-a8ba-c5894d64b889 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:04.536079 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 935/1858] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:46:04 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:46:04.538698 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6c5799-2cd1-4d5a-9e62-b73e0319b4af service cinder] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:04.548668 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87caa253-32cf-4b18-9293-060b6986a696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:04.549845 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87caa253-32cf-4b18-9293-060b6986a696 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:04.549845 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87caa253-32cf-4b18-9293-060b6986a696 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:04.550055 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87caa253-32cf-4b18-9293-060b6986a696 admin admin] PATH_INFO: `/v3/projects/498c6f8bc67d4be1a65d94f6e8e9f96d/users/d77aacbdeb764150b8d1ded105286ea8/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:04.596954 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6c5799-2cd1-4d5a-9e62-b73e0319b4af service cinder] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:04.602335 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87caa253-32cf-4b18-9293-060b6986a696 admin admin] RBAC: Authorizing `identity:create_grant(project_id=498c6f8bc67d4be1a65d94f6e8e9f96d, user_id=d77aacbdeb764150b8d1ded105286ea8, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:04.605253 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87caa253-32cf-4b18-9293-060b6986a696 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:04.614095 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8ed17c-3a0f-4b0a-a82a-cec27d471a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:04.614947 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ed17c-3a0f-4b0a-a82a-cec27d471a3a admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:04.615225 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ed17c-3a0f-4b0a-a82a-cec27d471a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:04.615504 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ed17c-3a0f-4b0a-a82a-cec27d471a3a admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:04.616166 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8ed17c-3a0f-4b0a-a82a-cec27d471a3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:04.619095 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8ed17c-3a0f-4b0a-a82a-cec27d471a3a admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:04.644146 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 936/1859] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:46:04 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:46:04.646908 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 924/1860] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:46:04 2022] PUT /identity/v3/projects/498c6f8bc67d4be1a65d94f6e8e9f96d/users/d77aacbdeb764150b8d1ded105286ea8/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:04.647937 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87caa253-32cf-4b18-9293-060b6986a696 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:04.648528 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8ed17c-3a0f-4b0a-a82a-cec27d471a3a admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:04.663067 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:04.682213 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8ed17c-3a0f-4b0a-a82a-cec27d471a3a admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:04.747238 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:04.782619 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87caa253-32cf-4b18-9293-060b6986a696 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:04.793868 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f54c03a-bee5-43da-bd0b-dfdfcbd6dc74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:04.794516 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f54c03a-bee5-43da-bd0b-dfdfcbd6dc74 service cinder] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:04.794857 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f54c03a-bee5-43da-bd0b-dfdfcbd6dc74 service cinder] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:04.795059 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f54c03a-bee5-43da-bd0b-dfdfcbd6dc74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:04.807357 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afa162c-ae3d-470e-bd57-0168acf3e74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:04.810284 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa162c-ae3d-470e-bd57-0168acf3e74a admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:04.810809 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa162c-ae3d-470e-bd57-0168acf3e74a admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:04.811491 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa162c-ae3d-470e-bd57-0168acf3e74a admin admin] PATH_INFO: `/v3/projects/444eba5d04884b8e9ffc22d52877635b/users/c21871eb1a174b7db108e8f83baebc93/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:04.838445 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afa162c-ae3d-470e-bd57-0168acf3e74a admin admin] RBAC: Authorizing `identity:create_grant(project_id=444eba5d04884b8e9ffc22d52877635b, user_id=c21871eb1a174b7db108e8f83baebc93, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:04.843251 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afa162c-ae3d-470e-bd57-0168acf3e74a admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:04.871303 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 937/1861] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:46:04 2022] PUT /identity/v3/projects/444eba5d04884b8e9ffc22d52877635b/users/c21871eb1a174b7db108e8f83baebc93/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:04.872937 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afa162c-ae3d-470e-bd57-0168acf3e74a admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:04.942181 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f54c03a-bee5-43da-bd0b-dfdfcbd6dc74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:04.945150 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f54c03a-bee5-43da-bd0b-dfdfcbd6dc74 service cinder] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:04.961069 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 925/1862] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:46:04 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:46:04.962224 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f54c03a-bee5-43da-bd0b-dfdfcbd6dc74 service cinder] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:04.989551 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f54c03a-bee5-43da-bd0b-dfdfcbd6dc74 service cinder] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:05.083479 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afa162c-ae3d-470e-bd57-0168acf3e74a admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:05.096043 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9147fddf-9341-4b21-8de5-4ac1c0360e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:05.096680 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147fddf-9341-4b21-8de5-4ac1c0360e66 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:05.096960 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147fddf-9341-4b21-8de5-4ac1c0360e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:05.097232 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147fddf-9341-4b21-8de5-4ac1c0360e66 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:05.097905 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9147fddf-9341-4b21-8de5-4ac1c0360e66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:05.099563 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9147fddf-9341-4b21-8de5-4ac1c0360e66 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:05.100378 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68eb2dd-4264-4ea9-8cc9-b3150fca7cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:05.100999 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68eb2dd-4264-4ea9-8cc9-b3150fca7cc5 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:05.101275 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68eb2dd-4264-4ea9-8cc9-b3150fca7cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:05.101571 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68eb2dd-4264-4ea9-8cc9-b3150fca7cc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:05.102978 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68eb2dd-4264-4ea9-8cc9-b3150fca7cc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:05.106422 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68eb2dd-4264-4ea9-8cc9-b3150fca7cc5 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:05.131378 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 926/1863] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:46:04 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:46:05.132282 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9147fddf-9341-4b21-8de5-4ac1c0360e66 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:05.133036 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 938/1864] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:46:04 2022] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:46:05.137889 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68eb2dd-4264-4ea9-8cc9-b3150fca7cc5 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:05.166124 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68eb2dd-4264-4ea9-8cc9-b3150fca7cc5 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:05.178396 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29abb89b-8fef-4e9e-878f-a6d0e2958f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:05.179093 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29abb89b-8fef-4e9e-878f-a6d0e2958f58 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:05.180521 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29abb89b-8fef-4e9e-878f-a6d0e2958f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:05.180813 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29abb89b-8fef-4e9e-878f-a6d0e2958f58 admin admin] PATH_INFO: `/v3/projects/498c6f8bc67d4be1a65d94f6e8e9f96d/users/d77aacbdeb764150b8d1ded105286ea8/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:05.186230 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29abb89b-8fef-4e9e-878f-a6d0e2958f58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=498c6f8bc67d4be1a65d94f6e8e9f96d, user_id=d77aacbdeb764150b8d1ded105286ea8, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:05.196256 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29abb89b-8fef-4e9e-878f-a6d0e2958f58 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:05.224542 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 939/1865] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:46:05 2022] PUT /identity/v3/projects/498c6f8bc67d4be1a65d94f6e8e9f96d/users/d77aacbdeb764150b8d1ded105286ea8/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:05.225497 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29abb89b-8fef-4e9e-878f-a6d0e2958f58 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:05.299919 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9147fddf-9341-4b21-8de5-4ac1c0360e66 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:05.312960 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:05.403632 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29abb89b-8fef-4e9e-878f-a6d0e2958f58 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:05.414160 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b400004-c137-4be9-8878-f246235a4b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:05.414850 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b400004-c137-4be9-8878-f246235a4b05 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:05.416585 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b400004-c137-4be9-8878-f246235a4b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:05.418298 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b400004-c137-4be9-8878-f246235a4b05 admin admin] PATH_INFO: `/v3/projects/444eba5d04884b8e9ffc22d52877635b/users/c21871eb1a174b7db108e8f83baebc93/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:05.422041 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9170c213-b143-46bf-9755-77dce8d87684 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:05.423059 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170c213-b143-46bf-9755-77dce8d87684 service cinder] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:05.423432 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170c213-b143-46bf-9755-77dce8d87684 service cinder] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:05.424414 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b400004-c137-4be9-8878-f246235a4b05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=444eba5d04884b8e9ffc22d52877635b, user_id=c21871eb1a174b7db108e8f83baebc93, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:05.425623 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170c213-b143-46bf-9755-77dce8d87684 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:05.428990 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b400004-c137-4be9-8878-f246235a4b05 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:05.456822 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 940/1866] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:46:05 2022] PUT /identity/v3/projects/444eba5d04884b8e9ffc22d52877635b/users/c21871eb1a174b7db108e8f83baebc93/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:05.460463 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32ffe1-47bd-407a-b1e3-b96aeceda7cf None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:05.464089 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32ffe1-47bd-407a-b1e3-b96aeceda7cf None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:05.464499 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32ffe1-47bd-407a-b1e3-b96aeceda7cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:05.558217 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-4c32ffe1-47bd-407a-b1e3-b96aeceda7cf None None] MFA Rules not processed for user `d77aacbdeb764150b8d1ded105286ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:05.559924 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-4c32ffe1-47bd-407a-b1e3-b96aeceda7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:05.597410 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:05.600733 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9170c213-b143-46bf-9755-77dce8d87684 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:05.603313 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9170c213-b143-46bf-9755-77dce8d87684 service cinder] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:05.629142 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 927/1867] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:46:05 2022] GET /identity/v3/auth/tokens => generated 3282 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:46:05.630920 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be833ea-23dd-465a-9eef-9ab8176a75e6 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:05.631250 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be833ea-23dd-465a-9eef-9ab8176a75e6 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:05.631528 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be833ea-23dd-465a-9eef-9ab8176a75e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:05.710429 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-9be833ea-23dd-465a-9eef-9ab8176a75e6 None None] MFA Rules not processed for user `c21871eb1a174b7db108e8f83baebc93`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:05.712883 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-9be833ea-23dd-465a-9eef-9ab8176a75e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:05.732929 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 941/1868] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:05 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:46:05.749119 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c32ffe1-47bd-407a-b1e3-b96aeceda7cf None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:05.860063 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 928/1869] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:05 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:46:05.883181 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c32ffe1-47bd-407a-b1e3-b96aeceda7cf None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:05.887103 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19643b74-6fcd-4bb3-ba97-86efc98c68fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:05.887779 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19643b74-6fcd-4bb3-ba97-86efc98c68fb service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:05.888123 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19643b74-6fcd-4bb3-ba97-86efc98c68fb service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:05.888890 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19643b74-6fcd-4bb3-ba97-86efc98c68fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:05.990895 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19643b74-6fcd-4bb3-ba97-86efc98c68fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:05.993539 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19643b74-6fcd-4bb3-ba97-86efc98c68fb service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:06.025726 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 942/1870] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:46:05 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:46:06.034318 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f033ea-adcb-4868-8c8c-f30a8923ba07 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:06.034879 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f033ea-adcb-4868-8c8c-f30a8923ba07 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:06.034879 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f033ea-adcb-4868-8c8c-f30a8923ba07 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:06.036734 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 929/1871] 10.222.0.47 () {54 vars in 921 bytes} [Mon Aug 29 22:46:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:46:06.048758 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5526e2-be50-496e-9e9a-97fe6db599c7 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:06.049140 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5526e2-be50-496e-9e9a-97fe6db599c7 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:06.049528 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5526e2-be50-496e-9e9a-97fe6db599c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:06.103620 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-0a5526e2-be50-496e-9e9a-97fe6db599c7 None None] MFA Rules not processed for user `35441c061e514b1b9341e7694ec2c0bc`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:06.109167 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-0a5526e2-be50-496e-9e9a-97fe6db599c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:06.242378 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f033ea-adcb-4868-8c8c-f30a8923ba07 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:06.272323 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:06.287871 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f033ea-adcb-4868-8c8c-f30a8923ba07 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:06.304650 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be859ca-e2d0-4a2d-a6b5-700623525e81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:06.307642 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be859ca-e2d0-4a2d-a6b5-700623525e81 service cinder] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:06.308515 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be859ca-e2d0-4a2d-a6b5-700623525e81 service cinder] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:06.309544 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be859ca-e2d0-4a2d-a6b5-700623525e81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:06.313089 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 943/1872] 10.222.0.47 () {58 vars in 1018 bytes} [Mon Aug 29 22:46:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:46:06.328979 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5526e2-be50-496e-9e9a-97fe6db599c7 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:06.330545 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-0a5526e2-be50-496e-9e9a-97fe6db599c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:06.334066 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be859ca-e2d0-4a2d-a6b5-700623525e81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:06.335685 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be859ca-e2d0-4a2d-a6b5-700623525e81 service cinder] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:06.361584 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5526e2-be50-496e-9e9a-97fe6db599c7 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:06.368668 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 930/1873] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:46:06 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:46:06.396247 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a60c78c-636e-4c10-9be5-cbb6ff7dc6f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35441c061e514b1b9341e7694ec2c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:06.397256 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60c78c-636e-4c10-9be5-cbb6ff7dc6f3 service nova] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:06.397734 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60c78c-636e-4c10-9be5-cbb6ff7dc6f3 service nova] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:06.398166 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60c78c-636e-4c10-9be5-cbb6ff7dc6f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:06.417270 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a60c78c-636e-4c10-9be5-cbb6ff7dc6f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:06.426319 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a60c78c-636e-4c10-9be5-cbb6ff7dc6f3 service nova] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:06.445569 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 944/1874] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:46:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:46:07.519818 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be859ca-e2d0-4a2d-a6b5-700623525e81 service cinder] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:07.614675 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:07.643192 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be859ca-e2d0-4a2d-a6b5-700623525e81 service cinder] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:07.649168 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1e830c-419a-4bdb-b360-e566c99fca6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:07.649974 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e830c-419a-4bdb-b360-e566c99fca6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:07.650318 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e830c-419a-4bdb-b360-e566c99fca6c admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:07.650662 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e830c-419a-4bdb-b360-e566c99fca6c admin admin] PATH_INFO: `/v3/users/b5edea2e8b93414680992daa27499303` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:07.651894 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1e830c-419a-4bdb-b360-e566c99fca6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5edea2e8b93414680992daa27499303)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:07.654317 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1e830c-419a-4bdb-b360-e566c99fca6c admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:07.733435 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-ec1e830c-419a-4bdb-b360-e566c99fca6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5edea2e8b93414680992daa27499303'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:07.758784 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-ec1e830c-419a-4bdb-b360-e566c99fca6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5edea2e8b93414680992daa27499303'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:07.759864 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-ec1e830c-419a-4bdb-b360-e566c99fca6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5edea2e8b93414680992daa27499303'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:07.764614 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a60c78c-636e-4c10-9be5-cbb6ff7dc6f3 service nova] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:07.776258 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-ec1e830c-419a-4bdb-b360-e566c99fca6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5edea2e8b93414680992daa27499303'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:07.777792 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a60c78c-636e-4c10-9be5-cbb6ff7dc6f3 service nova] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:07.784683 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57bec6d-e59f-44b2-99da-dac0d4714077 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:07.785675 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57bec6d-e59f-44b2-99da-dac0d4714077 service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:07.786656 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57bec6d-e59f-44b2-99da-dac0d4714077 service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:07.787391 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57bec6d-e59f-44b2-99da-dac0d4714077 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:07.788469 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-ec1e830c-419a-4bdb-b360-e566c99fca6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5edea2e8b93414680992daa27499303'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:07.801012 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 931/1875] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:46:07 2022] DELETE /identity/v3/users/b5edea2e8b93414680992daa27499303 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:07.808405 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057258a-9205-4e56-b878-f1436561a5d7 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:07.808510 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057258a-9205-4e56-b878-f1436561a5d7 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:07.809017 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057258a-9205-4e56-b878-f1436561a5d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:07.816521 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57bec6d-e59f-44b2-99da-dac0d4714077 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:07.816521 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57bec6d-e59f-44b2-99da-dac0d4714077 service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:07.838358 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 945/1876] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:46:07 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:46:07.846070 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-5057258a-9205-4e56-b878-f1436561a5d7 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:07.849832 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-5057258a-9205-4e56-b878-f1436561a5d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:07.967185 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 932/1877] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:46:08.016919 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57bec6d-e59f-44b2-99da-dac0d4714077 service cinder] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:08.018847 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-a57bec6d-e59f-44b2-99da-dac0d4714077 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:08.140400 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57bec6d-e59f-44b2-99da-dac0d4714077 service cinder] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:08.204178 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a77b6-aa19-472a-8fe8-7262f2eb42ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:08.204813 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a77b6-aa19-472a-8fe8-7262f2eb42ac service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:08.205094 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a77b6-aa19-472a-8fe8-7262f2eb42ac service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:08.205405 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a77b6-aa19-472a-8fe8-7262f2eb42ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:08.216856 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387a77b6-aa19-472a-8fe8-7262f2eb42ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:08.218363 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387a77b6-aa19-472a-8fe8-7262f2eb42ac service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:08.230160 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 946/1878] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:46:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:46:08.668638 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5057258a-9205-4e56-b878-f1436561a5d7 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:08.670480 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-5057258a-9205-4e56-b878-f1436561a5d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:08.708238 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5057258a-9205-4e56-b878-f1436561a5d7 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:08.741485 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4992a291-1d7e-4b8a-963b-013c41475239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:08.754164 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4992a291-1d7e-4b8a-963b-013c41475239 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:08.754472 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4992a291-1d7e-4b8a-963b-013c41475239 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:08.754795 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4992a291-1d7e-4b8a-963b-013c41475239 admin admin] PATH_INFO: `/v3/projects/fd6b58b41a134400ac330af53151d679` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:08.765386 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4992a291-1d7e-4b8a-963b-013c41475239 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd6b58b41a134400ac330af53151d679)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:08.767830 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4992a291-1d7e-4b8a-963b-013c41475239 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:08.876551 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-4992a291-1d7e-4b8a-963b-013c41475239 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd6b58b41a134400ac330af53151d679', 'request_id': 'req-4992a291-1d7e-4b8a-963b-013c41475239'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:08.879364 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:08.900192 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-4992a291-1d7e-4b8a-963b-013c41475239 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd6b58b41a134400ac330af53151d679', 'request_id': 'req-4992a291-1d7e-4b8a-963b-013c41475239'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:08.914635 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-4992a291-1d7e-4b8a-963b-013c41475239 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd6b58b41a134400ac330af53151d679', 'request_id': 'req-4992a291-1d7e-4b8a-963b-013c41475239'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:08.954111 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-4992a291-1d7e-4b8a-963b-013c41475239 admin admin] The token cache is being invalidate because project fd6b58b41a134400ac330af53151d679 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:46:08.954834 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-4992a291-1d7e-4b8a-963b-013c41475239 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:08.956878 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-4992a291-1d7e-4b8a-963b-013c41475239 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:08.962934 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 933/1879] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:46:08 2022] DELETE /identity/v3/projects/fd6b58b41a134400ac330af53151d679 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:08.967182 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a77b6-aa19-472a-8fe8-7262f2eb42ac service neutron] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:08.999099 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a77b6-aa19-472a-8fe8-7262f2eb42ac service neutron] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:09.205374 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c4d5b6-45ca-42c1-9a6b-dfbc41c1cb04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:09.206211 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c4d5b6-45ca-42c1-9a6b-dfbc41c1cb04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:09.206211 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c4d5b6-45ca-42c1-9a6b-dfbc41c1cb04 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:09.206607 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c4d5b6-45ca-42c1-9a6b-dfbc41c1cb04 admin admin] PATH_INFO: `/v3/users/c21871eb1a174b7db108e8f83baebc93` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:09.207993 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c4d5b6-45ca-42c1-9a6b-dfbc41c1cb04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c21871eb1a174b7db108e8f83baebc93)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:09.210721 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c4d5b6-45ca-42c1-9a6b-dfbc41c1cb04 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:09.288790 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:09.319716 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-85c4d5b6-45ca-42c1-9a6b-dfbc41c1cb04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c21871eb1a174b7db108e8f83baebc93'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:09.353413 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-85c4d5b6-45ca-42c1-9a6b-dfbc41c1cb04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c21871eb1a174b7db108e8f83baebc93'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:09.354717 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-85c4d5b6-45ca-42c1-9a6b-dfbc41c1cb04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c21871eb1a174b7db108e8f83baebc93'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:09.375014 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-85c4d5b6-45ca-42c1-9a6b-dfbc41c1cb04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c21871eb1a174b7db108e8f83baebc93'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:09.377271 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-85c4d5b6-45ca-42c1-9a6b-dfbc41c1cb04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c21871eb1a174b7db108e8f83baebc93'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:09.421371 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 947/1880] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:46:08 2022] DELETE /identity/v3/users/c21871eb1a174b7db108e8f83baebc93 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:09.976554 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4992a291-1d7e-4b8a-963b-013c41475239 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:09.978344 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-4992a291-1d7e-4b8a-963b-013c41475239 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:09.993706 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4992a291-1d7e-4b8a-963b-013c41475239 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:10.156552 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a780d6-6d5a-4bd2-8db4-2833895a0352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:10.157756 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a780d6-6d5a-4bd2-8db4-2833895a0352 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:10.158561 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a780d6-6d5a-4bd2-8db4-2833895a0352 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:10.159129 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a780d6-6d5a-4bd2-8db4-2833895a0352 admin admin] PATH_INFO: `/v3/projects/444eba5d04884b8e9ffc22d52877635b` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:10.162410 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a780d6-6d5a-4bd2-8db4-2833895a0352 admin admin] RBAC: Authorizing `identity:delete_project(project_id=444eba5d04884b8e9ffc22d52877635b)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:10.164764 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a780d6-6d5a-4bd2-8db4-2833895a0352 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:10.299833 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-07a780d6-6d5a-4bd2-8db4-2833895a0352 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '444eba5d04884b8e9ffc22d52877635b', 'request_id': 'req-07a780d6-6d5a-4bd2-8db4-2833895a0352'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:10.314754 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-07a780d6-6d5a-4bd2-8db4-2833895a0352 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '444eba5d04884b8e9ffc22d52877635b', 'request_id': 'req-07a780d6-6d5a-4bd2-8db4-2833895a0352'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:10.332513 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-07a780d6-6d5a-4bd2-8db4-2833895a0352 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '444eba5d04884b8e9ffc22d52877635b', 'request_id': 'req-07a780d6-6d5a-4bd2-8db4-2833895a0352'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:10.356724 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c4d5b6-45ca-42c1-9a6b-dfbc41c1cb04 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:10.358257 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-85c4d5b6-45ca-42c1-9a6b-dfbc41c1cb04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:10.367065 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-07a780d6-6d5a-4bd2-8db4-2833895a0352 admin admin] The token cache is being invalidate because project 444eba5d04884b8e9ffc22d52877635b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:46:10.368535 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-07a780d6-6d5a-4bd2-8db4-2833895a0352 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:10.370169 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-07a780d6-6d5a-4bd2-8db4-2833895a0352 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:10.377868 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c4d5b6-45ca-42c1-9a6b-dfbc41c1cb04 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:10.382735 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 934/1881] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:46:09 2022] DELETE /identity/v3/projects/444eba5d04884b8e9ffc22d52877635b => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:10.386046 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6b78c-a030-4ad8-9cbc-a5e073e15f92 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:10.387683 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6b78c-a030-4ad8-9cbc-a5e073e15f92 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:10.388008 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6b78c-a030-4ad8-9cbc-a5e073e15f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:10.440851 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-a0b6b78c-a030-4ad8-9cbc-a5e073e15f92 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:10.443320 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-a0b6b78c-a030-4ad8-9cbc-a5e073e15f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:10.454805 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc728419-c99d-487c-aa89-cc1de79beabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:10.455471 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc728419-c99d-487c-aa89-cc1de79beabf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:10.455754 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc728419-c99d-487c-aa89-cc1de79beabf admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:10.456027 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc728419-c99d-487c-aa89-cc1de79beabf admin admin] PATH_INFO: `/v3/users/ccf8ad42150d47e6b8667e4c02f38bc2` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:10.461077 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 935/1882] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:46:10.462102 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc728419-c99d-487c-aa89-cc1de79beabf admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccf8ad42150d47e6b8667e4c02f38bc2)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:10.464294 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc728419-c99d-487c-aa89-cc1de79beabf admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:10.471153 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa3dc3-c853-4aa6-9221-63086e76767a None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:10.471541 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa3dc3-c853-4aa6-9221-63086e76767a None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:10.471711 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa3dc3-c853-4aa6-9221-63086e76767a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:10.499342 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-04aa3dc3-c853-4aa6-9221-63086e76767a None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:10.502160 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-04aa3dc3-c853-4aa6-9221-63086e76767a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:10.525321 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 936/1883] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:46:10.529878 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aa3dc3-c853-4aa6-9221-63086e76767a None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:10.540744 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aa3dc3-c853-4aa6-9221-63086e76767a None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:10.547228 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a268169-4fc8-4b44-ac1c-bbaaef86736e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:10.547592 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a268169-4fc8-4b44-ac1c-bbaaef86736e admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:10.547949 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a268169-4fc8-4b44-ac1c-bbaaef86736e admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:10.548297 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a268169-4fc8-4b44-ac1c-bbaaef86736e admin admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:10.549022 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a268169-4fc8-4b44-ac1c-bbaaef86736e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:46:10.550794 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a268169-4fc8-4b44-ac1c-bbaaef86736e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:10.551201 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a268169-4fc8-4b44-ac1c-bbaaef86736e admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:10.566824 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 937/1884] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Aug 29 22:46:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:46:10.569986 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-dc728419-c99d-487c-aa89-cc1de79beabf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccf8ad42150d47e6b8667e4c02f38bc2'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:10.571817 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a268169-4fc8-4b44-ac1c-bbaaef86736e admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:10.585279 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a268169-4fc8-4b44-ac1c-bbaaef86736e admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:10.592255 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-dc728419-c99d-487c-aa89-cc1de79beabf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccf8ad42150d47e6b8667e4c02f38bc2'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:10.594141 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-dc728419-c99d-487c-aa89-cc1de79beabf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccf8ad42150d47e6b8667e4c02f38bc2'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:10.595013 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cbee3b-5132-406b-8dce-ac4da9af9402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:10.595975 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cbee3b-5132-406b-8dce-ac4da9af9402 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:10.596332 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cbee3b-5132-406b-8dce-ac4da9af9402 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:10.596682 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cbee3b-5132-406b-8dce-ac4da9af9402 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:10.597514 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cbee3b-5132-406b-8dce-ac4da9af9402 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:10.604828 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-dc728419-c99d-487c-aa89-cc1de79beabf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccf8ad42150d47e6b8667e4c02f38bc2'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:10.605981 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-dc728419-c99d-487c-aa89-cc1de79beabf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccf8ad42150d47e6b8667e4c02f38bc2'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:10.614318 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cbee3b-5132-406b-8dce-ac4da9af9402 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:10.642042 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 948/1885] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:46:10 2022] DELETE /identity/v3/users/ccf8ad42150d47e6b8667e4c02f38bc2 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:10.648791 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac1139-ad0a-4b91-bd0c-c2c81697f68a None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:10.648791 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac1139-ad0a-4b91-bd0c-c2c81697f68a None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:10.648791 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac1139-ad0a-4b91-bd0c-c2c81697f68a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:10.656242 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 938/1886] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:46:10 2022] POST /identity/v3/projects => generated 383 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:46:10.660173 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cbee3b-5132-406b-8dce-ac4da9af9402 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:10.664858 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-76cbee3b-5132-406b-8dce-ac4da9af9402 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:10.677381 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-ffac1139-ad0a-4b91-bd0c-c2c81697f68a None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:10.681065 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-ffac1139-ad0a-4b91-bd0c-c2c81697f68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:10.706886 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:10.730832 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:10.791575 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cbee3b-5132-406b-8dce-ac4da9af9402 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:10.803138 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 949/1887] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:46:10.805931 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d121881f-1073-4bfe-80aa-5259276e0479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:10.806306 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d121881f-1073-4bfe-80aa-5259276e0479 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:10.806595 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d121881f-1073-4bfe-80aa-5259276e0479 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:10.807008 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d121881f-1073-4bfe-80aa-5259276e0479 admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:10.807673 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d121881f-1073-4bfe-80aa-5259276e0479 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:10.810383 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffac1139-ad0a-4b91-bd0c-c2c81697f68a None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:10.811673 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d121881f-1073-4bfe-80aa-5259276e0479 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:10.814144 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-ffac1139-ad0a-4b91-bd0c-c2c81697f68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:10.852644 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 939/1888] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:46:10 2022] POST /identity/v3/users => generated 292 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:46:10.856699 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d121881f-1073-4bfe-80aa-5259276e0479 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:10.875335 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d121881f-1073-4bfe-80aa-5259276e0479 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:10.883955 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e14908d-5e99-4cd1-a935-ee8d74402a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:10.884675 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14908d-5e99-4cd1-a935-ee8d74402a7f admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:10.885030 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14908d-5e99-4cd1-a935-ee8d74402a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:10.885518 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14908d-5e99-4cd1-a935-ee8d74402a7f admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:10.886625 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e14908d-5e99-4cd1-a935-ee8d74402a7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:10.888579 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e14908d-5e99-4cd1-a935-ee8d74402a7f admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:10.893484 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffac1139-ad0a-4b91-bd0c-c2c81697f68a None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:10.899024 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c9439-d1a7-44a6-b5aa-701ee7f72a3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:10.899813 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c9439-d1a7-44a6-b5aa-701ee7f72a3a service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:10.900194 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c9439-d1a7-44a6-b5aa-701ee7f72a3a service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:10.900613 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c9439-d1a7-44a6-b5aa-701ee7f72a3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:10.902791 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 940/1889] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:46:10 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:46:10.906741 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e14908d-5e99-4cd1-a935-ee8d74402a7f admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:10.918110 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7c9439-d1a7-44a6-b5aa-701ee7f72a3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:10.920523 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7c9439-d1a7-44a6-b5aa-701ee7f72a3a service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:10.922910 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e14908d-5e99-4cd1-a935-ee8d74402a7f admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:10.937873 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7303d6d-c276-4576-af22-cbdff043fea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:10.938513 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7303d6d-c276-4576-af22-cbdff043fea4 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:10.938791 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7303d6d-c276-4576-af22-cbdff043fea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:10.939065 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7303d6d-c276-4576-af22-cbdff043fea4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:10.939715 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7303d6d-c276-4576-af22-cbdff043fea4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:10.946404 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7303d6d-c276-4576-af22-cbdff043fea4 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:10.955189 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 950/1890] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:46:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:46:10.964248 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 941/1891] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:46:10 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:46:10.969155 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c9439-d1a7-44a6-b5aa-701ee7f72a3a service neutron] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:10.987060 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c9439-d1a7-44a6-b5aa-701ee7f72a3a service neutron] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:11.004237 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893dda0-dac1-4483-9652-ff496d1498ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:11.005513 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893dda0-dac1-4483-9652-ff496d1498ee admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:11.005884 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893dda0-dac1-4483-9652-ff496d1498ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:11.006703 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893dda0-dac1-4483-9652-ff496d1498ee admin admin] PATH_INFO: `/v3/projects/845590146e3b4495ad4d8c9187729ed7/users/2a74d6a7d2664ad59aa5e7a0d1c2194f/roles/0c67797d444d4c929b2ccab47c468848` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:11.052516 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b893dda0-dac1-4483-9652-ff496d1498ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=845590146e3b4495ad4d8c9187729ed7, user_id=2a74d6a7d2664ad59aa5e7a0d1c2194f, role_id=0c67797d444d4c929b2ccab47c468848)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:11.056523 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b893dda0-dac1-4483-9652-ff496d1498ee admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:11.092332 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 951/1892] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:46:10 2022] PUT /identity/v3/projects/845590146e3b4495ad4d8c9187729ed7/users/2a74d6a7d2664ad59aa5e7a0d1c2194f/roles/0c67797d444d4c929b2ccab47c468848 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:11.103229 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7277b6d5-5c80-4228-97e9-cc963749cc01 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:11.103764 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7277b6d5-5c80-4228-97e9-cc963749cc01 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:11.103764 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7277b6d5-5c80-4228-97e9-cc963749cc01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:11.161804 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-7277b6d5-5c80-4228-97e9-cc963749cc01 None None] MFA Rules not processed for user `2a74d6a7d2664ad59aa5e7a0d1c2194f`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:11.163064 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-7277b6d5-5c80-4228-97e9-cc963749cc01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:11.258689 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 942/1893] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:46:11.263696 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893dda0-dac1-4483-9652-ff496d1498ee admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:11.391186 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893dda0-dac1-4483-9652-ff496d1498ee admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:11.409773 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef28a71-8591-4fd9-a0d9-ac45eb0d1537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:11.410040 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef28a71-8591-4fd9-a0d9-ac45eb0d1537 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:11.410259 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef28a71-8591-4fd9-a0d9-ac45eb0d1537 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:11.410608 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef28a71-8591-4fd9-a0d9-ac45eb0d1537 admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:11.411473 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef28a71-8591-4fd9-a0d9-ac45eb0d1537 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:11.413585 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef28a71-8591-4fd9-a0d9-ac45eb0d1537 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:11.486753 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 952/1894] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:46:11 2022] POST /identity/v3/projects => generated 383 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:46:11.487406 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7277b6d5-5c80-4228-97e9-cc963749cc01 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:11.511941 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7277b6d5-5c80-4228-97e9-cc963749cc01 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:11.623579 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d23085-feb8-4b3c-8991-e1a6ccd25ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:11.624343 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d23085-feb8-4b3c-8991-e1a6ccd25ddd admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:11.624846 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d23085-feb8-4b3c-8991-e1a6ccd25ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:11.625194 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d23085-feb8-4b3c-8991-e1a6ccd25ddd admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:11.626150 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d23085-feb8-4b3c-8991-e1a6ccd25ddd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:11.628322 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d23085-feb8-4b3c-8991-e1a6ccd25ddd admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:11.659237 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 943/1895] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:46:11 2022] POST /identity/v3/users => generated 298 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:46:11.661164 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef28a71-8591-4fd9-a0d9-ac45eb0d1537 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:11.675458 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef28a71-8591-4fd9-a0d9-ac45eb0d1537 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:11.685238 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de585d3e-c418-44e9-b7a6-9a99d7d910e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:11.686811 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de585d3e-c418-44e9-b7a6-9a99d7d910e7 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:11.687494 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de585d3e-c418-44e9-b7a6-9a99d7d910e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:11.688516 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de585d3e-c418-44e9-b7a6-9a99d7d910e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:11.690027 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de585d3e-c418-44e9-b7a6-9a99d7d910e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:11.694827 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de585d3e-c418-44e9-b7a6-9a99d7d910e7 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:11.719177 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 953/1896] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:46:11 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:46:11.720840 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d23085-feb8-4b3c-8991-e1a6ccd25ddd admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:11.736541 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d23085-feb8-4b3c-8991-e1a6ccd25ddd admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:11.742779 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee7bd8b-d05c-444a-b0f6-908c4afaac0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:11.743467 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7bd8b-d05c-444a-b0f6-908c4afaac0a admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:11.743751 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7bd8b-d05c-444a-b0f6-908c4afaac0a admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:11.744100 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7bd8b-d05c-444a-b0f6-908c4afaac0a admin admin] PATH_INFO: `/v3/projects/ed9b5a3b7fcb48cdb55214f5be4c7641/users/2cc5a974e10744bbbfb7c3783d4def83/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:11.757849 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:11.769270 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de585d3e-c418-44e9-b7a6-9a99d7d910e7 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:11.773059 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-de585d3e-c418-44e9-b7a6-9a99d7d910e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:11.798604 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de585d3e-c418-44e9-b7a6-9a99d7d910e7 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:11.799689 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee7bd8b-d05c-444a-b0f6-908c4afaac0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed9b5a3b7fcb48cdb55214f5be4c7641, user_id=2cc5a974e10744bbbfb7c3783d4def83, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:11.807483 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee7bd8b-d05c-444a-b0f6-908c4afaac0a admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:11.815278 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936acea5-ba30-418d-b0ba-69f2ed26da09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:11.816471 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936acea5-ba30-418d-b0ba-69f2ed26da09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:11.816747 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936acea5-ba30-418d-b0ba-69f2ed26da09 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:11.818400 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936acea5-ba30-418d-b0ba-69f2ed26da09 admin admin] PATH_INFO: `/v3/projects/b3f47c993d5140b6a7018ce33d4ba1cf` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:11.823403 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936acea5-ba30-418d-b0ba-69f2ed26da09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3f47c993d5140b6a7018ce33d4ba1cf)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:11.825979 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936acea5-ba30-418d-b0ba-69f2ed26da09 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:11.862299 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 944/1897] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:46:11 2022] PUT /identity/v3/projects/ed9b5a3b7fcb48cdb55214f5be4c7641/users/2cc5a974e10744bbbfb7c3783d4def83/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:11.867629 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee7bd8b-d05c-444a-b0f6-908c4afaac0a admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:11.900367 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:11.961252 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-936acea5-ba30-418d-b0ba-69f2ed26da09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3f47c993d5140b6a7018ce33d4ba1cf', 'request_id': 'req-936acea5-ba30-418d-b0ba-69f2ed26da09'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:11.981658 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-936acea5-ba30-418d-b0ba-69f2ed26da09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3f47c993d5140b6a7018ce33d4ba1cf', 'request_id': 'req-936acea5-ba30-418d-b0ba-69f2ed26da09'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:11.988590 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-936acea5-ba30-418d-b0ba-69f2ed26da09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3f47c993d5140b6a7018ce33d4ba1cf', 'request_id': 'req-936acea5-ba30-418d-b0ba-69f2ed26da09'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:12.009074 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee7bd8b-d05c-444a-b0f6-908c4afaac0a admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:12.020268 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-936acea5-ba30-418d-b0ba-69f2ed26da09 admin admin] The token cache is being invalidate because project b3f47c993d5140b6a7018ce33d4ba1cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:46:12.021470 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-936acea5-ba30-418d-b0ba-69f2ed26da09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:12.022278 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-936acea5-ba30-418d-b0ba-69f2ed26da09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:12.024340 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 954/1898] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:46:11 2022] DELETE /identity/v3/projects/b3f47c993d5140b6a7018ce33d4ba1cf => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:12.028397 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936acea5-ba30-418d-b0ba-69f2ed26da09 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:12.031604 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-936acea5-ba30-418d-b0ba-69f2ed26da09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:12.104834 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b6953-f46a-4ec1-861c-5dcba8884612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:12.106122 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b6953-f46a-4ec1-861c-5dcba8884612 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:12.106330 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b6953-f46a-4ec1-861c-5dcba8884612 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:12.106755 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b6953-f46a-4ec1-861c-5dcba8884612 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:12.108150 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8b6953-f46a-4ec1-861c-5dcba8884612 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:12.110436 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8b6953-f46a-4ec1-861c-5dcba8884612 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:12.128558 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 945/1899] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:46:11 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:46:12.128782 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936acea5-ba30-418d-b0ba-69f2ed26da09 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:12.129744 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b6953-f46a-4ec1-861c-5dcba8884612 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:12.132143 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-ba8b6953-f46a-4ec1-861c-5dcba8884612 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:12.135991 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169cb0aa-6025-4ccd-ad50-41f4eeae9d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:12.138800 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169cb0aa-6025-4ccd-ad50-41f4eeae9d88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:12.139236 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169cb0aa-6025-4ccd-ad50-41f4eeae9d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:12.139520 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169cb0aa-6025-4ccd-ad50-41f4eeae9d88 admin admin] PATH_INFO: `/v3/users/8b9382230d404e6ea333cf22f221b837` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:12.140843 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169cb0aa-6025-4ccd-ad50-41f4eeae9d88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b9382230d404e6ea333cf22f221b837)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:12.142974 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169cb0aa-6025-4ccd-ad50-41f4eeae9d88 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:12.146868 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b6953-f46a-4ec1-861c-5dcba8884612 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:12.153571 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec4087-b62f-4811-8978-2d3cd814cee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:12.155077 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec4087-b62f-4811-8978-2d3cd814cee9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:12.155077 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec4087-b62f-4811-8978-2d3cd814cee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:12.155077 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec4087-b62f-4811-8978-2d3cd814cee9 admin admin] PATH_INFO: `/v3/projects/ed9b5a3b7fcb48cdb55214f5be4c7641/users/2cc5a974e10744bbbfb7c3783d4def83/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:12.157515 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ec4087-b62f-4811-8978-2d3cd814cee9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed9b5a3b7fcb48cdb55214f5be4c7641, user_id=2cc5a974e10744bbbfb7c3783d4def83, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:12.160417 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ec4087-b62f-4811-8978-2d3cd814cee9 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:12.195876 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 946/1900] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:46:12 2022] PUT /identity/v3/projects/ed9b5a3b7fcb48cdb55214f5be4c7641/users/2cc5a974e10744bbbfb7c3783d4def83/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:46:12.210402 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921200a0-8b6c-4b00-b561-6c0f8ff10abd None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:12.210707 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921200a0-8b6c-4b00-b561-6c0f8ff10abd None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:12.211088 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921200a0-8b6c-4b00-b561-6c0f8ff10abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:12.226534 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-169cb0aa-6025-4ccd-ad50-41f4eeae9d88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b9382230d404e6ea333cf22f221b837'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:12.235964 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-169cb0aa-6025-4ccd-ad50-41f4eeae9d88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b9382230d404e6ea333cf22f221b837'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:12.237082 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-169cb0aa-6025-4ccd-ad50-41f4eeae9d88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b9382230d404e6ea333cf22f221b837'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:12.247583 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-169cb0aa-6025-4ccd-ad50-41f4eeae9d88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b9382230d404e6ea333cf22f221b837'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:12.248255 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-169cb0aa-6025-4ccd-ad50-41f4eeae9d88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b9382230d404e6ea333cf22f221b837'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:12.251982 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-921200a0-8b6c-4b00-b561-6c0f8ff10abd None None] MFA Rules not processed for user `2cc5a974e10744bbbfb7c3783d4def83`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:12.253280 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-921200a0-8b6c-4b00-b561-6c0f8ff10abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:12.272283 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 955/1901] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:46:12 2022] DELETE /identity/v3/users/8b9382230d404e6ea333cf22f221b837 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:46:12.346356 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:12.357817 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 947/1902] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:12 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:46:12.366506 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169cb0aa-6025-4ccd-ad50-41f4eeae9d88 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:12.368113 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-169cb0aa-6025-4ccd-ad50-41f4eeae9d88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:12.397420 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921200a0-8b6c-4b00-b561-6c0f8ff10abd None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:12.399310 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-921200a0-8b6c-4b00-b561-6c0f8ff10abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:12.404653 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:12.444541 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169cb0aa-6025-4ccd-ad50-41f4eeae9d88 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:12.449839 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e9f14-a3bd-46f1-9064-f8f367a004d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:12.451315 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e9f14-a3bd-46f1-9064-f8f367a004d0 service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:12.451603 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e9f14-a3bd-46f1-9064-f8f367a004d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:12.452593 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e9f14-a3bd-46f1-9064-f8f367a004d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:12.453902 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-975e9f14-a3bd-46f1-9064-f8f367a004d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:12.493193 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921200a0-8b6c-4b00-b561-6c0f8ff10abd None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:12.535753 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975e9f14-a3bd-46f1-9064-f8f367a004d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:12.538017 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975e9f14-a3bd-46f1-9064-f8f367a004d0 service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:12.547940 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 956/1903] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:46:12 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:46:12.548975 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e9f14-a3bd-46f1-9064-f8f367a004d0 service cinder] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:12.550457 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-975e9f14-a3bd-46f1-9064-f8f367a004d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:12.569634 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ae2d5-92cb-4d7a-8f53-4b5ef115bfe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:12.571083 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ae2d5-92cb-4d7a-8f53-4b5ef115bfe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:12.571447 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ae2d5-92cb-4d7a-8f53-4b5ef115bfe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:12.571804 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ae2d5-92cb-4d7a-8f53-4b5ef115bfe0 admin admin] PATH_INFO: `/v3/users/190e735d158b49e888f355b9f26e80e6` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:12.575193 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418ae2d5-92cb-4d7a-8f53-4b5ef115bfe0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=190e735d158b49e888f355b9f26e80e6)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:12.577772 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418ae2d5-92cb-4d7a-8f53-4b5ef115bfe0 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:12.643407 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e9f14-a3bd-46f1-9064-f8f367a004d0 service cinder] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:12.649571 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d678e-feba-49e1-8676-264fcdf89c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:12.650240 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d678e-feba-49e1-8676-264fcdf89c60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:12.650687 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d678e-feba-49e1-8676-264fcdf89c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:12.650882 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d678e-feba-49e1-8676-264fcdf89c60 admin admin] PATH_INFO: `/v3/users/0cdcacea3e9041b0b46232d866e52134` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:12.652336 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105d678e-feba-49e1-8676-264fcdf89c60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cdcacea3e9041b0b46232d866e52134)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:12.655208 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105d678e-feba-49e1-8676-264fcdf89c60 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:12.656188 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-418ae2d5-92cb-4d7a-8f53-4b5ef115bfe0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '190e735d158b49e888f355b9f26e80e6'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:12.674621 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-418ae2d5-92cb-4d7a-8f53-4b5ef115bfe0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '190e735d158b49e888f355b9f26e80e6'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:12.677761 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-418ae2d5-92cb-4d7a-8f53-4b5ef115bfe0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '190e735d158b49e888f355b9f26e80e6'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:12.696318 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-418ae2d5-92cb-4d7a-8f53-4b5ef115bfe0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '190e735d158b49e888f355b9f26e80e6'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:12.706434 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-418ae2d5-92cb-4d7a-8f53-4b5ef115bfe0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '190e735d158b49e888f355b9f26e80e6'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:12.717229 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-105d678e-feba-49e1-8676-264fcdf89c60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cdcacea3e9041b0b46232d866e52134'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:12.717900 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 948/1904] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:46:12 2022] DELETE /identity/v3/users/190e735d158b49e888f355b9f26e80e6 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:12.718764 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ae2d5-92cb-4d7a-8f53-4b5ef115bfe0 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:12.720459 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-418ae2d5-92cb-4d7a-8f53-4b5ef115bfe0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:12.726252 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-105d678e-feba-49e1-8676-264fcdf89c60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cdcacea3e9041b0b46232d866e52134'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:12.727014 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-105d678e-feba-49e1-8676-264fcdf89c60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cdcacea3e9041b0b46232d866e52134'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:12.735242 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-105d678e-feba-49e1-8676-264fcdf89c60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cdcacea3e9041b0b46232d866e52134'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:12.736201 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-105d678e-feba-49e1-8676-264fcdf89c60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cdcacea3e9041b0b46232d866e52134'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:12.754628 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:12.759177 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:12.765800 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 957/1905] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:46:12 2022] DELETE /identity/v3/users/0cdcacea3e9041b0b46232d866e52134 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:12.768069 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4feb641-f7ce-4c27-ab51-f43129eb9f7f None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:12.768438 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4feb641-f7ce-4c27-ab51-f43129eb9f7f None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:12.768764 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4feb641-f7ce-4c27-ab51-f43129eb9f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:12.796168 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-a4feb641-f7ce-4c27-ab51-f43129eb9f7f None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:12.798317 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-a4feb641-f7ce-4c27-ab51-f43129eb9f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:12.834201 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ae2d5-92cb-4d7a-8f53-4b5ef115bfe0 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:12.909209 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02514ed6-7ff9-4bcc-9c81-b0895b6288c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:12.909893 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02514ed6-7ff9-4bcc-9c81-b0895b6288c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:12.910178 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02514ed6-7ff9-4bcc-9c81-b0895b6288c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:12.910456 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02514ed6-7ff9-4bcc-9c81-b0895b6288c7 admin admin] PATH_INFO: `/v3/projects/ac929a86692e43da835850b982ab8800` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:12.911992 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02514ed6-7ff9-4bcc-9c81-b0895b6288c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac929a86692e43da835850b982ab8800)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:12.914225 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02514ed6-7ff9-4bcc-9c81-b0895b6288c7 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:12.923988 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 958/1906] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:46:12.929984 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c1670-334d-4928-963f-3f30d3413b75 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:12.930489 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c1670-334d-4928-963f-3f30d3413b75 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:12.931004 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c1670-334d-4928-963f-3f30d3413b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:12.956422 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-ba8c1670-334d-4928-963f-3f30d3413b75 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:12.958871 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-ba8c1670-334d-4928-963f-3f30d3413b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:13.003919 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-02514ed6-7ff9-4bcc-9c81-b0895b6288c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac929a86692e43da835850b982ab8800', 'request_id': 'req-02514ed6-7ff9-4bcc-9c81-b0895b6288c7'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:13.024151 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-02514ed6-7ff9-4bcc-9c81-b0895b6288c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac929a86692e43da835850b982ab8800', 'request_id': 'req-02514ed6-7ff9-4bcc-9c81-b0895b6288c7'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:13.061197 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-02514ed6-7ff9-4bcc-9c81-b0895b6288c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac929a86692e43da835850b982ab8800', 'request_id': 'req-02514ed6-7ff9-4bcc-9c81-b0895b6288c7'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:13.077876 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-02514ed6-7ff9-4bcc-9c81-b0895b6288c7 admin admin] The token cache is being invalidate because project ac929a86692e43da835850b982ab8800 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:46:13.078175 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-02514ed6-7ff9-4bcc-9c81-b0895b6288c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:13.080191 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-02514ed6-7ff9-4bcc-9c81-b0895b6288c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:13.085956 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 949/1907] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:46:12 2022] DELETE /identity/v3/projects/ac929a86692e43da835850b982ab8800 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:13.085956 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02514ed6-7ff9-4bcc-9c81-b0895b6288c7 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:13.086699 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-02514ed6-7ff9-4bcc-9c81-b0895b6288c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:13.093078 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 959/1908] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:46:13.096395 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2eb1d-c74d-4022-a80d-4f8c0321b385 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:13.096395 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2eb1d-c74d-4022-a80d-4f8c0321b385 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:13.096395 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2eb1d-c74d-4022-a80d-4f8c0321b385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:13.120823 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-6ac2eb1d-c74d-4022-a80d-4f8c0321b385 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:13.121722 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-6ac2eb1d-c74d-4022-a80d-4f8c0321b385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:13.158611 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 960/1909] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:46:13.158611 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac2eb1d-c74d-4022-a80d-4f8c0321b385 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:13.158611 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-6ac2eb1d-c74d-4022-a80d-4f8c0321b385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:13.208518 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02514ed6-7ff9-4bcc-9c81-b0895b6288c7 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:13.212905 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9610cb6-7776-4c8a-a4fb-5eb3e6362428 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:13.213563 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9610cb6-7776-4c8a-a4fb-5eb3e6362428 service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:13.213842 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9610cb6-7776-4c8a-a4fb-5eb3e6362428 service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:13.214109 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9610cb6-7776-4c8a-a4fb-5eb3e6362428 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:13.216076 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-a9610cb6-7776-4c8a-a4fb-5eb3e6362428 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:13.229561 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9610cb6-7776-4c8a-a4fb-5eb3e6362428 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:13.231014 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9610cb6-7776-4c8a-a4fb-5eb3e6362428 service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:13.256389 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 950/1910] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:46:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:46:13.259317 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130883f7-bfc1-4495-a7fa-2e82112192a0 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:13.259650 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130883f7-bfc1-4495-a7fa-2e82112192a0 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:13.259894 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130883f7-bfc1-4495-a7fa-2e82112192a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:13.267617 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac2eb1d-c74d-4022-a80d-4f8c0321b385 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:13.273814 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2432bcb6-ec48-4fec-8a4f-aa8be7855d78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:13.275453 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432bcb6-ec48-4fec-8a4f-aa8be7855d78 service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:13.276154 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432bcb6-ec48-4fec-8a4f-aa8be7855d78 service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:13.276628 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432bcb6-ec48-4fec-8a4f-aa8be7855d78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:13.286467 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:13.291396 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2432bcb6-ec48-4fec-8a4f-aa8be7855d78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:13.293852 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2432bcb6-ec48-4fec-8a4f-aa8be7855d78 service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:13.304705 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-130883f7-bfc1-4495-a7fa-2e82112192a0 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:13.306637 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-130883f7-bfc1-4495-a7fa-2e82112192a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:13.308758 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 961/1911] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:46:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:46:13.315519 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 951/1912] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:46:13.321487 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2432bcb6-ec48-4fec-8a4f-aa8be7855d78 service neutron] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:13.332673 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2432bcb6-ec48-4fec-8a4f-aa8be7855d78 service neutron] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:13.338702 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7446779-1462-49a2-8173-3132cd39e2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:13.339458 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7446779-1462-49a2-8173-3132cd39e2b5 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:13.339808 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7446779-1462-49a2-8173-3132cd39e2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:13.340150 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7446779-1462-49a2-8173-3132cd39e2b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:13.340888 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7446779-1462-49a2-8173-3132cd39e2b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:46:13.341259 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7446779-1462-49a2-8173-3132cd39e2b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:13.343007 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7446779-1462-49a2-8173-3132cd39e2b5 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:13.360591 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 962/1913] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Aug 29 22:46:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:46:13.365053 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130883f7-bfc1-4495-a7fa-2e82112192a0 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:13.375586 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130883f7-bfc1-4495-a7fa-2e82112192a0 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:13.381167 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2447a0-3d4d-47f2-9099-7faf1cd815d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:13.382030 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2447a0-3d4d-47f2-9099-7faf1cd815d1 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:13.382366 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2447a0-3d4d-47f2-9099-7faf1cd815d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:13.382687 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2447a0-3d4d-47f2-9099-7faf1cd815d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:13.383606 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2447a0-3d4d-47f2-9099-7faf1cd815d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:13.385862 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2447a0-3d4d-47f2-9099-7faf1cd815d1 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:13.423821 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 952/1914] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:46:13 2022] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:46:13.425284 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7446779-1462-49a2-8173-3132cd39e2b5 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:13.438313 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7446779-1462-49a2-8173-3132cd39e2b5 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:13.465193 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:13.513065 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b90e16c-dd75-414c-8301-1e25b52801e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:13.513939 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90e16c-dd75-414c-8301-1e25b52801e8 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:13.514509 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90e16c-dd75-414c-8301-1e25b52801e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:13.514509 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90e16c-dd75-414c-8301-1e25b52801e8 admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:13.515716 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b90e16c-dd75-414c-8301-1e25b52801e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:13.518664 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b90e16c-dd75-414c-8301-1e25b52801e8 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:13.563364 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 963/1915] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:46:13 2022] POST /identity/v3/users => generated 289 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:46:13.567563 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2447a0-3d4d-47f2-9099-7faf1cd815d1 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:13.581886 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2447a0-3d4d-47f2-9099-7faf1cd815d1 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:13.588331 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127b1785-53fb-4cd9-9931-d482324ea39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:13.589224 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b1785-53fb-4cd9-9931-d482324ea39a admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:13.589521 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b1785-53fb-4cd9-9931-d482324ea39a admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:13.589865 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b1785-53fb-4cd9-9931-d482324ea39a admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:13.591036 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127b1785-53fb-4cd9-9931-d482324ea39a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:13.592950 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127b1785-53fb-4cd9-9931-d482324ea39a admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:13.619117 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 953/1916] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:46:13 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:46:13.623915 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b90e16c-dd75-414c-8301-1e25b52801e8 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:13.638121 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b90e16c-dd75-414c-8301-1e25b52801e8 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:13.644614 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b36e8a-5c46-474d-942d-bfbadd537723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:13.645282 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b36e8a-5c46-474d-942d-bfbadd537723 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:13.645747 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b36e8a-5c46-474d-942d-bfbadd537723 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:13.646268 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b36e8a-5c46-474d-942d-bfbadd537723 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:13.647099 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b36e8a-5c46-474d-942d-bfbadd537723 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:13.648794 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b36e8a-5c46-474d-942d-bfbadd537723 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:13.670683 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 964/1917] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:46:13 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:46:13.672498 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127b1785-53fb-4cd9-9931-d482324ea39a admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:13.688982 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127b1785-53fb-4cd9-9931-d482324ea39a admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:13.697180 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a7c93e-d1db-4d55-991f-941196a9e19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:13.698803 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7c93e-d1db-4d55-991f-941196a9e19c admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:13.699095 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7c93e-d1db-4d55-991f-941196a9e19c admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:13.699431 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7c93e-d1db-4d55-991f-941196a9e19c admin admin] PATH_INFO: `/v3/projects/a14591886c814f59abd9aae40ecaf3de/users/1848e9b64d824863bd726a3df3a280b4/roles/0c67797d444d4c929b2ccab47c468848` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:13.719924 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a7c93e-d1db-4d55-991f-941196a9e19c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a14591886c814f59abd9aae40ecaf3de, user_id=1848e9b64d824863bd726a3df3a280b4, role_id=0c67797d444d4c929b2ccab47c468848)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:13.722739 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a7c93e-d1db-4d55-991f-941196a9e19c admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:13.754674 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 954/1918] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:46:13 2022] PUT /identity/v3/projects/a14591886c814f59abd9aae40ecaf3de/users/1848e9b64d824863bd726a3df3a280b4/roles/0c67797d444d4c929b2ccab47c468848 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:46:13.757931 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be485f59-f086-4ea6-83e0-2a65abc87bf2 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:13.758600 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be485f59-f086-4ea6-83e0-2a65abc87bf2 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:13.759007 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be485f59-f086-4ea6-83e0-2a65abc87bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:13.798065 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-be485f59-f086-4ea6-83e0-2a65abc87bf2 None None] MFA Rules not processed for user `1848e9b64d824863bd726a3df3a280b4`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:13.800318 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-be485f59-f086-4ea6-83e0-2a65abc87bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:13.885294 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 965/1919] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:46:13.899254 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a7c93e-d1db-4d55-991f-941196a9e19c admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:13.900740 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-13a7c93e-d1db-4d55-991f-941196a9e19c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:13.967458 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be485f59-f086-4ea6-83e0-2a65abc87bf2 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:13.969127 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-be485f59-f086-4ea6-83e0-2a65abc87bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:14.011307 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a7c93e-d1db-4d55-991f-941196a9e19c admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:14.015369 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98832f88-79e9-41fc-8364-8b596ad95674 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5c4e692fd714354b96bd3ef4fcecdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:14.015995 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98832f88-79e9-41fc-8364-8b596ad95674 service glance] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:14.016275 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98832f88-79e9-41fc-8364-8b596ad95674 service glance] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:14.016617 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98832f88-79e9-41fc-8364-8b596ad95674 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:14.028134 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98832f88-79e9-41fc-8364-8b596ad95674 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:14.030296 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98832f88-79e9-41fc-8364-8b596ad95674 service glance] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:14.047227 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 955/1920] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:46:13 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:46:14.078170 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be485f59-f086-4ea6-83e0-2a65abc87bf2 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:14.085556 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b526da9-a99c-47a6-bc62-52c73d65b55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:14.086199 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b526da9-a99c-47a6-bc62-52c73d65b55a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:14.086465 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b526da9-a99c-47a6-bc62-52c73d65b55a admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:14.086736 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b526da9-a99c-47a6-bc62-52c73d65b55a admin admin] PATH_INFO: `/v3/projects/933ea8647f9f4bc6a4e88a82b3f745d5` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:14.088254 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b526da9-a99c-47a6-bc62-52c73d65b55a admin admin] RBAC: Authorizing `identity:delete_project(project_id=933ea8647f9f4bc6a4e88a82b3f745d5)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:14.090417 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b526da9-a99c-47a6-bc62-52c73d65b55a admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:14.160048 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:14.198903 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-6b526da9-a99c-47a6-bc62-52c73d65b55a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '933ea8647f9f4bc6a4e88a82b3f745d5', 'request_id': 'req-6b526da9-a99c-47a6-bc62-52c73d65b55a'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:14.214413 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-6b526da9-a99c-47a6-bc62-52c73d65b55a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '933ea8647f9f4bc6a4e88a82b3f745d5', 'request_id': 'req-6b526da9-a99c-47a6-bc62-52c73d65b55a'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:14.233862 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-6b526da9-a99c-47a6-bc62-52c73d65b55a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '933ea8647f9f4bc6a4e88a82b3f745d5', 'request_id': 'req-6b526da9-a99c-47a6-bc62-52c73d65b55a'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:14.260967 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-6b526da9-a99c-47a6-bc62-52c73d65b55a admin admin] The token cache is being invalidate because project 933ea8647f9f4bc6a4e88a82b3f745d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:46:14.261286 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-6b526da9-a99c-47a6-bc62-52c73d65b55a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:14.263135 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-6b526da9-a99c-47a6-bc62-52c73d65b55a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:14.272749 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 966/1921] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:46:13 2022] DELETE /identity/v3/projects/933ea8647f9f4bc6a4e88a82b3f745d5 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:14.272961 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98832f88-79e9-41fc-8364-8b596ad95674 service glance] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:14.289193 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98832f88-79e9-41fc-8364-8b596ad95674 service glance] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:14.312594 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b526da9-a99c-47a6-bc62-52c73d65b55a admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:14.314102 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-6b526da9-a99c-47a6-bc62-52c73d65b55a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:14.474343 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b526da9-a99c-47a6-bc62-52c73d65b55a admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:14.479130 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb017e3-6148-4e21-9020-4a5c5ff3e838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:14.479737 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb017e3-6148-4e21-9020-4a5c5ff3e838 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:14.480026 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb017e3-6148-4e21-9020-4a5c5ff3e838 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:14.480309 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb017e3-6148-4e21-9020-4a5c5ff3e838 admin admin] PATH_INFO: `/v3/users/d77aacbdeb764150b8d1ded105286ea8` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:14.481852 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb017e3-6148-4e21-9020-4a5c5ff3e838 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d77aacbdeb764150b8d1ded105286ea8)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:14.484213 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb017e3-6148-4e21-9020-4a5c5ff3e838 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:14.492297 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ddeda-5732-410d-a987-7d3a028f08b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:14.492956 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ddeda-5732-410d-a987-7d3a028f08b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:14.493240 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ddeda-5732-410d-a987-7d3a028f08b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:14.493543 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ddeda-5732-410d-a987-7d3a028f08b6 admin admin] PATH_INFO: `/v3/projects/d5af490cf6cd4b7ca8ee747cce5a011a` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:14.495126 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ddeda-5732-410d-a987-7d3a028f08b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5af490cf6cd4b7ca8ee747cce5a011a)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:14.498648 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ddeda-5732-410d-a987-7d3a028f08b6 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:14.526234 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:14.564749 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-fcb017e3-6148-4e21-9020-4a5c5ff3e838 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd77aacbdeb764150b8d1ded105286ea8'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:14.575189 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-fcb017e3-6148-4e21-9020-4a5c5ff3e838 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd77aacbdeb764150b8d1ded105286ea8'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:14.576721 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-fcb017e3-6148-4e21-9020-4a5c5ff3e838 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd77aacbdeb764150b8d1ded105286ea8'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:14.597160 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-fcb017e3-6148-4e21-9020-4a5c5ff3e838 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd77aacbdeb764150b8d1ded105286ea8'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:14.606716 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-a87ddeda-5732-410d-a987-7d3a028f08b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5af490cf6cd4b7ca8ee747cce5a011a', 'request_id': 'req-a87ddeda-5732-410d-a987-7d3a028f08b6'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:14.611019 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-fcb017e3-6148-4e21-9020-4a5c5ff3e838 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd77aacbdeb764150b8d1ded105286ea8'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:14.618515 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-a87ddeda-5732-410d-a987-7d3a028f08b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5af490cf6cd4b7ca8ee747cce5a011a', 'request_id': 'req-a87ddeda-5732-410d-a987-7d3a028f08b6'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:14.624804 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 956/1922] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:46:14 2022] DELETE /identity/v3/users/d77aacbdeb764150b8d1ded105286ea8 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:14.632385 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-a87ddeda-5732-410d-a987-7d3a028f08b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5af490cf6cd4b7ca8ee747cce5a011a', 'request_id': 'req-a87ddeda-5732-410d-a987-7d3a028f08b6'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:14.664759 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-a87ddeda-5732-410d-a987-7d3a028f08b6 admin admin] The token cache is being invalidate because project d5af490cf6cd4b7ca8ee747cce5a011a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:46:14.665609 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-a87ddeda-5732-410d-a987-7d3a028f08b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:14.667098 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-a87ddeda-5732-410d-a987-7d3a028f08b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:14.669643 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 967/1923] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:46:14 2022] DELETE /identity/v3/projects/d5af490cf6cd4b7ca8ee747cce5a011a => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:14.674288 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb017e3-6148-4e21-9020-4a5c5ff3e838 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:14.677356 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-fcb017e3-6148-4e21-9020-4a5c5ff3e838 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:14.867912 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb017e3-6148-4e21-9020-4a5c5ff3e838 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:14.875265 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7db977c-05ec-4937-9b69-f3e702c67ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:14.875920 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db977c-05ec-4937-9b69-f3e702c67ee9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:14.876200 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db977c-05ec-4937-9b69-f3e702c67ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:14.876477 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db977c-05ec-4937-9b69-f3e702c67ee9 admin admin] PATH_INFO: `/v3/users/2d4e218f099d4a1aaa8f672b764dfe9a` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:14.877719 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7db977c-05ec-4937-9b69-f3e702c67ee9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d4e218f099d4a1aaa8f672b764dfe9a)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:14.879685 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7db977c-05ec-4937-9b69-f3e702c67ee9 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:14.949058 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-f7db977c-05ec-4937-9b69-f3e702c67ee9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d4e218f099d4a1aaa8f672b764dfe9a'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:14.964287 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-f7db977c-05ec-4937-9b69-f3e702c67ee9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d4e218f099d4a1aaa8f672b764dfe9a'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:14.965084 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-f7db977c-05ec-4937-9b69-f3e702c67ee9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d4e218f099d4a1aaa8f672b764dfe9a'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:14.987199 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-f7db977c-05ec-4937-9b69-f3e702c67ee9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d4e218f099d4a1aaa8f672b764dfe9a'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:15.002558 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-f7db977c-05ec-4937-9b69-f3e702c67ee9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d4e218f099d4a1aaa8f672b764dfe9a'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:15.012484 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 957/1924] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:46:14 2022] DELETE /identity/v3/users/2d4e218f099d4a1aaa8f672b764dfe9a => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:15.221028 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ddeda-5732-410d-a987-7d3a028f08b6 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:15.222502 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-a87ddeda-5732-410d-a987-7d3a028f08b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:15.336651 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:15.363182 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ddeda-5732-410d-a987-7d3a028f08b6 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:15.442749 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7db977c-05ec-4937-9b69-f3e702c67ee9 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:15.446138 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-f7db977c-05ec-4937-9b69-f3e702c67ee9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:15.459552 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57609f80-e4af-441b-b0c4-3190c4cbf6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:15.460229 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57609f80-e4af-441b-b0c4-3190c4cbf6e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:15.460521 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57609f80-e4af-441b-b0c4-3190c4cbf6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:15.460790 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57609f80-e4af-441b-b0c4-3190c4cbf6e7 admin admin] PATH_INFO: `/v3/projects/498c6f8bc67d4be1a65d94f6e8e9f96d` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:15.462207 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57609f80-e4af-441b-b0c4-3190c4cbf6e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=498c6f8bc67d4be1a65d94f6e8e9f96d)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:15.464471 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57609f80-e4af-441b-b0c4-3190c4cbf6e7 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:15.498282 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:15.569444 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-57609f80-e4af-441b-b0c4-3190c4cbf6e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '498c6f8bc67d4be1a65d94f6e8e9f96d', 'request_id': 'req-57609f80-e4af-441b-b0c4-3190c4cbf6e7'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:15.587484 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-57609f80-e4af-441b-b0c4-3190c4cbf6e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '498c6f8bc67d4be1a65d94f6e8e9f96d', 'request_id': 'req-57609f80-e4af-441b-b0c4-3190c4cbf6e7'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:15.611238 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7db977c-05ec-4937-9b69-f3e702c67ee9 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:15.617248 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-57609f80-e4af-441b-b0c4-3190c4cbf6e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '498c6f8bc67d4be1a65d94f6e8e9f96d', 'request_id': 'req-57609f80-e4af-441b-b0c4-3190c4cbf6e7'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:15.684833 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-57609f80-e4af-441b-b0c4-3190c4cbf6e7 admin admin] The token cache is being invalidate because project 498c6f8bc67d4be1a65d94f6e8e9f96d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:46:15.685196 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-57609f80-e4af-441b-b0c4-3190c4cbf6e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:15.688958 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-57609f80-e4af-441b-b0c4-3190c4cbf6e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:15.694705 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 968/1925] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:46:15 2022] DELETE /identity/v3/projects/498c6f8bc67d4be1a65d94f6e8e9f96d => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:15.696578 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859721b-d611-470f-b925-bb41323c3d43 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:15.696946 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859721b-d611-470f-b925-bb41323c3d43 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:15.697293 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859721b-d611-470f-b925-bb41323c3d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:15.726876 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-e859721b-d611-470f-b925-bb41323c3d43 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:15.731549 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-e859721b-d611-470f-b925-bb41323c3d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:15.736154 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821263e7-632c-493d-a054-40b0826abf28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:15.736839 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821263e7-632c-493d-a054-40b0826abf28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:15.737128 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821263e7-632c-493d-a054-40b0826abf28 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:15.737455 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821263e7-632c-493d-a054-40b0826abf28 admin admin] PATH_INFO: `/v3/projects/0837dedb7b3f4af08d340cc62320c2b1` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:15.738688 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821263e7-632c-493d-a054-40b0826abf28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0837dedb7b3f4af08d340cc62320c2b1)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:15.740755 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821263e7-632c-493d-a054-40b0826abf28 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:15.749176 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 969/1926] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:46:15.751281 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24109044-2fcc-4db3-8070-bd5076cb1f34 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:15.751856 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24109044-2fcc-4db3-8070-bd5076cb1f34 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:15.752403 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24109044-2fcc-4db3-8070-bd5076cb1f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:15.775705 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-24109044-2fcc-4db3-8070-bd5076cb1f34 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:15.776955 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-24109044-2fcc-4db3-8070-bd5076cb1f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:15.785726 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 970/1927] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:46:15.790353 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24109044-2fcc-4db3-8070-bd5076cb1f34 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:15.796723 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-821263e7-632c-493d-a054-40b0826abf28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0837dedb7b3f4af08d340cc62320c2b1', 'request_id': 'req-821263e7-632c-493d-a054-40b0826abf28'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:15.799369 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24109044-2fcc-4db3-8070-bd5076cb1f34 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:15.803835 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-821263e7-632c-493d-a054-40b0826abf28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0837dedb7b3f4af08d340cc62320c2b1', 'request_id': 'req-821263e7-632c-493d-a054-40b0826abf28'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:15.809572 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-821263e7-632c-493d-a054-40b0826abf28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0837dedb7b3f4af08d340cc62320c2b1', 'request_id': 'req-821263e7-632c-493d-a054-40b0826abf28'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:15.824548 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-821263e7-632c-493d-a054-40b0826abf28 admin admin] The token cache is being invalidate because project 0837dedb7b3f4af08d340cc62320c2b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:46:15.824854 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-821263e7-632c-493d-a054-40b0826abf28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:15.825545 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-821263e7-632c-493d-a054-40b0826abf28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:15.831364 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 958/1928] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:46:15 2022] DELETE /identity/v3/projects/0837dedb7b3f4af08d340cc62320c2b1 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:15.832907 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f0b847-f211-48ba-8c69-bb5f8b4a7fc8 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:15.833262 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f0b847-f211-48ba-8c69-bb5f8b4a7fc8 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:15.833635 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f0b847-f211-48ba-8c69-bb5f8b4a7fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:15.856465 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-f3f0b847-f211-48ba-8c69-bb5f8b4a7fc8 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:15.858161 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-f3f0b847-f211-48ba-8c69-bb5f8b4a7fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:15.894249 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e7678-f488-4bf7-910e-dde0df2dae9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:15.894907 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e7678-f488-4bf7-910e-dde0df2dae9f admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:15.895259 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e7678-f488-4bf7-910e-dde0df2dae9f admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:15.895420 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e7678-f488-4bf7-910e-dde0df2dae9f admin admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:15.896390 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34e7678-f488-4bf7-910e-dde0df2dae9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:46:15.896687 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34e7678-f488-4bf7-910e-dde0df2dae9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:15.898338 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34e7678-f488-4bf7-910e-dde0df2dae9f admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:15.922560 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 971/1929] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Aug 29 22:46:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:46:15.923731 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e7678-f488-4bf7-910e-dde0df2dae9f admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:15.925731 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-c34e7678-f488-4bf7-910e-dde0df2dae9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:15.977910 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e7678-f488-4bf7-910e-dde0df2dae9f admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:15.979904 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:15.986367 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e117ea0b-1e11-4730-afad-154edce17f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:15.987847 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117ea0b-1e11-4730-afad-154edce17f76 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:15.987847 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117ea0b-1e11-4730-afad-154edce17f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:15.988055 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117ea0b-1e11-4730-afad-154edce17f76 admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:15.988696 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e117ea0b-1e11-4730-afad-154edce17f76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:15.994865 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e117ea0b-1e11-4730-afad-154edce17f76 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:16.005659 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 959/1930] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:46:16.012068 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:16.022128 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220a82bd-4793-4408-add3-a6cebc50b0ed None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:16.022128 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220a82bd-4793-4408-add3-a6cebc50b0ed None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:16.022128 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220a82bd-4793-4408-add3-a6cebc50b0ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:16.054521 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-220a82bd-4793-4408-add3-a6cebc50b0ed None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:16.055823 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-220a82bd-4793-4408-add3-a6cebc50b0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:16.062526 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 972/1931] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:46:15 2022] POST /identity/v3/projects => generated 387 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:46:16.065398 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e117ea0b-1e11-4730-afad-154edce17f76 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:16.147441 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 960/1932] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:46:16.152950 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220a82bd-4793-4408-add3-a6cebc50b0ed None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:16.169968 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220a82bd-4793-4408-add3-a6cebc50b0ed None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:16.177521 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1948e814-7d72-476c-9d26-1b965250b704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:16.178482 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948e814-7d72-476c-9d26-1b965250b704 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:16.179090 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948e814-7d72-476c-9d26-1b965250b704 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:16.179090 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948e814-7d72-476c-9d26-1b965250b704 admin admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:16.179622 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e117ea0b-1e11-4730-afad-154edce17f76 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:16.179751 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1948e814-7d72-476c-9d26-1b965250b704 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:46:16.180157 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1948e814-7d72-476c-9d26-1b965250b704 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:16.182118 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1948e814-7d72-476c-9d26-1b965250b704 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:16.187020 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1095c95e-42c7-430f-99dc-2e9d9205cdb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:16.187936 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095c95e-42c7-430f-99dc-2e9d9205cdb1 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:16.188304 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095c95e-42c7-430f-99dc-2e9d9205cdb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:16.188651 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095c95e-42c7-430f-99dc-2e9d9205cdb1 admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:16.189412 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1095c95e-42c7-430f-99dc-2e9d9205cdb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:16.191924 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1095c95e-42c7-430f-99dc-2e9d9205cdb1 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:16.202590 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 961/1933] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Aug 29 22:46:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:46:16.210370 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1948e814-7d72-476c-9d26-1b965250b704 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:16.234099 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 973/1934] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:46:16 2022] POST /identity/v3/users => generated 294 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:46:16.234399 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1948e814-7d72-476c-9d26-1b965250b704 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:16.234510 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1095c95e-42c7-430f-99dc-2e9d9205cdb1 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:16.241228 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9028dc9d-9c18-4ae3-ad14-66dfec4c1fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:16.242256 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9028dc9d-9c18-4ae3-ad14-66dfec4c1fd0 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:16.242877 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9028dc9d-9c18-4ae3-ad14-66dfec4c1fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:16.243539 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9028dc9d-9c18-4ae3-ad14-66dfec4c1fd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:16.244858 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9028dc9d-9c18-4ae3-ad14-66dfec4c1fd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:16.247763 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9028dc9d-9c18-4ae3-ad14-66dfec4c1fd0 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:16.249945 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1095c95e-42c7-430f-99dc-2e9d9205cdb1 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:16.256609 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048408b7-b3f0-4d51-bf8f-6da0fb654ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:16.257282 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048408b7-b3f0-4d51-bf8f-6da0fb654ce8 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:16.257580 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048408b7-b3f0-4d51-bf8f-6da0fb654ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:16.257900 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048408b7-b3f0-4d51-bf8f-6da0fb654ce8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:16.258942 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048408b7-b3f0-4d51-bf8f-6da0fb654ce8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:16.260639 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048408b7-b3f0-4d51-bf8f-6da0fb654ce8 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:16.281393 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 974/1935] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:46:16 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:46:16.285285 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048408b7-b3f0-4d51-bf8f-6da0fb654ce8 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:16.302466 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 962/1936] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:46:16 2022] POST /identity/v3/projects => generated 381 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:46:16.312418 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048408b7-b3f0-4d51-bf8f-6da0fb654ce8 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:16.315861 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9028dc9d-9c18-4ae3-ad14-66dfec4c1fd0 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:16.469560 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b57a69-696b-45a5-8b09-c233b60823b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:16.470518 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b57a69-696b-45a5-8b09-c233b60823b2 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:16.471055 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b57a69-696b-45a5-8b09-c233b60823b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:16.471486 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b57a69-696b-45a5-8b09-c233b60823b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:16.472555 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b57a69-696b-45a5-8b09-c233b60823b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:16.475465 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b57a69-696b-45a5-8b09-c233b60823b2 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:16.481634 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9028dc9d-9c18-4ae3-ad14-66dfec4c1fd0 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:16.490802 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1125f6be-c936-440b-a4d9-b7225c7a2b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:16.491436 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 975/1937] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:46:16 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:46:16.491794 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1125f6be-c936-440b-a4d9-b7225c7a2b79 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:16.492142 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1125f6be-c936-440b-a4d9-b7225c7a2b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:16.492487 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1125f6be-c936-440b-a4d9-b7225c7a2b79 admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:16.493316 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1125f6be-c936-440b-a4d9-b7225c7a2b79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:16.495150 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b57a69-696b-45a5-8b09-c233b60823b2 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:16.495797 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1125f6be-c936-440b-a4d9-b7225c7a2b79 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:16.512191 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b57a69-696b-45a5-8b09-c233b60823b2 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:16.528072 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a88385f-9393-4b65-99f4-66454110c631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:16.528920 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88385f-9393-4b65-99f4-66454110c631 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:16.529807 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88385f-9393-4b65-99f4-66454110c631 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:16.530341 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88385f-9393-4b65-99f4-66454110c631 admin admin] PATH_INFO: `/v3/projects/af8493dadec24a57a261e2c0fed36bc3/users/4f5db3b529a642938ab3fd69cf3f4f9c/roles/0c67797d444d4c929b2ccab47c468848` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:16.552721 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 963/1938] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:46:16 2022] POST /identity/v3/users => generated 291 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:46:16.557434 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1125f6be-c936-440b-a4d9-b7225c7a2b79 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:16.558421 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a88385f-9393-4b65-99f4-66454110c631 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af8493dadec24a57a261e2c0fed36bc3, user_id=4f5db3b529a642938ab3fd69cf3f4f9c, role_id=0c67797d444d4c929b2ccab47c468848)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:16.561124 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a88385f-9393-4b65-99f4-66454110c631 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:16.576899 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1125f6be-c936-440b-a4d9-b7225c7a2b79 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:16.582872 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3e75e4-c49f-4f2e-b860-738b30f4eb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:16.583603 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e75e4-c49f-4f2e-b860-738b30f4eb37 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:16.583918 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e75e4-c49f-4f2e-b860-738b30f4eb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:16.584195 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e75e4-c49f-4f2e-b860-738b30f4eb37 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:16.584911 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3e75e4-c49f-4f2e-b860-738b30f4eb37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:16.586878 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3e75e4-c49f-4f2e-b860-738b30f4eb37 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:16.605764 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 976/1939] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:46:16 2022] PUT /identity/v3/projects/af8493dadec24a57a261e2c0fed36bc3/users/4f5db3b529a642938ab3fd69cf3f4f9c/roles/0c67797d444d4c929b2ccab47c468848 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:46:16.616275 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfeb255-56e6-4f0e-94ed-255ec7c4b7dd None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:16.616687 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfeb255-56e6-4f0e-94ed-255ec7c4b7dd None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:16.617202 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfeb255-56e6-4f0e-94ed-255ec7c4b7dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:16.622354 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 964/1940] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:46:16 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:46:16.631305 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3e75e4-c49f-4f2e-b860-738b30f4eb37 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:16.655151 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3e75e4-c49f-4f2e-b860-738b30f4eb37 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:16.693892 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-1cfeb255-56e6-4f0e-94ed-255ec7c4b7dd None None] MFA Rules not processed for user `4f5db3b529a642938ab3fd69cf3f4f9c`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:16.695143 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-1cfeb255-56e6-4f0e-94ed-255ec7c4b7dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:16.716797 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:16.739431 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00397d62-6e53-4111-bbab-259fc48427ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:16.740619 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00397d62-6e53-4111-bbab-259fc48427ca admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:16.740903 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00397d62-6e53-4111-bbab-259fc48427ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:16.741180 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00397d62-6e53-4111-bbab-259fc48427ca admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:16.741956 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00397d62-6e53-4111-bbab-259fc48427ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:16.743669 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00397d62-6e53-4111-bbab-259fc48427ca admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:16.748618 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:16.780246 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 965/1941] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:46:16 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:46:16.783878 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00397d62-6e53-4111-bbab-259fc48427ca admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:16.809543 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00397d62-6e53-4111-bbab-259fc48427ca admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:16.815464 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 977/1942] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:16 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:46:16.817052 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfeb255-56e6-4f0e-94ed-255ec7c4b7dd None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:16.825703 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9aa09e-b18c-49df-a6fe-346cb6527b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:16.826579 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9aa09e-b18c-49df-a6fe-346cb6527b71 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:16.826846 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9aa09e-b18c-49df-a6fe-346cb6527b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:16.827716 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9aa09e-b18c-49df-a6fe-346cb6527b71 admin admin] PATH_INFO: `/v3/projects/38691e86d7b94b7c810e26e78725fb1a/users/52d4c7af4dd04f32b3950a8893765979/roles/0c67797d444d4c929b2ccab47c468848` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:16.837038 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfeb255-56e6-4f0e-94ed-255ec7c4b7dd None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:16.845613 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab489372-35d4-4ab8-97a9-f745aec53ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:16.847113 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab489372-35d4-4ab8-97a9-f745aec53ad8 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:16.847465 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab489372-35d4-4ab8-97a9-f745aec53ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:16.848036 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab489372-35d4-4ab8-97a9-f745aec53ad8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:16.848929 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab489372-35d4-4ab8-97a9-f745aec53ad8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:16.851770 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab489372-35d4-4ab8-97a9-f745aec53ad8 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:16.856717 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9aa09e-b18c-49df-a6fe-346cb6527b71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38691e86d7b94b7c810e26e78725fb1a, user_id=52d4c7af4dd04f32b3950a8893765979, role_id=0c67797d444d4c929b2ccab47c468848)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:16.865580 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9aa09e-b18c-49df-a6fe-346cb6527b71 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:16.893651 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 966/1943] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:46:16 2022] PUT /identity/v3/projects/38691e86d7b94b7c810e26e78725fb1a/users/52d4c7af4dd04f32b3950a8893765979/roles/0c67797d444d4c929b2ccab47c468848 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:16.899153 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 978/1944] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:46:16 2022] POST /identity/v3/projects => generated 385 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:46:16.900003 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9aa09e-b18c-49df-a6fe-346cb6527b71 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:16.905532 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e7a30-af2b-43d4-954f-0caf394de64e None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:16.905881 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e7a30-af2b-43d4-954f-0caf394de64e None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:16.907241 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e7a30-af2b-43d4-954f-0caf394de64e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:16.945554 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-289e7a30-af2b-43d4-954f-0caf394de64e None None] MFA Rules not processed for user `52d4c7af4dd04f32b3950a8893765979`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:16.946838 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-289e7a30-af2b-43d4-954f-0caf394de64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:17.011855 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9aa09e-b18c-49df-a6fe-346cb6527b71 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:17.053384 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 979/1945] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:46:17.055756 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289e7a30-af2b-43d4-954f-0caf394de64e None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:17.102498 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d75ed4-70ba-4561-87c5-a43b6c1a3e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:17.102498 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d75ed4-70ba-4561-87c5-a43b6c1a3e5f admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:17.102498 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d75ed4-70ba-4561-87c5-a43b6c1a3e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:17.102498 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d75ed4-70ba-4561-87c5-a43b6c1a3e5f admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:17.102801 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d75ed4-70ba-4561-87c5-a43b6c1a3e5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:17.103899 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d75ed4-70ba-4561-87c5-a43b6c1a3e5f admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:17.136373 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 967/1946] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:46:16 2022] POST /identity/v3/users => generated 299 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:46:17.140948 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d75ed4-70ba-4561-87c5-a43b6c1a3e5f admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:17.159187 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d75ed4-70ba-4561-87c5-a43b6c1a3e5f admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:17.164359 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb36db0-7824-4f8f-bea1-f82cbf9bb17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:17.165124 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb36db0-7824-4f8f-bea1-f82cbf9bb17d admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:17.165532 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb36db0-7824-4f8f-bea1-f82cbf9bb17d admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:17.166070 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb36db0-7824-4f8f-bea1-f82cbf9bb17d admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:17.167166 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb36db0-7824-4f8f-bea1-f82cbf9bb17d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:17.179765 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289e7a30-af2b-43d4-954f-0caf394de64e None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:17.183301 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb36db0-7824-4f8f-bea1-f82cbf9bb17d admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:17.185638 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5609369-d7df-4b41-b7b4-433609f873d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:17.189788 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5609369-d7df-4b41-b7b4-433609f873d9 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:17.189788 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5609369-d7df-4b41-b7b4-433609f873d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:17.189788 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5609369-d7df-4b41-b7b4-433609f873d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:17.190611 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5609369-d7df-4b41-b7b4-433609f873d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:17.192756 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5609369-d7df-4b41-b7b4-433609f873d9 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:17.196791 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 968/1947] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:46:17 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:46:17.202324 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb36db0-7824-4f8f-bea1-f82cbf9bb17d admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:17.217070 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb36db0-7824-4f8f-bea1-f82cbf9bb17d admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:17.224515 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d66f0f4-8c85-4f87-b5c6-a30cb42ac6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:17.225314 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66f0f4-8c85-4f87-b5c6-a30cb42ac6c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:17.225701 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66f0f4-8c85-4f87-b5c6-a30cb42ac6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:17.226053 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66f0f4-8c85-4f87-b5c6-a30cb42ac6c6 admin admin] PATH_INFO: `/v3/projects/bb6d96f94d76484bb222ef45c04ec9fe/users/07cf523bcedf4c72b48d871a024f2a0b/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:17.232489 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 980/1948] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:46:17 2022] POST /identity/v3/projects => generated 381 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:46:17.236383 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5609369-d7df-4b41-b7b4-433609f873d9 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:17.247656 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d66f0f4-8c85-4f87-b5c6-a30cb42ac6c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb6d96f94d76484bb222ef45c04ec9fe, user_id=07cf523bcedf4c72b48d871a024f2a0b, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:17.250639 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d66f0f4-8c85-4f87-b5c6-a30cb42ac6c6 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:17.264641 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:17.282530 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 969/1949] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:46:17 2022] PUT /identity/v3/projects/bb6d96f94d76484bb222ef45c04ec9fe/users/07cf523bcedf4c72b48d871a024f2a0b/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:46:17.286745 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d66f0f4-8c85-4f87-b5c6-a30cb42ac6c6 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:17.324457 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:17.343517 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5609369-d7df-4b41-b7b4-433609f873d9 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:17.396615 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d66f0f4-8c85-4f87-b5c6-a30cb42ac6c6 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:17.410782 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ac4a1a-68b9-4da9-9b8a-817cda3afa13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:17.410782 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac4a1a-68b9-4da9-9b8a-817cda3afa13 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:17.410782 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac4a1a-68b9-4da9-9b8a-817cda3afa13 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:17.410782 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac4a1a-68b9-4da9-9b8a-817cda3afa13 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:17.411089 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ac4a1a-68b9-4da9-9b8a-817cda3afa13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:17.411089 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ac4a1a-68b9-4da9-9b8a-817cda3afa13 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:17.422417 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 970/1950] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:46:17 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:46:17.426199 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ac4a1a-68b9-4da9-9b8a-817cda3afa13 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:17.436942 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ac4a1a-68b9-4da9-9b8a-817cda3afa13 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:17.437309 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d964a35-9148-40b5-a4f7-7c4bcc2d2d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:17.438179 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d964a35-9148-40b5-a4f7-7c4bcc2d2d0c admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:17.438696 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d964a35-9148-40b5-a4f7-7c4bcc2d2d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:17.439121 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d964a35-9148-40b5-a4f7-7c4bcc2d2d0c admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:17.439935 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d964a35-9148-40b5-a4f7-7c4bcc2d2d0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:17.442117 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d964a35-9148-40b5-a4f7-7c4bcc2d2d0c admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:17.443200 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa05d6-258e-45cd-84b8-e44ff85420a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:17.443888 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa05d6-258e-45cd-84b8-e44ff85420a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:17.444179 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa05d6-258e-45cd-84b8-e44ff85420a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:17.444447 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa05d6-258e-45cd-84b8-e44ff85420a3 admin admin] PATH_INFO: `/v3/projects/bb6d96f94d76484bb222ef45c04ec9fe/users/07cf523bcedf4c72b48d871a024f2a0b/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:17.446411 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa05d6-258e-45cd-84b8-e44ff85420a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb6d96f94d76484bb222ef45c04ec9fe, user_id=07cf523bcedf4c72b48d871a024f2a0b, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:17.449547 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa05d6-258e-45cd-84b8-e44ff85420a3 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:17.471815 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 981/1952] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:46:17 2022] POST /identity/v3/users => generated 297 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:46:17.474529 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 971/1952] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:46:17 2022] PUT /identity/v3/projects/bb6d96f94d76484bb222ef45c04ec9fe/users/07cf523bcedf4c72b48d871a024f2a0b/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:17.476673 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03834c6-2837-43cb-8ba6-9172e4f8532c None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:17.476961 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03834c6-2837-43cb-8ba6-9172e4f8532c None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:17.477286 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03834c6-2837-43cb-8ba6-9172e4f8532c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:17.480890 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa05d6-258e-45cd-84b8-e44ff85420a3 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:17.513712 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-c03834c6-2837-43cb-8ba6-9172e4f8532c None None] MFA Rules not processed for user `07cf523bcedf4c72b48d871a024f2a0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:17.514959 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-c03834c6-2837-43cb-8ba6-9172e4f8532c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:17.580923 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa05d6-258e-45cd-84b8-e44ff85420a3 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:17.587888 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e99a99-e5e9-4fdd-9694-6fb69cee74d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:17.589605 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e99a99-e5e9-4fdd-9694-6fb69cee74d9 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:17.589970 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e99a99-e5e9-4fdd-9694-6fb69cee74d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:17.590322 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e99a99-e5e9-4fdd-9694-6fb69cee74d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:17.591357 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e99a99-e5e9-4fdd-9694-6fb69cee74d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:17.593687 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e99a99-e5e9-4fdd-9694-6fb69cee74d9 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:17.617527 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 972/1953] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:46:17 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:46:17.618713 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e99a99-e5e9-4fdd-9694-6fb69cee74d9 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:17.634247 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e99a99-e5e9-4fdd-9694-6fb69cee74d9 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:17.640844 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8149c2ec-61b6-4fbb-b735-d43396dccf26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:17.641684 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149c2ec-61b6-4fbb-b735-d43396dccf26 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:17.641966 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149c2ec-61b6-4fbb-b735-d43396dccf26 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:17.642307 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149c2ec-61b6-4fbb-b735-d43396dccf26 admin admin] PATH_INFO: `/v3/projects/c1c80278bbcb4a0fa2655a3c75c0af99/users/c9bde88a85b34c7a967e599cee9c8d5a/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:17.644681 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 982/1954] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:17 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:46:17.658715 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03834c6-2837-43cb-8ba6-9172e4f8532c None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:17.660976 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-c03834c6-2837-43cb-8ba6-9172e4f8532c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:17.674180 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8149c2ec-61b6-4fbb-b735-d43396dccf26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1c80278bbcb4a0fa2655a3c75c0af99, user_id=c9bde88a85b34c7a967e599cee9c8d5a, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:17.678916 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8149c2ec-61b6-4fbb-b735-d43396dccf26 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:17.701173 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 973/1955] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:46:17 2022] PUT /identity/v3/projects/c1c80278bbcb4a0fa2655a3c75c0af99/users/c9bde88a85b34c7a967e599cee9c8d5a/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:17.704413 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8149c2ec-61b6-4fbb-b735-d43396dccf26 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:17.733223 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:17.757984 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03834c6-2837-43cb-8ba6-9172e4f8532c None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:17.797905 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8149c2ec-61b6-4fbb-b735-d43396dccf26 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:17.804079 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0fb53f-7d1a-45dc-bf18-4e35c90ffad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:17.804700 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0fb53f-7d1a-45dc-bf18-4e35c90ffad9 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:17.804978 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0fb53f-7d1a-45dc-bf18-4e35c90ffad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:17.805457 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0fb53f-7d1a-45dc-bf18-4e35c90ffad9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:17.806208 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0fb53f-7d1a-45dc-bf18-4e35c90ffad9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:17.808486 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0fb53f-7d1a-45dc-bf18-4e35c90ffad9 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:17.824610 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 974/1956] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:46:17 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:46:17.824610 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0fb53f-7d1a-45dc-bf18-4e35c90ffad9 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:17.826787 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-2d0fb53f-7d1a-45dc-bf18-4e35c90ffad9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:17.836645 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1f1b88-76f9-420e-9109-1886f7c5628a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:17.837272 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f1b88-76f9-420e-9109-1886f7c5628a service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:17.837606 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f1b88-76f9-420e-9109-1886f7c5628a service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:17.837882 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f1b88-76f9-420e-9109-1886f7c5628a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:17.851436 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:17.921180 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0fb53f-7d1a-45dc-bf18-4e35c90ffad9 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:17.927522 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebb31d4-cf5d-4458-be2a-9292fa1a9e29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:17.928588 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb31d4-cf5d-4458-be2a-9292fa1a9e29 service cinder] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:17.929086 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb31d4-cf5d-4458-be2a-9292fa1a9e29 service cinder] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:17.929599 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb31d4-cf5d-4458-be2a-9292fa1a9e29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:17.932068 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-bebb31d4-cf5d-4458-be2a-9292fa1a9e29 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:17.950624 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1f1b88-76f9-420e-9109-1886f7c5628a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:17.952098 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1f1b88-76f9-420e-9109-1886f7c5628a service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:17.966901 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 983/1957] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:46:17 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:46:17.967846 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1f1b88-76f9-420e-9109-1886f7c5628a service cinder] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:17.980647 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1f1b88-76f9-420e-9109-1886f7c5628a service cinder] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:17.985891 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e0d636-6699-4af4-beb0-a061b621645e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:17.986699 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e0d636-6699-4af4-beb0-a061b621645e admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:17.986975 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e0d636-6699-4af4-beb0-a061b621645e admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:17.987250 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e0d636-6699-4af4-beb0-a061b621645e admin admin] PATH_INFO: `/v3/projects/c1c80278bbcb4a0fa2655a3c75c0af99/users/c9bde88a85b34c7a967e599cee9c8d5a/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:17.990160 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e0d636-6699-4af4-beb0-a061b621645e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1c80278bbcb4a0fa2655a3c75c0af99, user_id=c9bde88a85b34c7a967e599cee9c8d5a, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:17.993579 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e0d636-6699-4af4-beb0-a061b621645e admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:18.025884 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 984/1958] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:46:17 2022] PUT /identity/v3/projects/c1c80278bbcb4a0fa2655a3c75c0af99/users/c9bde88a85b34c7a967e599cee9c8d5a/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:18.036372 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5cb8b7-d61f-44b0-912a-5ec9d09a3f13 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:18.036645 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5cb8b7-d61f-44b0-912a-5ec9d09a3f13 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:18.036909 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5cb8b7-d61f-44b0-912a-5ec9d09a3f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:18.042246 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebb31d4-cf5d-4458-be2a-9292fa1a9e29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:18.043689 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebb31d4-cf5d-4458-be2a-9292fa1a9e29 service cinder] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:18.063943 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 975/1959] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:46:17 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:46:18.084182 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebb31d4-cf5d-4458-be2a-9292fa1a9e29 service cinder] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:18.085154 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-cf5cb8b7-d61f-44b0-912a-5ec9d09a3f13 None None] MFA Rules not processed for user `c9bde88a85b34c7a967e599cee9c8d5a`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:18.086846 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-cf5cb8b7-d61f-44b0-912a-5ec9d09a3f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:18.104641 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebb31d4-cf5d-4458-be2a-9292fa1a9e29 service cinder] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:18.225807 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26027f12-120e-401f-ae78-782bfe53ddaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:18.226502 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26027f12-120e-401f-ae78-782bfe53ddaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:18.226801 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26027f12-120e-401f-ae78-782bfe53ddaa admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:18.228862 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26027f12-120e-401f-ae78-782bfe53ddaa admin admin] PATH_INFO: `/v3/users/4f5db3b529a642938ab3fd69cf3f4f9c` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:18.233428 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26027f12-120e-401f-ae78-782bfe53ddaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f5db3b529a642938ab3fd69cf3f4f9c)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:18.240335 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26027f12-120e-401f-ae78-782bfe53ddaa admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:18.241302 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 985/1960] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:18 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:46:18.270359 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5cb8b7-d61f-44b0-912a-5ec9d09a3f13 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:18.312946 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:18.360761 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-26027f12-120e-401f-ae78-782bfe53ddaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f5db3b529a642938ab3fd69cf3f4f9c'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:18.373292 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-26027f12-120e-401f-ae78-782bfe53ddaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f5db3b529a642938ab3fd69cf3f4f9c'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:18.374354 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-26027f12-120e-401f-ae78-782bfe53ddaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f5db3b529a642938ab3fd69cf3f4f9c'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:18.375410 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5cb8b7-d61f-44b0-912a-5ec9d09a3f13 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:18.383687 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:18.386685 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646d335b-74d0-417c-b529-547ba6e297ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:18.389006 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d335b-74d0-417c-b529-547ba6e297ce service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:18.390827 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d335b-74d0-417c-b529-547ba6e297ce service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:18.391573 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d335b-74d0-417c-b529-547ba6e297ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:18.400092 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-26027f12-120e-401f-ae78-782bfe53ddaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f5db3b529a642938ab3fd69cf3f4f9c'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:18.414441 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-26027f12-120e-401f-ae78-782bfe53ddaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f5db3b529a642938ab3fd69cf3f4f9c'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:18.430195 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 976/1961] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:46:18 2022] DELETE /identity/v3/users/4f5db3b529a642938ab3fd69cf3f4f9c => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:18.430808 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646d335b-74d0-417c-b529-547ba6e297ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:18.432853 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646d335b-74d0-417c-b529-547ba6e297ce service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:18.437116 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c3488-aa57-4fb0-9153-e81fde03b37e None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:18.437642 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c3488-aa57-4fb0-9153-e81fde03b37e None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:18.438070 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c3488-aa57-4fb0-9153-e81fde03b37e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:18.459284 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 986/1962] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:46:18 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:46:18.465214 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-0e1c3488-aa57-4fb0-9153-e81fde03b37e None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:18.466506 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-0e1c3488-aa57-4fb0-9153-e81fde03b37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:18.630926 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 977/1963] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:46:18.641077 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646d335b-74d0-417c-b529-547ba6e297ce service cinder] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:18.642550 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-646d335b-74d0-417c-b529-547ba6e297ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:18.764682 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646d335b-74d0-417c-b529-547ba6e297ce service cinder] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:18.848590 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78047e5c-6676-4d0d-8ae0-864dc45d55f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:18.849281 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78047e5c-6676-4d0d-8ae0-864dc45d55f1 service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:18.849592 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78047e5c-6676-4d0d-8ae0-864dc45d55f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:18.849877 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78047e5c-6676-4d0d-8ae0-864dc45d55f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:18.872202 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78047e5c-6676-4d0d-8ae0-864dc45d55f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:18.873961 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78047e5c-6676-4d0d-8ae0-864dc45d55f1 service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:18.894224 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 987/1964] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:46:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:46:19.111393 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c3488-aa57-4fb0-9153-e81fde03b37e None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:19.112815 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-0e1c3488-aa57-4fb0-9153-e81fde03b37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:19.126639 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c3488-aa57-4fb0-9153-e81fde03b37e None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:19.133435 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3119dadd-9b33-4977-b0ca-d66e8ff887ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:19.134217 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3119dadd-9b33-4977-b0ca-d66e8ff887ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:19.134478 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3119dadd-9b33-4977-b0ca-d66e8ff887ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:19.134756 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3119dadd-9b33-4977-b0ca-d66e8ff887ea admin admin] PATH_INFO: `/v3/users/52d4c7af4dd04f32b3950a8893765979` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:19.135940 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3119dadd-9b33-4977-b0ca-d66e8ff887ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=52d4c7af4dd04f32b3950a8893765979)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:19.137959 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3119dadd-9b33-4977-b0ca-d66e8ff887ea admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:19.201425 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-3119dadd-9b33-4977-b0ca-d66e8ff887ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52d4c7af4dd04f32b3950a8893765979'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:19.208974 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-3119dadd-9b33-4977-b0ca-d66e8ff887ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52d4c7af4dd04f32b3950a8893765979'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:19.209726 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-3119dadd-9b33-4977-b0ca-d66e8ff887ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52d4c7af4dd04f32b3950a8893765979'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:19.245221 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78047e5c-6676-4d0d-8ae0-864dc45d55f1 service neutron] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:19.249079 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-3119dadd-9b33-4977-b0ca-d66e8ff887ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52d4c7af4dd04f32b3950a8893765979'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:19.249766 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-78047e5c-6676-4d0d-8ae0-864dc45d55f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:19.277285 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-3119dadd-9b33-4977-b0ca-d66e8ff887ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52d4c7af4dd04f32b3950a8893765979'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:19.284457 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 978/1965] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:46:19 2022] DELETE /identity/v3/users/52d4c7af4dd04f32b3950a8893765979 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:19.287774 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78047e5c-6676-4d0d-8ae0-864dc45d55f1 service neutron] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:19.294921 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b767e9fe-ed06-4022-ad3e-9804f6cff95d None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:19.295207 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b767e9fe-ed06-4022-ad3e-9804f6cff95d None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:19.295484 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b767e9fe-ed06-4022-ad3e-9804f6cff95d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:19.317056 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-b767e9fe-ed06-4022-ad3e-9804f6cff95d None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:19.319321 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-b767e9fe-ed06-4022-ad3e-9804f6cff95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:19.383680 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258652d7-602e-4423-8f02-1142f4ce33ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:19.384523 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258652d7-602e-4423-8f02-1142f4ce33ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:19.384878 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258652d7-602e-4423-8f02-1142f4ce33ad admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:19.385235 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258652d7-602e-4423-8f02-1142f4ce33ad admin admin] PATH_INFO: `/v3/projects/af8493dadec24a57a261e2c0fed36bc3` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:19.386667 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258652d7-602e-4423-8f02-1142f4ce33ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=af8493dadec24a57a261e2c0fed36bc3)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:19.387287 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:19.389797 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258652d7-602e-4423-8f02-1142f4ce33ad admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:19.408982 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 979/1966] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:46:19.422207 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:19.425859 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b767e9fe-ed06-4022-ad3e-9804f6cff95d None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:19.425859 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-b767e9fe-ed06-4022-ad3e-9804f6cff95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:19.448750 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-258652d7-602e-4423-8f02-1142f4ce33ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af8493dadec24a57a261e2c0fed36bc3', 'request_id': 'req-258652d7-602e-4423-8f02-1142f4ce33ad'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:19.455337 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-258652d7-602e-4423-8f02-1142f4ce33ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af8493dadec24a57a261e2c0fed36bc3', 'request_id': 'req-258652d7-602e-4423-8f02-1142f4ce33ad'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:19.462713 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-258652d7-602e-4423-8f02-1142f4ce33ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af8493dadec24a57a261e2c0fed36bc3', 'request_id': 'req-258652d7-602e-4423-8f02-1142f4ce33ad'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:19.476844 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-258652d7-602e-4423-8f02-1142f4ce33ad admin admin] The token cache is being invalidate because project af8493dadec24a57a261e2c0fed36bc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:46:19.477129 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-258652d7-602e-4423-8f02-1142f4ce33ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:19.477822 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-258652d7-602e-4423-8f02-1142f4ce33ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:19.479586 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 988/1967] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:46:19 2022] DELETE /identity/v3/projects/af8493dadec24a57a261e2c0fed36bc3 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:19.483153 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258652d7-602e-4423-8f02-1142f4ce33ad admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:19.484498 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-258652d7-602e-4423-8f02-1142f4ce33ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:19.488522 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b767e9fe-ed06-4022-ad3e-9804f6cff95d None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:19.542895 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba544f55-1b2d-41c7-bb36-d70374103450 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:19.543548 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba544f55-1b2d-41c7-bb36-d70374103450 service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:19.543913 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba544f55-1b2d-41c7-bb36-d70374103450 service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:19.544183 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba544f55-1b2d-41c7-bb36-d70374103450 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:19.545963 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-ba544f55-1b2d-41c7-bb36-d70374103450 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:19.558894 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba544f55-1b2d-41c7-bb36-d70374103450 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:19.560376 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba544f55-1b2d-41c7-bb36-d70374103450 service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:19.566014 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258652d7-602e-4423-8f02-1142f4ce33ad admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:19.572548 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 980/1968] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:46:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:46:19.573997 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccacbdd-8af3-415d-84d4-3ed6bee187a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:19.574894 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccacbdd-8af3-415d-84d4-3ed6bee187a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:19.575097 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccacbdd-8af3-415d-84d4-3ed6bee187a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:19.575399 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccacbdd-8af3-415d-84d4-3ed6bee187a1 admin admin] PATH_INFO: `/v3/users/07cf523bcedf4c72b48d871a024f2a0b` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:19.576818 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccacbdd-8af3-415d-84d4-3ed6bee187a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07cf523bcedf4c72b48d871a024f2a0b)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:19.579056 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccacbdd-8af3-415d-84d4-3ed6bee187a1 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:19.650910 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-4ccacbdd-8af3-415d-84d4-3ed6bee187a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07cf523bcedf4c72b48d871a024f2a0b'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:19.659489 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-4ccacbdd-8af3-415d-84d4-3ed6bee187a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07cf523bcedf4c72b48d871a024f2a0b'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:19.660256 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-4ccacbdd-8af3-415d-84d4-3ed6bee187a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07cf523bcedf4c72b48d871a024f2a0b'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:19.669710 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-4ccacbdd-8af3-415d-84d4-3ed6bee187a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07cf523bcedf4c72b48d871a024f2a0b'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:19.670840 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-4ccacbdd-8af3-415d-84d4-3ed6bee187a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07cf523bcedf4c72b48d871a024f2a0b'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:19.701574 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 989/1969] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:46:19 2022] DELETE /identity/v3/users/07cf523bcedf4c72b48d871a024f2a0b => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:46:19.951851 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba544f55-1b2d-41c7-bb36-d70374103450 service neutron] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:19.953359 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-ba544f55-1b2d-41c7-bb36-d70374103450 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:19.975121 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba544f55-1b2d-41c7-bb36-d70374103450 service neutron] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:20.110906 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4486ffa9-1178-459a-a0ce-8102bc4c4bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:20.111868 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4486ffa9-1178-459a-a0ce-8102bc4c4bc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:20.112296 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4486ffa9-1178-459a-a0ce-8102bc4c4bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:20.112705 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4486ffa9-1178-459a-a0ce-8102bc4c4bc0 admin admin] PATH_INFO: `/v3/projects/38691e86d7b94b7c810e26e78725fb1a` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:20.114118 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4486ffa9-1178-459a-a0ce-8102bc4c4bc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38691e86d7b94b7c810e26e78725fb1a)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:20.117212 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4486ffa9-1178-459a-a0ce-8102bc4c4bc0 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:20.205994 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-4486ffa9-1178-459a-a0ce-8102bc4c4bc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38691e86d7b94b7c810e26e78725fb1a', 'request_id': 'req-4486ffa9-1178-459a-a0ce-8102bc4c4bc0'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:20.210323 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:20.220766 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-4486ffa9-1178-459a-a0ce-8102bc4c4bc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38691e86d7b94b7c810e26e78725fb1a', 'request_id': 'req-4486ffa9-1178-459a-a0ce-8102bc4c4bc0'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:20.233285 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-4486ffa9-1178-459a-a0ce-8102bc4c4bc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38691e86d7b94b7c810e26e78725fb1a', 'request_id': 'req-4486ffa9-1178-459a-a0ce-8102bc4c4bc0'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:20.250806 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-4486ffa9-1178-459a-a0ce-8102bc4c4bc0 admin admin] The token cache is being invalidate because project 38691e86d7b94b7c810e26e78725fb1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:46:20.251383 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-4486ffa9-1178-459a-a0ce-8102bc4c4bc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:20.252055 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-4486ffa9-1178-459a-a0ce-8102bc4c4bc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:20.255533 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 981/1970] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:46:19 2022] DELETE /identity/v3/projects/38691e86d7b94b7c810e26e78725fb1a => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:20.259627 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccacbdd-8af3-415d-84d4-3ed6bee187a1 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:20.261281 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-4ccacbdd-8af3-415d-84d4-3ed6bee187a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:20.294591 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccacbdd-8af3-415d-84d4-3ed6bee187a1 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:20.346429 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:20.350829 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4486ffa9-1178-459a-a0ce-8102bc4c4bc0 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:20.353184 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-4486ffa9-1178-459a-a0ce-8102bc4c4bc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:20.404123 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9ae543-2020-4eb9-ad2e-8ab0a42a119f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:20.404766 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ae543-2020-4eb9-ad2e-8ab0a42a119f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:20.405047 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ae543-2020-4eb9-ad2e-8ab0a42a119f admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:20.405345 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ae543-2020-4eb9-ad2e-8ab0a42a119f admin admin] PATH_INFO: `/v3/users/c9bde88a85b34c7a967e599cee9c8d5a` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:20.406799 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9ae543-2020-4eb9-ad2e-8ab0a42a119f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9bde88a85b34c7a967e599cee9c8d5a)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:20.408736 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9ae543-2020-4eb9-ad2e-8ab0a42a119f admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:20.440035 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4486ffa9-1178-459a-a0ce-8102bc4c4bc0 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:20.447770 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925c687c-cf89-4630-ab5b-c0e559488027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:20.447770 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925c687c-cf89-4630-ab5b-c0e559488027 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:20.448618 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925c687c-cf89-4630-ab5b-c0e559488027 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:20.448855 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925c687c-cf89-4630-ab5b-c0e559488027 admin admin] PATH_INFO: `/v3/projects/bb6d96f94d76484bb222ef45c04ec9fe` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:20.450744 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925c687c-cf89-4630-ab5b-c0e559488027 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb6d96f94d76484bb222ef45c04ec9fe)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:20.454577 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925c687c-cf89-4630-ab5b-c0e559488027 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:20.498930 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-7d9ae543-2020-4eb9-ad2e-8ab0a42a119f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9bde88a85b34c7a967e599cee9c8d5a'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:20.507658 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-7d9ae543-2020-4eb9-ad2e-8ab0a42a119f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9bde88a85b34c7a967e599cee9c8d5a'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:20.509071 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-7d9ae543-2020-4eb9-ad2e-8ab0a42a119f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9bde88a85b34c7a967e599cee9c8d5a'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:20.519508 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-7d9ae543-2020-4eb9-ad2e-8ab0a42a119f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9bde88a85b34c7a967e599cee9c8d5a'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:20.520262 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-7d9ae543-2020-4eb9-ad2e-8ab0a42a119f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9bde88a85b34c7a967e599cee9c8d5a'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:20.526585 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-925c687c-cf89-4630-ab5b-c0e559488027 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb6d96f94d76484bb222ef45c04ec9fe', 'request_id': 'req-925c687c-cf89-4630-ab5b-c0e559488027'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:20.537971 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-925c687c-cf89-4630-ab5b-c0e559488027 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb6d96f94d76484bb222ef45c04ec9fe', 'request_id': 'req-925c687c-cf89-4630-ab5b-c0e559488027'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:20.547609 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-925c687c-cf89-4630-ab5b-c0e559488027 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb6d96f94d76484bb222ef45c04ec9fe', 'request_id': 'req-925c687c-cf89-4630-ab5b-c0e559488027'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:20.556728 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 990/1971] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:46:20 2022] DELETE /identity/v3/users/c9bde88a85b34c7a967e599cee9c8d5a => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:20.571281 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-925c687c-cf89-4630-ab5b-c0e559488027 admin admin] The token cache is being invalidate because project bb6d96f94d76484bb222ef45c04ec9fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:46:20.571763 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-925c687c-cf89-4630-ab5b-c0e559488027 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:20.572853 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-925c687c-cf89-4630-ab5b-c0e559488027 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:20.575461 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 982/1972] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:46:20 2022] DELETE /identity/v3/projects/bb6d96f94d76484bb222ef45c04ec9fe => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:20.580793 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd2a8d6-08cf-4b5a-acfa-e651285ffd9a None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:20.581388 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd2a8d6-08cf-4b5a-acfa-e651285ffd9a None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:20.581861 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd2a8d6-08cf-4b5a-acfa-e651285ffd9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:20.618656 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-ffd2a8d6-08cf-4b5a-acfa-e651285ffd9a None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:20.620287 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-ffd2a8d6-08cf-4b5a-acfa-e651285ffd9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:20.728758 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 991/1973] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:46:20.743623 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b7a7d0-cf9f-4c60-8ded-041f04a77b44 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:20.744179 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b7a7d0-cf9f-4c60-8ded-041f04a77b44 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:20.744596 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b7a7d0-cf9f-4c60-8ded-041f04a77b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:20.779775 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-f9b7a7d0-cf9f-4c60-8ded-041f04a77b44 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:20.781984 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-f9b7a7d0-cf9f-4c60-8ded-041f04a77b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:20.796200 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 983/1974] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:46:20.802928 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd2a8d6-08cf-4b5a-acfa-e651285ffd9a None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:20.814254 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd2a8d6-08cf-4b5a-acfa-e651285ffd9a None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:20.820017 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a27869-59d0-46c0-a5c0-c65df4bd2e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:20.820713 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a27869-59d0-46c0-a5c0-c65df4bd2e0b admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:20.821068 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a27869-59d0-46c0-a5c0-c65df4bd2e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:20.821444 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a27869-59d0-46c0-a5c0-c65df4bd2e0b admin admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:20.822171 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a27869-59d0-46c0-a5c0-c65df4bd2e0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:46:20.822538 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a27869-59d0-46c0-a5c0-c65df4bd2e0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:20.824199 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a27869-59d0-46c0-a5c0-c65df4bd2e0b admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:20.837416 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 992/1975] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Aug 29 22:46:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:46:20.841940 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b7a7d0-cf9f-4c60-8ded-041f04a77b44 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:20.852387 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b7a7d0-cf9f-4c60-8ded-041f04a77b44 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:20.857382 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45232ba4-7d2b-4b5b-8f52-24a3d29b4ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:20.858013 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45232ba4-7d2b-4b5b-8f52-24a3d29b4ed0 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:20.858326 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45232ba4-7d2b-4b5b-8f52-24a3d29b4ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:20.858591 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45232ba4-7d2b-4b5b-8f52-24a3d29b4ed0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:20.859383 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45232ba4-7d2b-4b5b-8f52-24a3d29b4ed0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:20.861310 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45232ba4-7d2b-4b5b-8f52-24a3d29b4ed0 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:20.907015 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 984/1976] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:46:20 2022] POST /identity/v3/projects => generated 381 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:46:20.911789 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a27869-59d0-46c0-a5c0-c65df4bd2e0b admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:20.922527 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a27869-59d0-46c0-a5c0-c65df4bd2e0b admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:20.967295 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:20.969238 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45232ba4-7d2b-4b5b-8f52-24a3d29b4ed0 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:20.971412 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-45232ba4-7d2b-4b5b-8f52-24a3d29b4ed0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:21.004252 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c09c1a-cc3f-4186-a292-e392bbc1a1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:21.005629 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c09c1a-cc3f-4186-a292-e392bbc1a1a8 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:21.005992 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c09c1a-cc3f-4186-a292-e392bbc1a1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:21.006955 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c09c1a-cc3f-4186-a292-e392bbc1a1a8 admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:21.007627 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c09c1a-cc3f-4186-a292-e392bbc1a1a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:21.009801 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c09c1a-cc3f-4186-a292-e392bbc1a1a8 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:21.039120 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:21.045878 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 993/1977] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:46:20 2022] POST /identity/v3/users => generated 291 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:46:21.047429 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c09c1a-cc3f-4186-a292-e392bbc1a1a8 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:21.059090 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c09c1a-cc3f-4186-a292-e392bbc1a1a8 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:21.069759 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d639f4b1-b46b-4082-8a51-6cb20f6b3d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:21.070395 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639f4b1-b46b-4082-8a51-6cb20f6b3d23 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:21.070677 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639f4b1-b46b-4082-8a51-6cb20f6b3d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:21.070955 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639f4b1-b46b-4082-8a51-6cb20f6b3d23 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:21.072341 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d639f4b1-b46b-4082-8a51-6cb20f6b3d23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:21.073319 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d639f4b1-b46b-4082-8a51-6cb20f6b3d23 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:21.074481 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45232ba4-7d2b-4b5b-8f52-24a3d29b4ed0 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:21.080304 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65b908-5eb8-4299-94c3-f015e0c5ab27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:21.080504 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65b908-5eb8-4299-94c3-f015e0c5ab27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:21.080745 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65b908-5eb8-4299-94c3-f015e0c5ab27 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:21.080940 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65b908-5eb8-4299-94c3-f015e0c5ab27 admin admin] PATH_INFO: `/v3/projects/c1c80278bbcb4a0fa2655a3c75c0af99` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:21.082118 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f65b908-5eb8-4299-94c3-f015e0c5ab27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1c80278bbcb4a0fa2655a3c75c0af99)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:21.085362 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f65b908-5eb8-4299-94c3-f015e0c5ab27 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:21.085499 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 994/1978] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:46:21 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:46:21.089015 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d639f4b1-b46b-4082-8a51-6cb20f6b3d23 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:21.099108 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d639f4b1-b46b-4082-8a51-6cb20f6b3d23 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:21.104380 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c42f9-1f49-4a78-bff2-6e94a98a8366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:21.105387 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c42f9-1f49-4a78-bff2-6e94a98a8366 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:21.105645 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c42f9-1f49-4a78-bff2-6e94a98a8366 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:21.106020 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c42f9-1f49-4a78-bff2-6e94a98a8366 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:21.106782 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62c42f9-1f49-4a78-bff2-6e94a98a8366 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:21.108486 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62c42f9-1f49-4a78-bff2-6e94a98a8366 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:21.126193 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 995/1979] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:46:21 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:46:21.127286 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c42f9-1f49-4a78-bff2-6e94a98a8366 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:21.142126 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c42f9-1f49-4a78-bff2-6e94a98a8366 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:21.173442 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-1f65b908-5eb8-4299-94c3-f015e0c5ab27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1c80278bbcb4a0fa2655a3c75c0af99', 'request_id': 'req-1f65b908-5eb8-4299-94c3-f015e0c5ab27'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:21.206765 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-1f65b908-5eb8-4299-94c3-f015e0c5ab27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1c80278bbcb4a0fa2655a3c75c0af99', 'request_id': 'req-1f65b908-5eb8-4299-94c3-f015e0c5ab27'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:21.216614 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-1f65b908-5eb8-4299-94c3-f015e0c5ab27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1c80278bbcb4a0fa2655a3c75c0af99', 'request_id': 'req-1f65b908-5eb8-4299-94c3-f015e0c5ab27'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:21.245696 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-1f65b908-5eb8-4299-94c3-f015e0c5ab27 admin admin] The token cache is being invalidate because project c1c80278bbcb4a0fa2655a3c75c0af99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:46:21.251028 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-1f65b908-5eb8-4299-94c3-f015e0c5ab27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:21.252395 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-1f65b908-5eb8-4299-94c3-f015e0c5ab27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:21.256296 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff17184-5b7c-41c0-9a9e-7a1965dc1bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:21.261116 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 985/1980] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:46:20 2022] DELETE /identity/v3/projects/c1c80278bbcb4a0fa2655a3c75c0af99 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:46:21.261422 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff17184-5b7c-41c0-9a9e-7a1965dc1bc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:21.261422 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff17184-5b7c-41c0-9a9e-7a1965dc1bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:21.261422 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff17184-5b7c-41c0-9a9e-7a1965dc1bc8 admin admin] PATH_INFO: `/v3/projects/743cdd59fafb4a97b4d1bfb5384eb917/users/46f6ada2d7e4495c93bb8751c1f9adc6/roles/0c67797d444d4c929b2ccab47c468848` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:21.261662 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9ffd5-d796-4a5a-afab-26ef378c453f None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:21.261662 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9ffd5-d796-4a5a-afab-26ef378c453f None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:21.261943 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9ffd5-d796-4a5a-afab-26ef378c453f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:21.296841 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff17184-5b7c-41c0-9a9e-7a1965dc1bc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=743cdd59fafb4a97b4d1bfb5384eb917, user_id=46f6ada2d7e4495c93bb8751c1f9adc6, role_id=0c67797d444d4c929b2ccab47c468848)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:21.301168 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff17184-5b7c-41c0-9a9e-7a1965dc1bc8 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:21.313250 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-f8d9ffd5-d796-4a5a-afab-26ef378c453f None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:21.315218 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-f8d9ffd5-d796-4a5a-afab-26ef378c453f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:21.340241 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 996/1981] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:46:21 2022] PUT /identity/v3/projects/743cdd59fafb4a97b4d1bfb5384eb917/users/46f6ada2d7e4495c93bb8751c1f9adc6/roles/0c67797d444d4c929b2ccab47c468848 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:21.351113 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ebe595-2b38-4e1d-8960-64eb6bb4831b None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:21.351586 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ebe595-2b38-4e1d-8960-64eb6bb4831b None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:21.352298 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ebe595-2b38-4e1d-8960-64eb6bb4831b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:21.434976 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-25ebe595-2b38-4e1d-8960-64eb6bb4831b None None] MFA Rules not processed for user `46f6ada2d7e4495c93bb8751c1f9adc6`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:21.436602 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-25ebe595-2b38-4e1d-8960-64eb6bb4831b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:21.491453 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 986/1982] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:46:21.501311 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834e06d-38ed-49a2-bf47-cbf2f3e90839 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:21.501311 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834e06d-38ed-49a2-bf47-cbf2f3e90839 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:21.501607 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834e06d-38ed-49a2-bf47-cbf2f3e90839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:21.529382 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-f834e06d-38ed-49a2-bf47-cbf2f3e90839 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:21.530644 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-f834e06d-38ed-49a2-bf47-cbf2f3e90839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:21.541655 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 987/1983] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:46:21.547160 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f834e06d-38ed-49a2-bf47-cbf2f3e90839 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:21.558631 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f834e06d-38ed-49a2-bf47-cbf2f3e90839 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:21.560907 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 997/1984] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:46:21.565634 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1a9232-8462-4230-a1a0-841ac3fee4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:21.566882 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ebe595-2b38-4e1d-8960-64eb6bb4831b None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:21.567194 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a9232-8462-4230-a1a0-841ac3fee4de admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:21.567917 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a9232-8462-4230-a1a0-841ac3fee4de admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:21.568340 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a9232-8462-4230-a1a0-841ac3fee4de admin admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:21.569200 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-25ebe595-2b38-4e1d-8960-64eb6bb4831b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:21.569717 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1a9232-8462-4230-a1a0-841ac3fee4de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:46:21.570165 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1a9232-8462-4230-a1a0-841ac3fee4de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:21.572354 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1a9232-8462-4230-a1a0-841ac3fee4de admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:21.589108 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ebe595-2b38-4e1d-8960-64eb6bb4831b None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:21.592783 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 988/1985] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Aug 29 22:46:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:46:21.594691 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1a9232-8462-4230-a1a0-841ac3fee4de admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:21.603437 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0355cf-71f3-4aca-8e4c-9a7b8d8bde75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:21.604183 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0355cf-71f3-4aca-8e4c-9a7b8d8bde75 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:21.604713 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0355cf-71f3-4aca-8e4c-9a7b8d8bde75 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:21.605098 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0355cf-71f3-4aca-8e4c-9a7b8d8bde75 admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:21.606031 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0355cf-71f3-4aca-8e4c-9a7b8d8bde75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:21.609309 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1a9232-8462-4230-a1a0-841ac3fee4de admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:21.614329 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0355cf-71f3-4aca-8e4c-9a7b8d8bde75 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:21.626073 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12c5f05-c363-43da-9ac5-2f78920712cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:21.626862 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c5f05-c363-43da-9ac5-2f78920712cc admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:21.627148 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c5f05-c363-43da-9ac5-2f78920712cc admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:21.628345 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c5f05-c363-43da-9ac5-2f78920712cc admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:21.628594 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12c5f05-c363-43da-9ac5-2f78920712cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:21.632034 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12c5f05-c363-43da-9ac5-2f78920712cc admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:21.636911 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:21.651631 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 998/1986] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:46:21 2022] POST /identity/v3/projects => generated 383 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:46:21.655755 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0355cf-71f3-4aca-8e4c-9a7b8d8bde75 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:21.672555 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 989/1987] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:46:21 2022] POST /identity/v3/projects => generated 381 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:46:21.682946 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12c5f05-c363-43da-9ac5-2f78920712cc admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:21.730023 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:21.731265 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0355cf-71f3-4aca-8e4c-9a7b8d8bde75 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:21.768974 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12c5f05-c363-43da-9ac5-2f78920712cc admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:21.775340 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b20c59-e528-4a84-b7a0-032715cb0c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:21.776269 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b20c59-e528-4a84-b7a0-032715cb0c6a admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:21.776745 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b20c59-e528-4a84-b7a0-032715cb0c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:21.777179 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b20c59-e528-4a84-b7a0-032715cb0c6a admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:21.778053 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b20c59-e528-4a84-b7a0-032715cb0c6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:21.780375 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b20c59-e528-4a84-b7a0-032715cb0c6a admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:21.802637 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca9fac-c25b-4fdf-ae82-e8373aaab08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:21.803313 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca9fac-c25b-4fdf-ae82-e8373aaab08e admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:21.803718 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca9fac-c25b-4fdf-ae82-e8373aaab08e admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:21.803926 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca9fac-c25b-4fdf-ae82-e8373aaab08e admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:21.804604 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ca9fac-c25b-4fdf-ae82-e8373aaab08e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:21.809381 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 990/1988] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:46:21 2022] POST /identity/v3/users => generated 291 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:46:21.809560 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ca9fac-c25b-4fdf-ae82-e8373aaab08e admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:21.811123 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b20c59-e528-4a84-b7a0-032715cb0c6a admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:21.824046 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b20c59-e528-4a84-b7a0-032715cb0c6a admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:21.830134 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc773fe-03a6-4ce4-ac8d-b29449648385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:21.830766 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc773fe-03a6-4ce4-ac8d-b29449648385 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:21.834552 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 999/1989] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:46:21 2022] POST /identity/v3/users => generated 298 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:46:21.837909 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc773fe-03a6-4ce4-ac8d-b29449648385 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:21.838308 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca9fac-c25b-4fdf-ae82-e8373aaab08e admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:21.838533 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc773fe-03a6-4ce4-ac8d-b29449648385 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:21.839504 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc773fe-03a6-4ce4-ac8d-b29449648385 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:21.841510 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc773fe-03a6-4ce4-ac8d-b29449648385 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:21.852305 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca9fac-c25b-4fdf-ae82-e8373aaab08e admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:21.858108 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 991/1990] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:46:21 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:46:21.858289 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da4445f-8080-4a25-9013-5936da7801ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:21.859064 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4445f-8080-4a25-9013-5936da7801ea admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:21.859192 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc773fe-03a6-4ce4-ac8d-b29449648385 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:21.859290 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4445f-8080-4a25-9013-5936da7801ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:21.859290 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4445f-8080-4a25-9013-5936da7801ea admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:21.860315 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da4445f-8080-4a25-9013-5936da7801ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:21.862019 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da4445f-8080-4a25-9013-5936da7801ea admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:21.870506 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc773fe-03a6-4ce4-ac8d-b29449648385 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:21.877437 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1000/1991] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:46:21 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:46:21.877655 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940284b9-452b-4358-a0cb-0638b00acf10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:21.877655 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940284b9-452b-4358-a0cb-0638b00acf10 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:21.877655 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940284b9-452b-4358-a0cb-0638b00acf10 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:21.877655 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940284b9-452b-4358-a0cb-0638b00acf10 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:21.878179 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940284b9-452b-4358-a0cb-0638b00acf10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:21.879803 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940284b9-452b-4358-a0cb-0638b00acf10 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:21.881360 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da4445f-8080-4a25-9013-5936da7801ea admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:21.892972 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da4445f-8080-4a25-9013-5936da7801ea admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:21.898380 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 992/1992] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:46:21 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:46:21.899413 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940284b9-452b-4358-a0cb-0638b00acf10 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:21.911070 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940284b9-452b-4358-a0cb-0638b00acf10 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:21.915882 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13f76b1-b109-4f46-babf-85504d4748b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:21.916671 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f76b1-b109-4f46-babf-85504d4748b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:21.916809 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7514aa91-f677-4ed7-9def-0432a16b7e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:21.917072 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f76b1-b109-4f46-babf-85504d4748b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:21.917444 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f76b1-b109-4f46-babf-85504d4748b4 admin admin] PATH_INFO: `/v3/projects/f6d2d63d92e24e23b3c2d7d9815f8264/users/81bd8647699e4a8fa872b69b99fb4150/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:21.917734 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514aa91-f677-4ed7-9def-0432a16b7e68 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:21.918091 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514aa91-f677-4ed7-9def-0432a16b7e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:21.918433 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514aa91-f677-4ed7-9def-0432a16b7e68 admin admin] PATH_INFO: `/v3/projects/0906dc87a6614c0bb4fd4694ee00e6f7/users/36c8f4fda06e45ac840fd0937744e706/roles/0c67797d444d4c929b2ccab47c468848` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:21.937374 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7514aa91-f677-4ed7-9def-0432a16b7e68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0906dc87a6614c0bb4fd4694ee00e6f7, user_id=36c8f4fda06e45ac840fd0937744e706, role_id=0c67797d444d4c929b2ccab47c468848)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:21.937621 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13f76b1-b109-4f46-babf-85504d4748b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6d2d63d92e24e23b3c2d7d9815f8264, user_id=81bd8647699e4a8fa872b69b99fb4150, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:21.939655 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7514aa91-f677-4ed7-9def-0432a16b7e68 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:21.941937 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13f76b1-b109-4f46-babf-85504d4748b4 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:21.956807 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 993/1993] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:46:21 2022] PUT /identity/v3/projects/0906dc87a6614c0bb4fd4694ee00e6f7/users/36c8f4fda06e45ac840fd0937744e706/roles/0c67797d444d4c929b2ccab47c468848 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:21.967357 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1001/1994] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:46:21 2022] PUT /identity/v3/projects/f6d2d63d92e24e23b3c2d7d9815f8264/users/81bd8647699e4a8fa872b69b99fb4150/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:46:21.968068 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed88061-15da-48de-bce1-a65585047647 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:21.968713 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed88061-15da-48de-bce1-a65585047647 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:21.969000 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed88061-15da-48de-bce1-a65585047647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:21.971920 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13f76b1-b109-4f46-babf-85504d4748b4 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:22.001251 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-aed88061-15da-48de-bce1-a65585047647 None None] MFA Rules not processed for user `36c8f4fda06e45ac840fd0937744e706`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:22.002908 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-aed88061-15da-48de-bce1-a65585047647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:22.068786 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:22.072513 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13f76b1-b109-4f46-babf-85504d4748b4 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:22.080031 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f104ef-5a4c-4ddd-8806-66a56fe4adc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:22.080774 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f104ef-5a4c-4ddd-8806-66a56fe4adc7 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:22.081053 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f104ef-5a4c-4ddd-8806-66a56fe4adc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:22.081358 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f104ef-5a4c-4ddd-8806-66a56fe4adc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:22.082082 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f104ef-5a4c-4ddd-8806-66a56fe4adc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:22.084316 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f104ef-5a4c-4ddd-8806-66a56fe4adc7 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:22.105711 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1002/1995] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:46:21 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:46:22.107095 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f104ef-5a4c-4ddd-8806-66a56fe4adc7 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:22.118431 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 994/1996] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:46:22.119519 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f104ef-5a4c-4ddd-8806-66a56fe4adc7 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:22.119799 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed88061-15da-48de-bce1-a65585047647 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:22.125094 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1324fd34-0034-4bfc-8167-62028291b6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:22.125861 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1324fd34-0034-4bfc-8167-62028291b6c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:22.126226 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1324fd34-0034-4bfc-8167-62028291b6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:22.126406 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1324fd34-0034-4bfc-8167-62028291b6c3 admin admin] PATH_INFO: `/v3/projects/f6d2d63d92e24e23b3c2d7d9815f8264/users/81bd8647699e4a8fa872b69b99fb4150/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:22.128509 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1324fd34-0034-4bfc-8167-62028291b6c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6d2d63d92e24e23b3c2d7d9815f8264, user_id=81bd8647699e4a8fa872b69b99fb4150, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:22.131804 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1324fd34-0034-4bfc-8167-62028291b6c3 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:22.134213 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed88061-15da-48de-bce1-a65585047647 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:22.139546 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27b0049-92ab-4419-b98c-5b70c353d512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:22.140186 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b0049-92ab-4419-b98c-5b70c353d512 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:22.140467 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b0049-92ab-4419-b98c-5b70c353d512 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:22.140737 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b0049-92ab-4419-b98c-5b70c353d512 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:22.141552 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27b0049-92ab-4419-b98c-5b70c353d512 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:22.143633 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1003/1997] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:46:22 2022] PUT /identity/v3/projects/f6d2d63d92e24e23b3c2d7d9815f8264/users/81bd8647699e4a8fa872b69b99fb4150/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:22.144015 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27b0049-92ab-4419-b98c-5b70c353d512 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:22.155845 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5380c9d-9896-4fca-bf71-2e8cc5562229 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:22.155845 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5380c9d-9896-4fca-bf71-2e8cc5562229 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:22.155845 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5380c9d-9896-4fca-bf71-2e8cc5562229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:22.186185 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 995/1998] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:46:22 2022] POST /identity/v3/projects => generated 381 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:46:22.187356 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27b0049-92ab-4419-b98c-5b70c353d512 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:22.188559 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-b5380c9d-9896-4fca-bf71-2e8cc5562229 None None] MFA Rules not processed for user `81bd8647699e4a8fa872b69b99fb4150`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:22.189882 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-b5380c9d-9896-4fca-bf71-2e8cc5562229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:22.248871 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:22.272242 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27b0049-92ab-4419-b98c-5b70c353d512 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:22.280600 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1004/1999] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:22 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:46:22.285073 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6485a732-55b9-4cdc-98d7-99c3506c4851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:22.285828 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6485a732-55b9-4cdc-98d7-99c3506c4851 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:22.286446 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6485a732-55b9-4cdc-98d7-99c3506c4851 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:22.287473 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6485a732-55b9-4cdc-98d7-99c3506c4851 admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:22.288206 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6485a732-55b9-4cdc-98d7-99c3506c4851 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:22.290417 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6485a732-55b9-4cdc-98d7-99c3506c4851 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:22.292412 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5380c9d-9896-4fca-bf71-2e8cc5562229 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:22.293910 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-b5380c9d-9896-4fca-bf71-2e8cc5562229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:22.321436 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 996/2000] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:46:22 2022] POST /identity/v3/users => generated 297 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:46:22.325720 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6485a732-55b9-4cdc-98d7-99c3506c4851 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:22.337262 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6485a732-55b9-4cdc-98d7-99c3506c4851 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:22.352831 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d37660-3d4b-46ba-ac6c-b9a419461176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:22.353629 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d37660-3d4b-46ba-ac6c-b9a419461176 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:22.353906 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d37660-3d4b-46ba-ac6c-b9a419461176 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:22.354320 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d37660-3d4b-46ba-ac6c-b9a419461176 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:22.354968 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d37660-3d4b-46ba-ac6c-b9a419461176 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:22.356804 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d37660-3d4b-46ba-ac6c-b9a419461176 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:22.374105 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 997/2001] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:46:22 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:46:22.378510 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d37660-3d4b-46ba-ac6c-b9a419461176 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:22.383798 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5380c9d-9896-4fca-bf71-2e8cc5562229 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:22.390246 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4402ee8f-4ce5-4c02-89a5-f7160e3062f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:22.391156 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402ee8f-4ce5-4c02-89a5-f7160e3062f6 service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:22.391418 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d37660-3d4b-46ba-ac6c-b9a419461176 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:22.391541 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402ee8f-4ce5-4c02-89a5-f7160e3062f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:22.391829 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402ee8f-4ce5-4c02-89a5-f7160e3062f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:22.398004 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aefbd3-b0e8-42b1-bf8d-d145e1e24222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:22.398919 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aefbd3-b0e8-42b1-bf8d-d145e1e24222 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:22.399512 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aefbd3-b0e8-42b1-bf8d-d145e1e24222 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:22.399946 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aefbd3-b0e8-42b1-bf8d-d145e1e24222 admin admin] PATH_INFO: `/v3/projects/31bcc4a4722f4e3aa6a085d105fa1a47/users/d75dc27c0fb146a48bc51d11a5604ebf/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:22.403578 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4402ee8f-4ce5-4c02-89a5-f7160e3062f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:22.406295 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4402ee8f-4ce5-4c02-89a5-f7160e3062f6 service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:22.419591 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aefbd3-b0e8-42b1-bf8d-d145e1e24222 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31bcc4a4722f4e3aa6a085d105fa1a47, user_id=d75dc27c0fb146a48bc51d11a5604ebf, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:22.422406 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aefbd3-b0e8-42b1-bf8d-d145e1e24222 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:22.425222 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1005/2002] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:46:22 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:46:22.455521 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 998/2003] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:46:22 2022] PUT /identity/v3/projects/31bcc4a4722f4e3aa6a085d105fa1a47/users/d75dc27c0fb146a48bc51d11a5604ebf/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:46:22.459918 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4402ee8f-4ce5-4c02-89a5-f7160e3062f6 service cinder] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:22.483716 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4402ee8f-4ce5-4c02-89a5-f7160e3062f6 service cinder] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:22.578102 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae3bb4-b224-4491-b4ca-1e7c5ddceaa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:22.579092 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae3bb4-b224-4491-b4ca-1e7c5ddceaa9 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:22.579469 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae3bb4-b224-4491-b4ca-1e7c5ddceaa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:22.579841 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae3bb4-b224-4491-b4ca-1e7c5ddceaa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:22.580818 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ae3bb4-b224-4491-b4ca-1e7c5ddceaa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:22.583331 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ae3bb4-b224-4491-b4ca-1e7c5ddceaa9 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:22.601946 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aefbd3-b0e8-42b1-bf8d-d145e1e24222 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:22.602109 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1006/2004] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:46:22 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:46:22.602594 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-81aefbd3-b0e8-42b1-bf8d-d145e1e24222 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:22.604274 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae3bb4-b224-4491-b4ca-1e7c5ddceaa9 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:22.616766 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:22.624068 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae3bb4-b224-4491-b4ca-1e7c5ddceaa9 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:22.641551 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd43c1e9-a04a-402c-97ab-accd51028521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:22.642489 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43c1e9-a04a-402c-97ab-accd51028521 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:22.642489 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43c1e9-a04a-402c-97ab-accd51028521 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:22.642763 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43c1e9-a04a-402c-97ab-accd51028521 admin admin] PATH_INFO: `/v3/projects/31bcc4a4722f4e3aa6a085d105fa1a47/users/d75dc27c0fb146a48bc51d11a5604ebf/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:22.652703 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd43c1e9-a04a-402c-97ab-accd51028521 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31bcc4a4722f4e3aa6a085d105fa1a47, user_id=d75dc27c0fb146a48bc51d11a5604ebf, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:22.663158 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd43c1e9-a04a-402c-97ab-accd51028521 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:22.706463 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1007/2005] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:46:22 2022] PUT /identity/v3/projects/31bcc4a4722f4e3aa6a085d105fa1a47/users/d75dc27c0fb146a48bc51d11a5604ebf/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:46:22.717263 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3320109-dac1-4a8e-be3a-f90ceb9ec235 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:22.717263 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3320109-dac1-4a8e-be3a-f90ceb9ec235 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:22.717263 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3320109-dac1-4a8e-be3a-f90ceb9ec235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:22.773294 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-a3320109-dac1-4a8e-be3a-f90ceb9ec235 None None] MFA Rules not processed for user `d75dc27c0fb146a48bc51d11a5604ebf`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:22.774839 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-a3320109-dac1-4a8e-be3a-f90ceb9ec235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:22.805958 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aefbd3-b0e8-42b1-bf8d-d145e1e24222 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:22.904855 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1008/2006] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:22 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:46:22.907084 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886211f1-be81-4a8d-8e8a-55519d4e8e2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:22.907827 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886211f1-be81-4a8d-8e8a-55519d4e8e2c service cinder] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:22.908116 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886211f1-be81-4a8d-8e8a-55519d4e8e2c service cinder] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:22.908392 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886211f1-be81-4a8d-8e8a-55519d4e8e2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:22.915206 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3320109-dac1-4a8e-be3a-f90ceb9ec235 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:22.929225 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3320109-dac1-4a8e-be3a-f90ceb9ec235 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:22.933614 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81cd654-4e5b-43c3-9408-71e931288d1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:22.934300 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81cd654-4e5b-43c3-9408-71e931288d1a service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:22.934584 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81cd654-4e5b-43c3-9408-71e931288d1a service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:22.934949 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81cd654-4e5b-43c3-9408-71e931288d1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:22.947549 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81cd654-4e5b-43c3-9408-71e931288d1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:22.949514 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81cd654-4e5b-43c3-9408-71e931288d1a service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:22.962531 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1009/2007] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:46:22 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:46:23.013374 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886211f1-be81-4a8d-8e8a-55519d4e8e2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:23.013374 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886211f1-be81-4a8d-8e8a-55519d4e8e2c service cinder] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:23.028616 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 999/2008] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:46:22 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:46:23.151069 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81cd654-4e5b-43c3-9408-71e931288d1a service cinder] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:23.168896 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81cd654-4e5b-43c3-9408-71e931288d1a service cinder] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:23.177090 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c35bf1-b49c-40b6-9dc2-fca7d6db1f78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:23.180310 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c35bf1-b49c-40b6-9dc2-fca7d6db1f78 service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:23.180946 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c35bf1-b49c-40b6-9dc2-fca7d6db1f78 service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:23.181675 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c35bf1-b49c-40b6-9dc2-fca7d6db1f78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:23.320563 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c35bf1-b49c-40b6-9dc2-fca7d6db1f78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:23.322263 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c35bf1-b49c-40b6-9dc2-fca7d6db1f78 service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:23.335768 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1010/2009] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:46:23 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:46:23.815761 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886211f1-be81-4a8d-8e8a-55519d4e8e2c service cinder] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:23.818426 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-886211f1-be81-4a8d-8e8a-55519d4e8e2c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:23.834232 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:23.852424 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c35bf1-b49c-40b6-9dc2-fca7d6db1f78 service cinder] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:23.939939 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886211f1-be81-4a8d-8e8a-55519d4e8e2c service cinder] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:23.942600 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde8370-d87d-46a0-b715-f62be3d57c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:23.944051 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde8370-d87d-46a0-b715-f62be3d57c15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:23.944337 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde8370-d87d-46a0-b715-f62be3d57c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:23.944730 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde8370-d87d-46a0-b715-f62be3d57c15 admin admin] PATH_INFO: `/v3/users/2a74d6a7d2664ad59aa5e7a0d1c2194f` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:23.950155 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dde8370-d87d-46a0-b715-f62be3d57c15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a74d6a7d2664ad59aa5e7a0d1c2194f)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:23.951874 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dde8370-d87d-46a0-b715-f62be3d57c15 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:23.958274 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c35bf1-b49c-40b6-9dc2-fca7d6db1f78 service cinder] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:23.964638 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2bd9e0-71db-45d0-91de-8d12f0e8d435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:23.966299 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2bd9e0-71db-45d0-91de-8d12f0e8d435 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:23.966522 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2bd9e0-71db-45d0-91de-8d12f0e8d435 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:23.966803 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2bd9e0-71db-45d0-91de-8d12f0e8d435 admin admin] PATH_INFO: `/v3/users/36c8f4fda06e45ac840fd0937744e706` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:23.968133 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2bd9e0-71db-45d0-91de-8d12f0e8d435 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36c8f4fda06e45ac840fd0937744e706)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:23.973255 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2bd9e0-71db-45d0-91de-8d12f0e8d435 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:23.976242 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:24.026129 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-2dde8370-d87d-46a0-b715-f62be3d57c15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a74d6a7d2664ad59aa5e7a0d1c2194f'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:24.037107 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-2dde8370-d87d-46a0-b715-f62be3d57c15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a74d6a7d2664ad59aa5e7a0d1c2194f'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:24.038610 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-2dde8370-d87d-46a0-b715-f62be3d57c15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a74d6a7d2664ad59aa5e7a0d1c2194f'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:24.073969 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-2dde8370-d87d-46a0-b715-f62be3d57c15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a74d6a7d2664ad59aa5e7a0d1c2194f'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:24.076925 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-ae2bd9e0-71db-45d0-91de-8d12f0e8d435 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36c8f4fda06e45ac840fd0937744e706'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:24.091112 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-ae2bd9e0-71db-45d0-91de-8d12f0e8d435 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36c8f4fda06e45ac840fd0937744e706'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:24.091873 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-ae2bd9e0-71db-45d0-91de-8d12f0e8d435 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36c8f4fda06e45ac840fd0937744e706'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:24.108188 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-ae2bd9e0-71db-45d0-91de-8d12f0e8d435 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36c8f4fda06e45ac840fd0937744e706'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:24.108188 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-ae2bd9e0-71db-45d0-91de-8d12f0e8d435 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36c8f4fda06e45ac840fd0937744e706'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:24.108376 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-2dde8370-d87d-46a0-b715-f62be3d57c15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a74d6a7d2664ad59aa5e7a0d1c2194f'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:24.118875 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1000/2010] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:46:23 2022] DELETE /identity/v3/users/2a74d6a7d2664ad59aa5e7a0d1c2194f => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:24.120463 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1347805-6733-4c1b-b6a4-c3e1ebfd1257 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:24.121107 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1347805-6733-4c1b-b6a4-c3e1ebfd1257 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:24.121342 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1347805-6733-4c1b-b6a4-c3e1ebfd1257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:24.128103 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1011/2011] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:46:23 2022] DELETE /identity/v3/users/36c8f4fda06e45ac840fd0937744e706 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:46:24.135650 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338a7a6-1d1e-4be7-9903-bfc3000362b2 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:24.135937 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338a7a6-1d1e-4be7-9903-bfc3000362b2 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:24.136269 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338a7a6-1d1e-4be7-9903-bfc3000362b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:24.158752 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-d1347805-6733-4c1b-b6a4-c3e1ebfd1257 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:24.161713 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-4338a7a6-1d1e-4be7-9903-bfc3000362b2 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:24.163335 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-d1347805-6733-4c1b-b6a4-c3e1ebfd1257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:24.175986 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-4338a7a6-1d1e-4be7-9903-bfc3000362b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:24.255793 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1012/2012] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:46:24.267019 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4338a7a6-1d1e-4be7-9903-bfc3000362b2 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:24.268760 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-4338a7a6-1d1e-4be7-9903-bfc3000362b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:24.269827 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1001/2013] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:46:24.290268 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1347805-6733-4c1b-b6a4-c3e1ebfd1257 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:24.292257 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-d1347805-6733-4c1b-b6a4-c3e1ebfd1257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:24.367014 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:24.381168 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4338a7a6-1d1e-4be7-9903-bfc3000362b2 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:24.385265 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2803bcf1-660e-48fb-9e14-ebbce8ae9436 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:24.386001 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803bcf1-660e-48fb-9e14-ebbce8ae9436 service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:24.386283 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803bcf1-660e-48fb-9e14-ebbce8ae9436 service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:24.386550 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803bcf1-660e-48fb-9e14-ebbce8ae9436 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:24.396626 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2803bcf1-660e-48fb-9e14-ebbce8ae9436 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:24.398125 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2803bcf1-660e-48fb-9e14-ebbce8ae9436 service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:24.409157 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1013/2014] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:46:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:46:24.412749 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1347805-6733-4c1b-b6a4-c3e1ebfd1257 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:24.417552 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0952fb5f-f2c6-48d2-9eab-c1b93c71e021 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:24.418390 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952fb5f-f2c6-48d2-9eab-c1b93c71e021 service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:24.418860 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952fb5f-f2c6-48d2-9eab-c1b93c71e021 service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:24.419283 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952fb5f-f2c6-48d2-9eab-c1b93c71e021 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:24.431360 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0952fb5f-f2c6-48d2-9eab-c1b93c71e021 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:24.433556 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0952fb5f-f2c6-48d2-9eab-c1b93c71e021 service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:24.446972 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1002/2015] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:46:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:46:24.823873 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2803bcf1-660e-48fb-9e14-ebbce8ae9436 service neutron] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:24.827025 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-2803bcf1-660e-48fb-9e14-ebbce8ae9436 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:24.842679 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2803bcf1-660e-48fb-9e14-ebbce8ae9436 service neutron] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:24.851599 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1265392e-f287-438a-9b94-119ede874f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:24.852998 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265392e-f287-438a-9b94-119ede874f07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:24.852998 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265392e-f287-438a-9b94-119ede874f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:24.853403 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265392e-f287-438a-9b94-119ede874f07 admin admin] PATH_INFO: `/v3/projects/0906dc87a6614c0bb4fd4694ee00e6f7` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:24.855010 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1265392e-f287-438a-9b94-119ede874f07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0906dc87a6614c0bb4fd4694ee00e6f7)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:24.857502 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1265392e-f287-438a-9b94-119ede874f07 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:24.896474 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:24.922701 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0952fb5f-f2c6-48d2-9eab-c1b93c71e021 service neutron] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:24.924175 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-0952fb5f-f2c6-48d2-9eab-c1b93c71e021 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:24.934609 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-1265392e-f287-438a-9b94-119ede874f07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0906dc87a6614c0bb4fd4694ee00e6f7', 'request_id': 'req-1265392e-f287-438a-9b94-119ede874f07'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:24.941996 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-1265392e-f287-438a-9b94-119ede874f07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0906dc87a6614c0bb4fd4694ee00e6f7', 'request_id': 'req-1265392e-f287-438a-9b94-119ede874f07'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:24.946614 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0952fb5f-f2c6-48d2-9eab-c1b93c71e021 service neutron] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:24.951246 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-1265392e-f287-438a-9b94-119ede874f07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0906dc87a6614c0bb4fd4694ee00e6f7', 'request_id': 'req-1265392e-f287-438a-9b94-119ede874f07'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:24.969009 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-1265392e-f287-438a-9b94-119ede874f07 admin admin] The token cache is being invalidate because project 0906dc87a6614c0bb4fd4694ee00e6f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:46:24.969486 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-1265392e-f287-438a-9b94-119ede874f07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:24.970176 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-1265392e-f287-438a-9b94-119ede874f07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:24.972298 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1014/2016] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:46:24 2022] DELETE /identity/v3/projects/0906dc87a6614c0bb4fd4694ee00e6f7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:24.977660 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1265392e-f287-438a-9b94-119ede874f07 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:24.979110 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-1265392e-f287-438a-9b94-119ede874f07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:25.016966 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b13aed-c95a-4885-8d08-e00133c6e7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:25.017871 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b13aed-c95a-4885-8d08-e00133c6e7a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:25.018366 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b13aed-c95a-4885-8d08-e00133c6e7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:25.018851 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b13aed-c95a-4885-8d08-e00133c6e7a3 admin admin] PATH_INFO: `/v3/projects/845590146e3b4495ad4d8c9187729ed7` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:25.020172 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b13aed-c95a-4885-8d08-e00133c6e7a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=845590146e3b4495ad4d8c9187729ed7)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:25.022171 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b13aed-c95a-4885-8d08-e00133c6e7a3 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:25.054858 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1265392e-f287-438a-9b94-119ede874f07 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:25.060017 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac20de23-2cf2-450e-97b9-04f63433ad1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:25.060692 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20de23-2cf2-450e-97b9-04f63433ad1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:25.060957 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20de23-2cf2-450e-97b9-04f63433ad1b admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:25.061272 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20de23-2cf2-450e-97b9-04f63433ad1b admin admin] PATH_INFO: `/v3/users/d75dc27c0fb146a48bc51d11a5604ebf` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:25.062523 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac20de23-2cf2-450e-97b9-04f63433ad1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d75dc27c0fb146a48bc51d11a5604ebf)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:25.064446 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac20de23-2cf2-450e-97b9-04f63433ad1b admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:25.074141 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-80b13aed-c95a-4885-8d08-e00133c6e7a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '845590146e3b4495ad4d8c9187729ed7', 'request_id': 'req-80b13aed-c95a-4885-8d08-e00133c6e7a3'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:25.087353 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-80b13aed-c95a-4885-8d08-e00133c6e7a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '845590146e3b4495ad4d8c9187729ed7', 'request_id': 'req-80b13aed-c95a-4885-8d08-e00133c6e7a3'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:25.093862 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-80b13aed-c95a-4885-8d08-e00133c6e7a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '845590146e3b4495ad4d8c9187729ed7', 'request_id': 'req-80b13aed-c95a-4885-8d08-e00133c6e7a3'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:25.109036 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-80b13aed-c95a-4885-8d08-e00133c6e7a3 admin admin] The token cache is being invalidate because project 845590146e3b4495ad4d8c9187729ed7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:46:25.109399 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-80b13aed-c95a-4885-8d08-e00133c6e7a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:25.110180 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-80b13aed-c95a-4885-8d08-e00133c6e7a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:25.113406 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1003/2017] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:46:24 2022] DELETE /identity/v3/projects/845590146e3b4495ad4d8c9187729ed7 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:46:25.117073 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b13aed-c95a-4885-8d08-e00133c6e7a3 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:25.118719 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-80b13aed-c95a-4885-8d08-e00133c6e7a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:25.129771 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-ac20de23-2cf2-450e-97b9-04f63433ad1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd75dc27c0fb146a48bc51d11a5604ebf'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:25.140632 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-ac20de23-2cf2-450e-97b9-04f63433ad1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd75dc27c0fb146a48bc51d11a5604ebf'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:25.141705 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-ac20de23-2cf2-450e-97b9-04f63433ad1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd75dc27c0fb146a48bc51d11a5604ebf'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:25.157894 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-ac20de23-2cf2-450e-97b9-04f63433ad1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd75dc27c0fb146a48bc51d11a5604ebf'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:25.158532 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-ac20de23-2cf2-450e-97b9-04f63433ad1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd75dc27c0fb146a48bc51d11a5604ebf'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:25.184167 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1015/2018] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:46:24 2022] DELETE /identity/v3/users/d75dc27c0fb146a48bc51d11a5604ebf => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:46:25.202528 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b13aed-c95a-4885-8d08-e00133c6e7a3 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:25.207272 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:25.277061 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d296bde-ec5f-4a77-a145-c617374ded02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:25.278042 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d296bde-ec5f-4a77-a145-c617374ded02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:25.280100 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d296bde-ec5f-4a77-a145-c617374ded02 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:25.282159 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d296bde-ec5f-4a77-a145-c617374ded02 admin admin] PATH_INFO: `/v3/users/2cc5a974e10744bbbfb7c3783d4def83` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:25.283924 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d296bde-ec5f-4a77-a145-c617374ded02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cc5a974e10744bbbfb7c3783d4def83)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:25.286256 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d296bde-ec5f-4a77-a145-c617374ded02 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:25.405426 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-3d296bde-ec5f-4a77-a145-c617374ded02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cc5a974e10744bbbfb7c3783d4def83'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:25.414377 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-3d296bde-ec5f-4a77-a145-c617374ded02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cc5a974e10744bbbfb7c3783d4def83'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:25.415253 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-3d296bde-ec5f-4a77-a145-c617374ded02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cc5a974e10744bbbfb7c3783d4def83'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:25.430081 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-3d296bde-ec5f-4a77-a145-c617374ded02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cc5a974e10744bbbfb7c3783d4def83'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:25.439094 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-3d296bde-ec5f-4a77-a145-c617374ded02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cc5a974e10744bbbfb7c3783d4def83'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:25.446274 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1004/2019] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:46:25 2022] DELETE /identity/v3/users/2cc5a974e10744bbbfb7c3783d4def83 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:46:25.670756 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac20de23-2cf2-450e-97b9-04f63433ad1b admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:25.673108 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-ac20de23-2cf2-450e-97b9-04f63433ad1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:25.694585 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac20de23-2cf2-450e-97b9-04f63433ad1b admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:25.723921 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:25.764643 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9683a85-6d0b-4c05-b174-ead5c1bf1897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:25.765435 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9683a85-6d0b-4c05-b174-ead5c1bf1897 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:25.765848 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9683a85-6d0b-4c05-b174-ead5c1bf1897 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:25.766218 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9683a85-6d0b-4c05-b174-ead5c1bf1897 admin admin] PATH_INFO: `/v3/projects/31bcc4a4722f4e3aa6a085d105fa1a47` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:25.767661 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9683a85-6d0b-4c05-b174-ead5c1bf1897 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31bcc4a4722f4e3aa6a085d105fa1a47)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:25.769557 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9683a85-6d0b-4c05-b174-ead5c1bf1897 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:25.798577 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d296bde-ec5f-4a77-a145-c617374ded02 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:25.800190 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-3d296bde-ec5f-4a77-a145-c617374ded02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:25.817241 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d296bde-ec5f-4a77-a145-c617374ded02 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:25.832683 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-c9683a85-6d0b-4c05-b174-ead5c1bf1897 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31bcc4a4722f4e3aa6a085d105fa1a47', 'request_id': 'req-c9683a85-6d0b-4c05-b174-ead5c1bf1897'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:25.839813 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-c9683a85-6d0b-4c05-b174-ead5c1bf1897 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31bcc4a4722f4e3aa6a085d105fa1a47', 'request_id': 'req-c9683a85-6d0b-4c05-b174-ead5c1bf1897'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:25.845964 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-c9683a85-6d0b-4c05-b174-ead5c1bf1897 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31bcc4a4722f4e3aa6a085d105fa1a47', 'request_id': 'req-c9683a85-6d0b-4c05-b174-ead5c1bf1897'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:25.862830 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-c9683a85-6d0b-4c05-b174-ead5c1bf1897 admin admin] The token cache is being invalidate because project 31bcc4a4722f4e3aa6a085d105fa1a47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:46:25.863126 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-c9683a85-6d0b-4c05-b174-ead5c1bf1897 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:25.863808 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-c9683a85-6d0b-4c05-b174-ead5c1bf1897 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:25.866146 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1016/2020] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:46:25 2022] DELETE /identity/v3/projects/31bcc4a4722f4e3aa6a085d105fa1a47 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:25.870915 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a3800-a99a-4511-8cd6-cd669fb1154b None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:25.871209 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a3800-a99a-4511-8cd6-cd669fb1154b None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:25.871486 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a3800-a99a-4511-8cd6-cd669fb1154b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:25.891410 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50878dcd-2ad0-49d0-b9cf-d6007fe6e207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:25.892042 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50878dcd-2ad0-49d0-b9cf-d6007fe6e207 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:25.892326 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50878dcd-2ad0-49d0-b9cf-d6007fe6e207 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:25.892765 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50878dcd-2ad0-49d0-b9cf-d6007fe6e207 admin admin] PATH_INFO: `/v3/projects/ed9b5a3b7fcb48cdb55214f5be4c7641` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:25.892942 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-bc8a3800-a99a-4511-8cd6-cd669fb1154b None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:25.894102 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50878dcd-2ad0-49d0-b9cf-d6007fe6e207 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed9b5a3b7fcb48cdb55214f5be4c7641)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:25.894218 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-bc8a3800-a99a-4511-8cd6-cd669fb1154b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:25.896048 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50878dcd-2ad0-49d0-b9cf-d6007fe6e207 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:25.902997 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1017/2021] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:46:25.912411 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b81a1cd-2ca7-46e5-8585-38cc6b25f71a None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:25.912736 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b81a1cd-2ca7-46e5-8585-38cc6b25f71a None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:25.913020 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b81a1cd-2ca7-46e5-8585-38cc6b25f71a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:25.935278 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-5b81a1cd-2ca7-46e5-8585-38cc6b25f71a None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:25.935670 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:25.936854 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-5b81a1cd-2ca7-46e5-8585-38cc6b25f71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:25.955208 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-50878dcd-2ad0-49d0-b9cf-d6007fe6e207 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed9b5a3b7fcb48cdb55214f5be4c7641', 'request_id': 'req-50878dcd-2ad0-49d0-b9cf-d6007fe6e207'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:25.966028 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-50878dcd-2ad0-49d0-b9cf-d6007fe6e207 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed9b5a3b7fcb48cdb55214f5be4c7641', 'request_id': 'req-50878dcd-2ad0-49d0-b9cf-d6007fe6e207'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:25.974186 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-50878dcd-2ad0-49d0-b9cf-d6007fe6e207 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed9b5a3b7fcb48cdb55214f5be4c7641', 'request_id': 'req-50878dcd-2ad0-49d0-b9cf-d6007fe6e207'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:25.989278 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-50878dcd-2ad0-49d0-b9cf-d6007fe6e207 admin admin] The token cache is being invalidate because project ed9b5a3b7fcb48cdb55214f5be4c7641 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:46:25.990196 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-50878dcd-2ad0-49d0-b9cf-d6007fe6e207 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:25.991042 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-50878dcd-2ad0-49d0-b9cf-d6007fe6e207 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:25.992871 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1005/2022] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:46:25 2022] DELETE /identity/v3/projects/ed9b5a3b7fcb48cdb55214f5be4c7641 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:46:25.997850 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50878dcd-2ad0-49d0-b9cf-d6007fe6e207 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:25.999216 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-50878dcd-2ad0-49d0-b9cf-d6007fe6e207 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:26.008828 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1018/2023] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:46:26.014352 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647635a5-c054-44d2-9489-c51cb44d15a5 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:26.014772 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647635a5-c054-44d2-9489-c51cb44d15a5 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:26.015115 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647635a5-c054-44d2-9489-c51cb44d15a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:26.037289 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-647635a5-c054-44d2-9489-c51cb44d15a5 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:26.038612 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-647635a5-c054-44d2-9489-c51cb44d15a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:26.046834 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1019/2024] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:46:26.054440 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647635a5-c054-44d2-9489-c51cb44d15a5 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:26.064189 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647635a5-c054-44d2-9489-c51cb44d15a5 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:26.070385 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e341097f-ac70-49bc-a7a7-0b3fdf8a288f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:26.070997 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341097f-ac70-49bc-a7a7-0b3fdf8a288f admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:26.071273 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341097f-ac70-49bc-a7a7-0b3fdf8a288f admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:26.071559 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341097f-ac70-49bc-a7a7-0b3fdf8a288f admin admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:26.072210 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e341097f-ac70-49bc-a7a7-0b3fdf8a288f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:46:26.072535 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e341097f-ac70-49bc-a7a7-0b3fdf8a288f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:26.075048 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e341097f-ac70-49bc-a7a7-0b3fdf8a288f admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:26.078277 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50878dcd-2ad0-49d0-b9cf-d6007fe6e207 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:26.086371 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9f4395-90fb-4ff9-a588-8c6b4b465f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:26.087064 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f4395-90fb-4ff9-a588-8c6b4b465f83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:26.087368 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f4395-90fb-4ff9-a588-8c6b4b465f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:26.087625 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f4395-90fb-4ff9-a588-8c6b4b465f83 admin admin] PATH_INFO: `/v3/users/46f6ada2d7e4495c93bb8751c1f9adc6` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:26.088781 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9f4395-90fb-4ff9-a588-8c6b4b465f83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46f6ada2d7e4495c93bb8751c1f9adc6)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:26.090858 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9f4395-90fb-4ff9-a588-8c6b4b465f83 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:26.095442 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1020/2025] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Aug 29 22:46:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:46:26.095442 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6162d46-468c-484f-a582-e0ad23f8defe None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:26.095442 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6162d46-468c-484f-a582-e0ad23f8defe None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:26.095442 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6162d46-468c-484f-a582-e0ad23f8defe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:26.115240 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-d6162d46-468c-484f-a582-e0ad23f8defe None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:26.116368 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-d6162d46-468c-484f-a582-e0ad23f8defe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:26.126283 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1021/2026] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:46:26.127361 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6162d46-468c-484f-a582-e0ad23f8defe None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:26.138268 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6162d46-468c-484f-a582-e0ad23f8defe None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:26.143203 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc363473-8040-4704-9ea9-209f6275c0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:26.144065 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc363473-8040-4704-9ea9-209f6275c0a6 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:26.144365 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc363473-8040-4704-9ea9-209f6275c0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:26.144637 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc363473-8040-4704-9ea9-209f6275c0a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:26.145273 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc363473-8040-4704-9ea9-209f6275c0a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:26.145646 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-ff9f4395-90fb-4ff9-a588-8c6b4b465f83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46f6ada2d7e4495c93bb8751c1f9adc6'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:26.147404 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc363473-8040-4704-9ea9-209f6275c0a6 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:26.158489 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-ff9f4395-90fb-4ff9-a588-8c6b4b465f83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46f6ada2d7e4495c93bb8751c1f9adc6'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:26.159325 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-ff9f4395-90fb-4ff9-a588-8c6b4b465f83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46f6ada2d7e4495c93bb8751c1f9adc6'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:26.175357 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-ff9f4395-90fb-4ff9-a588-8c6b4b465f83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46f6ada2d7e4495c93bb8751c1f9adc6'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:26.179363 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1022/2027] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:46:26 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:46:26.180341 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc363473-8040-4704-9ea9-209f6275c0a6 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:26.185083 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:26.186350 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-ff9f4395-90fb-4ff9-a588-8c6b4b465f83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46f6ada2d7e4495c93bb8751c1f9adc6'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:26.193996 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1006/2028] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:46:25 2022] DELETE /identity/v3/users/46f6ada2d7e4495c93bb8751c1f9adc6 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:26.195628 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9f4395-90fb-4ff9-a588-8c6b4b465f83 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:26.196933 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-ff9f4395-90fb-4ff9-a588-8c6b4b465f83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:26.248853 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:26.258662 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc363473-8040-4704-9ea9-209f6275c0a6 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:26.285856 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9f4395-90fb-4ff9-a588-8c6b4b465f83 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:26.295643 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32354328-942d-4f7c-8c6d-83539662f8c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:26.296335 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32354328-942d-4f7c-8c6d-83539662f8c9 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:26.296583 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32354328-942d-4f7c-8c6d-83539662f8c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:26.296864 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32354328-942d-4f7c-8c6d-83539662f8c9 admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:26.297626 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32354328-942d-4f7c-8c6d-83539662f8c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:26.299544 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32354328-942d-4f7c-8c6d-83539662f8c9 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:26.328138 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1007/2029] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:46:26 2022] POST /identity/v3/users => generated 292 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:46:26.334232 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6bf07-7c28-4a89-99e1-713d813e8ae8 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:26.334958 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6bf07-7c28-4a89-99e1-713d813e8ae8 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:26.335283 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6bf07-7c28-4a89-99e1-713d813e8ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:26.363664 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-01e6bf07-7c28-4a89-99e1-713d813e8ae8 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:26.365765 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2d1708-3efe-464b-97d6-854b0617fbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:26.366047 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-01e6bf07-7c28-4a89-99e1-713d813e8ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:26.366759 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d1708-3efe-464b-97d6-854b0617fbe4 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:26.367258 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d1708-3efe-464b-97d6-854b0617fbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:26.367751 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d1708-3efe-464b-97d6-854b0617fbe4 admin admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:26.368935 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2d1708-3efe-464b-97d6-854b0617fbe4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:46:26.369547 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2d1708-3efe-464b-97d6-854b0617fbe4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:26.372643 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2d1708-3efe-464b-97d6-854b0617fbe4 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:26.376681 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1008/2030] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:46:26.377716 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e6bf07-7c28-4a89-99e1-713d813e8ae8 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:26.398709 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1023/2031] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Aug 29 22:46:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:46:26.400108 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2d1708-3efe-464b-97d6-854b0617fbe4 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:26.402997 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-2c2d1708-3efe-464b-97d6-854b0617fbe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:26.405409 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e6bf07-7c28-4a89-99e1-713d813e8ae8 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:26.411156 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbaabfe-5f2a-4cbb-90c2-e82e662b98f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:26.412091 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbaabfe-5f2a-4cbb-90c2-e82e662b98f6 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:26.412593 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbaabfe-5f2a-4cbb-90c2-e82e662b98f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:26.413012 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbaabfe-5f2a-4cbb-90c2-e82e662b98f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:26.413678 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbaabfe-5f2a-4cbb-90c2-e82e662b98f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:26.415407 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbaabfe-5f2a-4cbb-90c2-e82e662b98f6 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:26.426235 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1009/2032] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:46:26 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:46:26.430309 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbaabfe-5f2a-4cbb-90c2-e82e662b98f6 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:26.432080 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-2fbaabfe-5f2a-4cbb-90c2-e82e662b98f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:26.445970 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbaabfe-5f2a-4cbb-90c2-e82e662b98f6 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:26.453479 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1a49aa-464e-4c23-be2f-5cf7f46b9f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:26.454552 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a49aa-464e-4c23-be2f-5cf7f46b9f87 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:26.455570 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a49aa-464e-4c23-be2f-5cf7f46b9f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:26.456083 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a49aa-464e-4c23-be2f-5cf7f46b9f87 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:26.456853 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1a49aa-464e-4c23-be2f-5cf7f46b9f87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:26.459908 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1a49aa-464e-4c23-be2f-5cf7f46b9f87 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:26.489906 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2d1708-3efe-464b-97d6-854b0617fbe4 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:26.495024 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30088338-9934-4f70-a161-dac1eca43e74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:26.497369 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1010/2033] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:46:26 2022] POST /identity/v3/projects => generated 383 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:46:26.497514 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30088338-9934-4f70-a161-dac1eca43e74 service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:26.497514 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30088338-9934-4f70-a161-dac1eca43e74 service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:26.497514 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30088338-9934-4f70-a161-dac1eca43e74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:26.497793 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1a49aa-464e-4c23-be2f-5cf7f46b9f87 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:26.513667 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30088338-9934-4f70-a161-dac1eca43e74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:26.515748 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30088338-9934-4f70-a161-dac1eca43e74 service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:26.527655 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1024/2034] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:46:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:46:26.528550 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30088338-9934-4f70-a161-dac1eca43e74 service neutron] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:26.539851 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30088338-9934-4f70-a161-dac1eca43e74 service neutron] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:26.599284 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1a49aa-464e-4c23-be2f-5cf7f46b9f87 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:26.606506 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3440a2a7-4f61-4d5b-beb3-b1c00aff9726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:26.607142 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440a2a7-4f61-4d5b-beb3-b1c00aff9726 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:26.607830 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440a2a7-4f61-4d5b-beb3-b1c00aff9726 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:26.608071 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440a2a7-4f61-4d5b-beb3-b1c00aff9726 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:26.609143 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3440a2a7-4f61-4d5b-beb3-b1c00aff9726 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:26.611465 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3440a2a7-4f61-4d5b-beb3-b1c00aff9726 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:26.613945 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:26.634763 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1011/2035] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:46:26 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:46:26.640091 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3440a2a7-4f61-4d5b-beb3-b1c00aff9726 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:26.641051 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8492263-0a18-48bc-98ec-6986db889aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:26.642763 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8492263-0a18-48bc-98ec-6986db889aa7 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:26.642992 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8492263-0a18-48bc-98ec-6986db889aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:26.643514 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8492263-0a18-48bc-98ec-6986db889aa7 admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:26.644134 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8492263-0a18-48bc-98ec-6986db889aa7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:26.651090 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8492263-0a18-48bc-98ec-6986db889aa7 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:26.657681 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3440a2a7-4f61-4d5b-beb3-b1c00aff9726 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:26.663506 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63db948-9405-49e6-a80d-eaaa024457ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:26.664331 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63db948-9405-49e6-a80d-eaaa024457ac admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:26.664710 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63db948-9405-49e6-a80d-eaaa024457ac admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:26.665186 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63db948-9405-49e6-a80d-eaaa024457ac admin admin] PATH_INFO: `/v3/projects/ae6433659a0a4c6982b6c303035da5e9/users/509483e9f4da44eaa13e1b8419038151/roles/0c67797d444d4c929b2ccab47c468848` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:26.687800 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63db948-9405-49e6-a80d-eaaa024457ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae6433659a0a4c6982b6c303035da5e9, user_id=509483e9f4da44eaa13e1b8419038151, role_id=0c67797d444d4c929b2ccab47c468848)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:26.689169 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1025/2036] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:46:26 2022] POST /identity/v3/users => generated 292 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:46:26.694987 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8492263-0a18-48bc-98ec-6986db889aa7 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:26.695358 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63db948-9405-49e6-a80d-eaaa024457ac admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:26.712019 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8492263-0a18-48bc-98ec-6986db889aa7 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:26.736644 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1012/2037] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:46:26 2022] PUT /identity/v3/projects/ae6433659a0a4c6982b6c303035da5e9/users/509483e9f4da44eaa13e1b8419038151/roles/0c67797d444d4c929b2ccab47c468848 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:26.738538 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40659d9d-8d29-45e5-8779-f70647566480 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:26.738609 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40659d9d-8d29-45e5-8779-f70647566480 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:26.738879 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40659d9d-8d29-45e5-8779-f70647566480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:26.789794 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-40659d9d-8d29-45e5-8779-f70647566480 None None] MFA Rules not processed for user `509483e9f4da44eaa13e1b8419038151`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:26.789794 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-40659d9d-8d29-45e5-8779-f70647566480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:26.883699 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a6c346-f525-4ba9-818b-8a4aa372bf08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:26.884491 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a6c346-f525-4ba9-818b-8a4aa372bf08 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:26.884897 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a6c346-f525-4ba9-818b-8a4aa372bf08 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:26.885281 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a6c346-f525-4ba9-818b-8a4aa372bf08 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:26.886116 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a6c346-f525-4ba9-818b-8a4aa372bf08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:26.894844 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a6c346-f525-4ba9-818b-8a4aa372bf08 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:26.913643 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1026/2038] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:46:26 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:46:26.915773 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a6c346-f525-4ba9-818b-8a4aa372bf08 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:26.918729 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:26.929322 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a6c346-f525-4ba9-818b-8a4aa372bf08 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:26.934864 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b429e6-85d7-42c2-8438-40cdbb75365b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:26.935484 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b429e6-85d7-42c2-8438-40cdbb75365b admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:26.935768 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b429e6-85d7-42c2-8438-40cdbb75365b admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:26.936043 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b429e6-85d7-42c2-8438-40cdbb75365b admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:26.937106 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b429e6-85d7-42c2-8438-40cdbb75365b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:26.938930 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b429e6-85d7-42c2-8438-40cdbb75365b admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:26.950892 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1013/2039] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:46:26.957970 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1027/2040] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:46:26 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:46:26.962506 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40659d9d-8d29-45e5-8779-f70647566480 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:26.963767 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b429e6-85d7-42c2-8438-40cdbb75365b admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:26.967372 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-79b429e6-85d7-42c2-8438-40cdbb75365b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:26.983934 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40659d9d-8d29-45e5-8779-f70647566480 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:26.991720 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd8de9-98e2-4f9c-9e49-ead2066f115b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:26.992523 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd8de9-98e2-4f9c-9e49-ead2066f115b admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:26.992880 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd8de9-98e2-4f9c-9e49-ead2066f115b admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:26.993251 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd8de9-98e2-4f9c-9e49-ead2066f115b admin admin] PATH_INFO: `/v3/projects/3ff4826db4e041ecbd7c44a7fee9b9c0/users/aedc01a664484c479b0fa28b0315eaa9/roles/0c67797d444d4c929b2ccab47c468848` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:27.014465 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dd8de9-98e2-4f9c-9e49-ead2066f115b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ff4826db4e041ecbd7c44a7fee9b9c0, user_id=aedc01a664484c479b0fa28b0315eaa9, role_id=0c67797d444d4c929b2ccab47c468848)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:27.023102 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dd8de9-98e2-4f9c-9e49-ead2066f115b admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:27.045426 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1014/2041] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:46:26 2022] PUT /identity/v3/projects/3ff4826db4e041ecbd7c44a7fee9b9c0/users/aedc01a664484c479b0fa28b0315eaa9/roles/0c67797d444d4c929b2ccab47c468848 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:27.046349 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd8de9-98e2-4f9c-9e49-ead2066f115b admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:27.053098 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-e6dd8de9-98e2-4f9c-9e49-ead2066f115b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:27.090807 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b429e6-85d7-42c2-8438-40cdbb75365b admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:27.141018 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd8de9-98e2-4f9c-9e49-ead2066f115b admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:27.147788 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e754634-a3a6-4595-992e-cd6a2a8a752d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:27.148442 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e754634-a3a6-4595-992e-cd6a2a8a752d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:27.149058 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e754634-a3a6-4595-992e-cd6a2a8a752d admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:27.149370 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e754634-a3a6-4595-992e-cd6a2a8a752d admin admin] PATH_INFO: `/v3/projects/743cdd59fafb4a97b4d1bfb5384eb917` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:27.150704 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e754634-a3a6-4595-992e-cd6a2a8a752d admin admin] RBAC: Authorizing `identity:delete_project(project_id=743cdd59fafb4a97b4d1bfb5384eb917)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:27.152622 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e754634-a3a6-4595-992e-cd6a2a8a752d admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:27.159072 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7a164b-2d99-4269-9065-9dda2ea963b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:27.160324 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a164b-2d99-4269-9065-9dda2ea963b3 service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:27.160748 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a164b-2d99-4269-9065-9dda2ea963b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:27.162220 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a164b-2d99-4269-9065-9dda2ea963b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:27.196820 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:27.221046 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-7e754634-a3a6-4595-992e-cd6a2a8a752d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '743cdd59fafb4a97b4d1bfb5384eb917', 'request_id': 'req-7e754634-a3a6-4595-992e-cd6a2a8a752d'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:27.228740 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-7e754634-a3a6-4595-992e-cd6a2a8a752d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '743cdd59fafb4a97b4d1bfb5384eb917', 'request_id': 'req-7e754634-a3a6-4595-992e-cd6a2a8a752d'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:27.228919 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7a164b-2d99-4269-9065-9dda2ea963b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:27.231404 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7a164b-2d99-4269-9065-9dda2ea963b3 service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:27.240818 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-7e754634-a3a6-4595-992e-cd6a2a8a752d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '743cdd59fafb4a97b4d1bfb5384eb917', 'request_id': 'req-7e754634-a3a6-4595-992e-cd6a2a8a752d'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:27.244612 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1028/2042] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:46:26 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:46:27.245984 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481b4cb1-31b3-40a8-8ad2-9913a750a38b None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:27.246423 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481b4cb1-31b3-40a8-8ad2-9913a750a38b None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:27.246851 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481b4cb1-31b3-40a8-8ad2-9913a750a38b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:27.273886 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-7e754634-a3a6-4595-992e-cd6a2a8a752d admin admin] The token cache is being invalidate because project 743cdd59fafb4a97b4d1bfb5384eb917 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:46:27.274377 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-7e754634-a3a6-4595-992e-cd6a2a8a752d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:27.276017 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-7e754634-a3a6-4595-992e-cd6a2a8a752d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:27.279404 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1015/2043] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:46:27 2022] DELETE /identity/v3/projects/743cdd59fafb4a97b4d1bfb5384eb917 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:27.284597 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e754634-a3a6-4595-992e-cd6a2a8a752d admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:27.291026 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-7e754634-a3a6-4595-992e-cd6a2a8a752d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:27.308946 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-481b4cb1-31b3-40a8-8ad2-9913a750a38b None None] MFA Rules not processed for user `aedc01a664484c479b0fa28b0315eaa9`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:27.310371 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-481b4cb1-31b3-40a8-8ad2-9913a750a38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:27.363977 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:27.381192 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e754634-a3a6-4595-992e-cd6a2a8a752d admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:27.387999 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e2dac7-c0d0-4583-8192-71071d6d0c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:27.389292 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2dac7-c0d0-4583-8192-71071d6d0c10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:27.390211 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2dac7-c0d0-4583-8192-71071d6d0c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:27.390559 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2dac7-c0d0-4583-8192-71071d6d0c10 admin admin] PATH_INFO: `/v3/users/509483e9f4da44eaa13e1b8419038151` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:27.391816 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e2dac7-c0d0-4583-8192-71071d6d0c10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=509483e9f4da44eaa13e1b8419038151)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:27.394310 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e2dac7-c0d0-4583-8192-71071d6d0c10 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:27.400797 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1029/2044] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:46:27.402061 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481b4cb1-31b3-40a8-8ad2-9913a750a38b None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:27.403959 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-481b4cb1-31b3-40a8-8ad2-9913a750a38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:27.422923 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481b4cb1-31b3-40a8-8ad2-9913a750a38b None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:27.432397 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31112fdd-5e21-412d-b562-8bad3c2fdb95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:27.433262 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31112fdd-5e21-412d-b562-8bad3c2fdb95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:27.433935 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31112fdd-5e21-412d-b562-8bad3c2fdb95 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:27.434262 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31112fdd-5e21-412d-b562-8bad3c2fdb95 admin admin] PATH_INFO: `/v3/users/81bd8647699e4a8fa872b69b99fb4150` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:27.435596 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31112fdd-5e21-412d-b562-8bad3c2fdb95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81bd8647699e4a8fa872b69b99fb4150)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:27.437648 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31112fdd-5e21-412d-b562-8bad3c2fdb95 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:27.454611 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-25e2dac7-c0d0-4583-8192-71071d6d0c10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '509483e9f4da44eaa13e1b8419038151'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:27.468434 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-25e2dac7-c0d0-4583-8192-71071d6d0c10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '509483e9f4da44eaa13e1b8419038151'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:27.469304 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-25e2dac7-c0d0-4583-8192-71071d6d0c10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '509483e9f4da44eaa13e1b8419038151'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:27.486379 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-25e2dac7-c0d0-4583-8192-71071d6d0c10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '509483e9f4da44eaa13e1b8419038151'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:27.495060 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-25e2dac7-c0d0-4583-8192-71071d6d0c10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '509483e9f4da44eaa13e1b8419038151'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:27.505111 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1016/2045] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:46:27 2022] DELETE /identity/v3/users/509483e9f4da44eaa13e1b8419038151 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:27.506460 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e2dac7-c0d0-4583-8192-71071d6d0c10 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:27.507891 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-25e2dac7-c0d0-4583-8192-71071d6d0c10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:27.509923 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-31112fdd-5e21-412d-b562-8bad3c2fdb95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81bd8647699e4a8fa872b69b99fb4150'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:27.519136 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-31112fdd-5e21-412d-b562-8bad3c2fdb95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81bd8647699e4a8fa872b69b99fb4150'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:27.519917 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-31112fdd-5e21-412d-b562-8bad3c2fdb95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81bd8647699e4a8fa872b69b99fb4150'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:27.530855 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-31112fdd-5e21-412d-b562-8bad3c2fdb95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81bd8647699e4a8fa872b69b99fb4150'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:27.531933 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-31112fdd-5e21-412d-b562-8bad3c2fdb95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81bd8647699e4a8fa872b69b99fb4150'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:27.561643 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1030/2046] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:46:27 2022] DELETE /identity/v3/users/81bd8647699e4a8fa872b69b99fb4150 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:27.561643 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd258f80-f43b-4021-b98c-29fedccda38f None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:27.561643 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd258f80-f43b-4021-b98c-29fedccda38f None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:27.561643 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd258f80-f43b-4021-b98c-29fedccda38f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:27.582226 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e2dac7-c0d0-4583-8192-71071d6d0c10 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:27.584197 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-cd258f80-f43b-4021-b98c-29fedccda38f None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:27.585610 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-cd258f80-f43b-4021-b98c-29fedccda38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:27.663124 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:27.694261 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cab9cf-4b9d-4178-8a04-3bbf66433144 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:27.698287 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cab9cf-4b9d-4178-8a04-3bbf66433144 service cinder] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:27.698574 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cab9cf-4b9d-4178-8a04-3bbf66433144 service cinder] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:27.698855 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cab9cf-4b9d-4178-8a04-3bbf66433144 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:27.709109 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-41cab9cf-4b9d-4178-8a04-3bbf66433144 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:27.746201 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1031/2047] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:46:27.772181 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd258f80-f43b-4021-b98c-29fedccda38f None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:27.774404 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-cd258f80-f43b-4021-b98c-29fedccda38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:27.800251 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:27.836452 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cab9cf-4b9d-4178-8a04-3bbf66433144 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:27.839257 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cab9cf-4b9d-4178-8a04-3bbf66433144 service cinder] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:27.854278 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1017/2048] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:46:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:46:27.899814 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd258f80-f43b-4021-b98c-29fedccda38f None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:27.904433 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba827e41-df2a-4225-83e6-5aa2d62ee969 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:27.905229 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba827e41-df2a-4225-83e6-5aa2d62ee969 service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:27.905679 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba827e41-df2a-4225-83e6-5aa2d62ee969 service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:27.906037 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba827e41-df2a-4225-83e6-5aa2d62ee969 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:27.920986 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba827e41-df2a-4225-83e6-5aa2d62ee969 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:27.923642 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba827e41-df2a-4225-83e6-5aa2d62ee969 service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:27.940216 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1032/2049] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:46:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:46:28.279934 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cab9cf-4b9d-4178-8a04-3bbf66433144 service cinder] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:28.282639 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-41cab9cf-4b9d-4178-8a04-3bbf66433144 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:28.314093 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cab9cf-4b9d-4178-8a04-3bbf66433144 service cinder] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:28.335068 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1147b-0544-4961-8644-0f5f8db39488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:28.335811 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1147b-0544-4961-8644-0f5f8db39488 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:28.336126 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1147b-0544-4961-8644-0f5f8db39488 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:28.336477 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1147b-0544-4961-8644-0f5f8db39488 admin admin] PATH_INFO: `/v3/projects/f6d2d63d92e24e23b3c2d7d9815f8264` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:28.337935 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb1147b-0544-4961-8644-0f5f8db39488 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6d2d63d92e24e23b3c2d7d9815f8264)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:28.339869 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb1147b-0544-4961-8644-0f5f8db39488 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:28.407762 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-ebb1147b-0544-4961-8644-0f5f8db39488 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6d2d63d92e24e23b3c2d7d9815f8264', 'request_id': 'req-ebb1147b-0544-4961-8644-0f5f8db39488'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:28.416784 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-ebb1147b-0544-4961-8644-0f5f8db39488 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6d2d63d92e24e23b3c2d7d9815f8264', 'request_id': 'req-ebb1147b-0544-4961-8644-0f5f8db39488'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:28.423189 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-ebb1147b-0544-4961-8644-0f5f8db39488 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6d2d63d92e24e23b3c2d7d9815f8264', 'request_id': 'req-ebb1147b-0544-4961-8644-0f5f8db39488'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:28.444541 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-ebb1147b-0544-4961-8644-0f5f8db39488 admin admin] The token cache is being invalidate because project f6d2d63d92e24e23b3c2d7d9815f8264 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:46:28.445183 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-ebb1147b-0544-4961-8644-0f5f8db39488 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:28.446117 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-ebb1147b-0544-4961-8644-0f5f8db39488 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:28.448401 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1018/2050] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:46:28 2022] DELETE /identity/v3/projects/f6d2d63d92e24e23b3c2d7d9815f8264 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:28.454015 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4521f7-22be-433d-a243-b078303f9fa5 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:28.454604 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4521f7-22be-433d-a243-b078303f9fa5 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:28.454908 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4521f7-22be-433d-a243-b078303f9fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:28.477182 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-6b4521f7-22be-433d-a243-b078303f9fa5 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:28.478484 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-6b4521f7-22be-433d-a243-b078303f9fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:28.543857 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1033/2051] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:46:28.551545 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583bbb69-5a3e-4720-b32a-abd3ca936fb2 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:28.551830 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583bbb69-5a3e-4720-b32a-abd3ca936fb2 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:28.552840 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583bbb69-5a3e-4720-b32a-abd3ca936fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:28.573252 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-583bbb69-5a3e-4720-b32a-abd3ca936fb2 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:28.574529 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-583bbb69-5a3e-4720-b32a-abd3ca936fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:28.582633 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1019/2052] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:46:28.587583 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4521f7-22be-433d-a243-b078303f9fa5 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:28.598035 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4521f7-22be-433d-a243-b078303f9fa5 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:28.603234 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc054c2d-e0db-4a65-8868-df2820bbeb56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:28.603845 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc054c2d-e0db-4a65-8868-df2820bbeb56 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:28.604166 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc054c2d-e0db-4a65-8868-df2820bbeb56 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:28.604441 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc054c2d-e0db-4a65-8868-df2820bbeb56 admin admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:28.605225 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc054c2d-e0db-4a65-8868-df2820bbeb56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:46:28.605554 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc054c2d-e0db-4a65-8868-df2820bbeb56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:28.607147 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc054c2d-e0db-4a65-8868-df2820bbeb56 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:28.620430 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1034/2053] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Aug 29 22:46:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:46:28.624473 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583bbb69-5a3e-4720-b32a-abd3ca936fb2 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:28.635810 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583bbb69-5a3e-4720-b32a-abd3ca936fb2 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:28.641383 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afed6856-61af-4e88-9718-c597ca4e78ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:28.642135 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed6856-61af-4e88-9718-c597ca4e78ef admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:28.642539 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed6856-61af-4e88-9718-c597ca4e78ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:28.642814 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed6856-61af-4e88-9718-c597ca4e78ef admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:28.643483 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afed6856-61af-4e88-9718-c597ca4e78ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:28.645469 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afed6856-61af-4e88-9718-c597ca4e78ef admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:28.679238 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1020/2054] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:46:28 2022] POST /identity/v3/projects => generated 371 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:46:28.683666 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc054c2d-e0db-4a65-8868-df2820bbeb56 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:28.695335 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc054c2d-e0db-4a65-8868-df2820bbeb56 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:28.760982 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af4ae9-3c6e-4ef4-9a1b-b23aa14e066c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:28.761701 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af4ae9-3c6e-4ef4-9a1b-b23aa14e066c admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:28.761891 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af4ae9-3c6e-4ef4-9a1b-b23aa14e066c admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:28.762161 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af4ae9-3c6e-4ef4-9a1b-b23aa14e066c admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:28.762812 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21af4ae9-3c6e-4ef4-9a1b-b23aa14e066c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:28.764815 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21af4ae9-3c6e-4ef4-9a1b-b23aa14e066c admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:28.775718 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:28.793830 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1035/2055] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:46:28 2022] POST /identity/v3/users => generated 286 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:46:28.795201 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afed6856-61af-4e88-9718-c597ca4e78ef admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:28.808146 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afed6856-61af-4e88-9718-c597ca4e78ef admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:28.812937 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34266cc-a8af-49df-8596-fac9edb6a9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:28.813682 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34266cc-a8af-49df-8596-fac9edb6a9ae admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:28.814045 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34266cc-a8af-49df-8596-fac9edb6a9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:28.814387 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34266cc-a8af-49df-8596-fac9edb6a9ae admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:28.815111 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34266cc-a8af-49df-8596-fac9edb6a9ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:28.816776 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34266cc-a8af-49df-8596-fac9edb6a9ae admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:28.828299 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1021/2056] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:46:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:46:28.832703 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af4ae9-3c6e-4ef4-9a1b-b23aa14e066c admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:28.851068 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af4ae9-3c6e-4ef4-9a1b-b23aa14e066c admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:28.856624 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9306989b-2655-4fca-8da2-9292e0d29084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:28.857501 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306989b-2655-4fca-8da2-9292e0d29084 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:28.857796 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306989b-2655-4fca-8da2-9292e0d29084 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:28.858050 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306989b-2655-4fca-8da2-9292e0d29084 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:28.858705 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9306989b-2655-4fca-8da2-9292e0d29084 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:28.860420 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9306989b-2655-4fca-8da2-9292e0d29084 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:28.873444 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1036/2057] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:46:28 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:46:28.878044 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34266cc-a8af-49df-8596-fac9edb6a9ae admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:28.889200 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34266cc-a8af-49df-8596-fac9edb6a9ae admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:28.894170 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a54bf6f-8020-4e29-b361-f18a89700408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:28.894835 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a54bf6f-8020-4e29-b361-f18a89700408 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:28.895116 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a54bf6f-8020-4e29-b361-f18a89700408 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:28.895446 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a54bf6f-8020-4e29-b361-f18a89700408 admin admin] PATH_INFO: `/v3/projects/88d706377de942e6ac6b47b00c1445ff/users/2d51831614aa4dccb26410329386b663/roles/0c67797d444d4c929b2ccab47c468848` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:28.915061 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a54bf6f-8020-4e29-b361-f18a89700408 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88d706377de942e6ac6b47b00c1445ff, user_id=2d51831614aa4dccb26410329386b663, role_id=0c67797d444d4c929b2ccab47c468848)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:28.915279 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9306989b-2655-4fca-8da2-9292e0d29084 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:28.918035 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a54bf6f-8020-4e29-b361-f18a89700408 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:28.919374 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-9306989b-2655-4fca-8da2-9292e0d29084 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:28.938931 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9306989b-2655-4fca-8da2-9292e0d29084 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:28.943621 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1022/2058] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:46:28 2022] PUT /identity/v3/projects/88d706377de942e6ac6b47b00c1445ff/users/2d51831614aa4dccb26410329386b663/roles/0c67797d444d4c929b2ccab47c468848 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:28.947485 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef687c-a3d8-4633-a1e4-81c2397aef69 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:28.947771 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef687c-a3d8-4633-a1e4-81c2397aef69 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:28.948947 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef687c-a3d8-4633-a1e4-81c2397aef69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:28.997652 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-9eef687c-a3d8-4633-a1e4-81c2397aef69 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:28.999369 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-9eef687c-a3d8-4633-a1e4-81c2397aef69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:29.126083 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db2dd02-a87b-479c-b41e-93a17fca14be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:29.129344 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2dd02-a87b-479c-b41e-93a17fca14be admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:29.129840 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2dd02-a87b-479c-b41e-93a17fca14be admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:29.132303 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2dd02-a87b-479c-b41e-93a17fca14be admin admin] PATH_INFO: `/v3/projects/ae6433659a0a4c6982b6c303035da5e9` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:29.134676 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db2dd02-a87b-479c-b41e-93a17fca14be admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae6433659a0a4c6982b6c303035da5e9)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:29.138209 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db2dd02-a87b-479c-b41e-93a17fca14be admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:29.149126 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1023/2059] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:46:29.165441 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef687c-a3d8-4633-a1e4-81c2397aef69 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:29.168604 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-9eef687c-a3d8-4633-a1e4-81c2397aef69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:29.181793 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:29.214782 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-0db2dd02-a87b-479c-b41e-93a17fca14be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae6433659a0a4c6982b6c303035da5e9', 'request_id': 'req-0db2dd02-a87b-479c-b41e-93a17fca14be'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:29.223603 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-0db2dd02-a87b-479c-b41e-93a17fca14be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae6433659a0a4c6982b6c303035da5e9', 'request_id': 'req-0db2dd02-a87b-479c-b41e-93a17fca14be'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:29.231888 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-0db2dd02-a87b-479c-b41e-93a17fca14be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae6433659a0a4c6982b6c303035da5e9', 'request_id': 'req-0db2dd02-a87b-479c-b41e-93a17fca14be'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:29.250669 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-0db2dd02-a87b-479c-b41e-93a17fca14be admin admin] The token cache is being invalidate because project ae6433659a0a4c6982b6c303035da5e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:46:29.251649 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-0db2dd02-a87b-479c-b41e-93a17fca14be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:29.252593 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-0db2dd02-a87b-479c-b41e-93a17fca14be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:29.255310 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1037/2060] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:46:28 2022] DELETE /identity/v3/projects/ae6433659a0a4c6982b6c303035da5e9 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:46:29.287122 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ca9fe-fa04-49f3-880f-7e9dc09e38f1 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:29.288355 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ca9fe-fa04-49f3-880f-7e9dc09e38f1 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:29.289991 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ca9fe-fa04-49f3-880f-7e9dc09e38f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:29.298234 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef687c-a3d8-4633-a1e4-81c2397aef69 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:29.358438 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-cc5ca9fe-fa04-49f3-880f-7e9dc09e38f1 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:29.367509 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-cc5ca9fe-fa04-49f3-880f-7e9dc09e38f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:29.435128 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d89908-074f-4c8f-b4d2-89dbbde9cbea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:29.435981 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d89908-074f-4c8f-b4d2-89dbbde9cbea service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:29.436364 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d89908-074f-4c8f-b4d2-89dbbde9cbea service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:29.436742 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d89908-074f-4c8f-b4d2-89dbbde9cbea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:29.443952 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-29d89908-074f-4c8f-b4d2-89dbbde9cbea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:29.533749 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1038/2061] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:46:29.543468 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f6be1d-86cb-48f3-a280-e97ce5f5f362 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:29.572003 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f6be1d-86cb-48f3-a280-e97ce5f5f362 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:29.573663 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f6be1d-86cb-48f3-a280-e97ce5f5f362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:29.591859 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d89908-074f-4c8f-b4d2-89dbbde9cbea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:29.594244 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d89908-074f-4c8f-b4d2-89dbbde9cbea service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:29.610777 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1024/2062] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:46:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:46:29.637422 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-f4f6be1d-86cb-48f3-a280-e97ce5f5f362 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:29.638964 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-f4f6be1d-86cb-48f3-a280-e97ce5f5f362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:29.653703 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1039/2063] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:46:29.658944 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d89908-074f-4c8f-b4d2-89dbbde9cbea service neutron] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:29.680353 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d89908-074f-4c8f-b4d2-89dbbde9cbea service neutron] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:29.687811 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ac28ef-7423-47a5-9dd4-4b450b8999e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:29.688690 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac28ef-7423-47a5-9dd4-4b450b8999e0 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:29.689152 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac28ef-7423-47a5-9dd4-4b450b8999e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:29.689598 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac28ef-7423-47a5-9dd4-4b450b8999e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:29.690364 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ac28ef-7423-47a5-9dd4-4b450b8999e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:46:29.690775 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ac28ef-7423-47a5-9dd4-4b450b8999e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:29.693851 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ac28ef-7423-47a5-9dd4-4b450b8999e0 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:29.740309 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1025/2064] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Aug 29 22:46:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:46:29.744602 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f6be1d-86cb-48f3-a280-e97ce5f5f362 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:29.769645 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f6be1d-86cb-48f3-a280-e97ce5f5f362 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:29.780616 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b6e38-6d93-4d8f-a5ca-e680e5a611b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:29.781309 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b6e38-6d93-4d8f-a5ca-e680e5a611b6 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:29.781638 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b6e38-6d93-4d8f-a5ca-e680e5a611b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:29.782202 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b6e38-6d93-4d8f-a5ca-e680e5a611b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:29.782857 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4b6e38-6d93-4d8f-a5ca-e680e5a611b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:29.786261 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4b6e38-6d93-4d8f-a5ca-e680e5a611b6 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:29.796905 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:29.862445 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1040/2065] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:46:29 2022] POST /identity/v3/projects => generated 375 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:46:29.866642 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ac28ef-7423-47a5-9dd4-4b450b8999e0 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:29.886491 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ac28ef-7423-47a5-9dd4-4b450b8999e0 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:29.999920 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:30.012228 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f4073d-a48d-4d56-8df8-39a9fb082688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:30.018549 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4073d-a48d-4d56-8df8-39a9fb082688 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:30.019095 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4073d-a48d-4d56-8df8-39a9fb082688 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:30.019820 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4073d-a48d-4d56-8df8-39a9fb082688 admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:30.020809 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f4073d-a48d-4d56-8df8-39a9fb082688 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:30.023422 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f4073d-a48d-4d56-8df8-39a9fb082688 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:30.072544 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1026/2066] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:46:29 2022] POST /identity/v3/users => generated 288 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:46:30.077511 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b6e38-6d93-4d8f-a5ca-e680e5a611b6 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:30.092952 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b6e38-6d93-4d8f-a5ca-e680e5a611b6 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:30.110549 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f6b555-387f-4dfd-85a9-625c59fc6ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:30.111191 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f6b555-387f-4dfd-85a9-625c59fc6ccd admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:30.111476 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f6b555-387f-4dfd-85a9-625c59fc6ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:30.111746 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f6b555-387f-4dfd-85a9-625c59fc6ccd admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:30.112402 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f6b555-387f-4dfd-85a9-625c59fc6ccd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:30.114059 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f6b555-387f-4dfd-85a9-625c59fc6ccd admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:30.166172 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1041/2067] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:46:30 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:46:30.170537 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f4073d-a48d-4d56-8df8-39a9fb082688 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:30.204418 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f4073d-a48d-4d56-8df8-39a9fb082688 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:30.234277 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7367e6bc-80a3-448c-a7d3-02d5b7777adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:30.235409 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367e6bc-80a3-448c-a7d3-02d5b7777adb admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:30.236009 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367e6bc-80a3-448c-a7d3-02d5b7777adb admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:30.236702 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367e6bc-80a3-448c-a7d3-02d5b7777adb admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:30.241603 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7367e6bc-80a3-448c-a7d3-02d5b7777adb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:30.245008 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7367e6bc-80a3-448c-a7d3-02d5b7777adb admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:30.292313 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1027/2068] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:46:30 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:46:30.295636 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f6b555-387f-4dfd-85a9-625c59fc6ccd admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:30.316492 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f6b555-387f-4dfd-85a9-625c59fc6ccd admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:30.323469 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cdf4bd-c6ce-441e-b860-46ceb425dae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:30.324141 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cdf4bd-c6ce-441e-b860-46ceb425dae4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:30.324419 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cdf4bd-c6ce-441e-b860-46ceb425dae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:30.324693 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cdf4bd-c6ce-441e-b860-46ceb425dae4 admin admin] PATH_INFO: `/v3/projects/b413994f95124848b4cf98b0dddb2441/users/46898434ad354315924909e59399e155/roles/0c67797d444d4c929b2ccab47c468848` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:30.347724 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cdf4bd-c6ce-441e-b860-46ceb425dae4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b413994f95124848b4cf98b0dddb2441, user_id=46898434ad354315924909e59399e155, role_id=0c67797d444d4c929b2ccab47c468848)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:30.351833 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cdf4bd-c6ce-441e-b860-46ceb425dae4 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:30.386432 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1042/2069] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:46:30 2022] PUT /identity/v3/projects/b413994f95124848b4cf98b0dddb2441/users/46898434ad354315924909e59399e155/roles/0c67797d444d4c929b2ccab47c468848 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:30.388330 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06a682-5a19-421a-ba5c-b11dddc788ed None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:30.388807 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06a682-5a19-421a-ba5c-b11dddc788ed None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:30.389004 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06a682-5a19-421a-ba5c-b11dddc788ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:30.430357 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-1d06a682-5a19-421a-ba5c-b11dddc788ed None None] MFA Rules not processed for user `46898434ad354315924909e59399e155`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:30.431719 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-1d06a682-5a19-421a-ba5c-b11dddc788ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:30.568513 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1028/2070] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:46:30.574000 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cdf4bd-c6ce-441e-b860-46ceb425dae4 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:30.709288 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cdf4bd-c6ce-441e-b860-46ceb425dae4 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:30.719381 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a58e29-2eed-4d0e-9890-f0ce0bb21a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:30.720021 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a58e29-2eed-4d0e-9890-f0ce0bb21a8f admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:30.720300 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a58e29-2eed-4d0e-9890-f0ce0bb21a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:30.720572 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a58e29-2eed-4d0e-9890-f0ce0bb21a8f admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:30.721229 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a58e29-2eed-4d0e-9890-f0ce0bb21a8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:30.723185 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a58e29-2eed-4d0e-9890-f0ce0bb21a8f admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:30.768705 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1043/2071] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:46:30 2022] POST /identity/v3/projects => generated 375 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:46:30.773426 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d06a682-5a19-421a-ba5c-b11dddc788ed None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:30.786862 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d06a682-5a19-421a-ba5c-b11dddc788ed None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:30.902417 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a0da1a-8fa4-4ae4-8c41-0dfacb23c851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:30.903924 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0da1a-8fa4-4ae4-8c41-0dfacb23c851 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:30.904233 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0da1a-8fa4-4ae4-8c41-0dfacb23c851 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:30.904951 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0da1a-8fa4-4ae4-8c41-0dfacb23c851 admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:30.906060 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a0da1a-8fa4-4ae4-8c41-0dfacb23c851 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:30.909007 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a0da1a-8fa4-4ae4-8c41-0dfacb23c851 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:30.953095 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1029/2072] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:46:30 2022] POST /identity/v3/users => generated 294 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:46:30.961742 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a58e29-2eed-4d0e-9890-f0ce0bb21a8f admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:30.986708 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a58e29-2eed-4d0e-9890-f0ce0bb21a8f admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:31.001550 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ffe8b7-3681-4786-9835-caaf212d496f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:31.002179 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ffe8b7-3681-4786-9835-caaf212d496f admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:31.002506 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ffe8b7-3681-4786-9835-caaf212d496f admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:31.002837 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ffe8b7-3681-4786-9835-caaf212d496f admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:31.003545 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ffe8b7-3681-4786-9835-caaf212d496f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:31.005745 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ffe8b7-3681-4786-9835-caaf212d496f admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:31.049153 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2662a4be-4553-4ea9-9dfa-6dbb2eef43a9 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:31.049486 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2662a4be-4553-4ea9-9dfa-6dbb2eef43a9 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:31.049849 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2662a4be-4553-4ea9-9dfa-6dbb2eef43a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:31.053363 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1044/2073] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:46:30 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:46:31.056122 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ffe8b7-3681-4786-9835-caaf212d496f admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:31.070610 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ffe8b7-3681-4786-9835-caaf212d496f admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:31.078358 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0355ed-68bf-474e-8a8b-dcb22f76f081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:31.085066 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0355ed-68bf-474e-8a8b-dcb22f76f081 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:31.085679 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0355ed-68bf-474e-8a8b-dcb22f76f081 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:31.086144 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0355ed-68bf-474e-8a8b-dcb22f76f081 admin admin] PATH_INFO: `/v3/projects/6902da9e177d4b05a37f6035dd4b10a9/users/8f932ac1754544c1b3eadfbaef17045c/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:31.120637 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0355ed-68bf-474e-8a8b-dcb22f76f081 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6902da9e177d4b05a37f6035dd4b10a9, user_id=8f932ac1754544c1b3eadfbaef17045c, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:31.127541 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0355ed-68bf-474e-8a8b-dcb22f76f081 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:31.134061 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-2662a4be-4553-4ea9-9dfa-6dbb2eef43a9 None None] MFA Rules not processed for user `2d51831614aa4dccb26410329386b663`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:31.140431 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-2662a4be-4553-4ea9-9dfa-6dbb2eef43a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:31.165137 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1045/2074] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:46:31 2022] PUT /identity/v3/projects/6902da9e177d4b05a37f6035dd4b10a9/users/8f932ac1754544c1b3eadfbaef17045c/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:46:31.170352 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0355ed-68bf-474e-8a8b-dcb22f76f081 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:31.269735 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:31.293988 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0355ed-68bf-474e-8a8b-dcb22f76f081 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:31.301040 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8247aded-7739-48b7-a1ae-7a07d5a300b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:31.305882 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8247aded-7739-48b7-a1ae-7a07d5a300b8 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:31.306660 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8247aded-7739-48b7-a1ae-7a07d5a300b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:31.307172 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8247aded-7739-48b7-a1ae-7a07d5a300b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:31.310137 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8247aded-7739-48b7-a1ae-7a07d5a300b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:31.314338 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8247aded-7739-48b7-a1ae-7a07d5a300b8 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:31.317785 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:31.320348 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1030/2075] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:46:31.327370 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2662a4be-4553-4ea9-9dfa-6dbb2eef43a9 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:31.332893 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-2662a4be-4553-4ea9-9dfa-6dbb2eef43a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:31.340602 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1046/2076] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:46:31 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:46:31.344900 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8247aded-7739-48b7-a1ae-7a07d5a300b8 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:31.360915 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2662a4be-4553-4ea9-9dfa-6dbb2eef43a9 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:31.361053 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8247aded-7739-48b7-a1ae-7a07d5a300b8 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:31.369485 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e22acc-3c6c-46f1-8f05-12fa685cb717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:31.369716 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bfbae4-5021-4e7d-a64f-78e45422ce5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:31.370028 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e22acc-3c6c-46f1-8f05-12fa685cb717 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:31.370315 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e22acc-3c6c-46f1-8f05-12fa685cb717 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:31.370557 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bfbae4-5021-4e7d-a64f-78e45422ce5f admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:31.370779 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e22acc-3c6c-46f1-8f05-12fa685cb717 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:31.370873 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bfbae4-5021-4e7d-a64f-78e45422ce5f admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:31.371216 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bfbae4-5021-4e7d-a64f-78e45422ce5f admin admin] PATH_INFO: `/v3/projects/6902da9e177d4b05a37f6035dd4b10a9/users/8f932ac1754544c1b3eadfbaef17045c/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:31.371328 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e22acc-3c6c-46f1-8f05-12fa685cb717 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:31.373429 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bfbae4-5021-4e7d-a64f-78e45422ce5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6902da9e177d4b05a37f6035dd4b10a9, user_id=8f932ac1754544c1b3eadfbaef17045c, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:31.374023 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e22acc-3c6c-46f1-8f05-12fa685cb717 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:31.376544 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bfbae4-5021-4e7d-a64f-78e45422ce5f admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:31.389869 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1047/2077] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:46:31 2022] PUT /identity/v3/projects/6902da9e177d4b05a37f6035dd4b10a9/users/8f932ac1754544c1b3eadfbaef17045c/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:31.401821 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d3683-6122-4f17-8c86-1355345fac87 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:31.402260 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d3683-6122-4f17-8c86-1355345fac87 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:31.402638 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d3683-6122-4f17-8c86-1355345fac87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:31.440183 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1031/2078] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:46:31 2022] POST /identity/v3/projects => generated 373 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:46:31.445428 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e22acc-3c6c-46f1-8f05-12fa685cb717 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:31.494625 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-c76d3683-6122-4f17-8c86-1355345fac87 None None] MFA Rules not processed for user `8f932ac1754544c1b3eadfbaef17045c`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:31.496231 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-c76d3683-6122-4f17-8c86-1355345fac87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:31.547892 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e22acc-3c6c-46f1-8f05-12fa685cb717 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:31.553175 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e64e4-6ef9-498d-bc26-7a56f408d6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:31.553987 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e64e4-6ef9-498d-bc26-7a56f408d6b2 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:31.554624 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e64e4-6ef9-498d-bc26-7a56f408d6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:31.555154 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e64e4-6ef9-498d-bc26-7a56f408d6b2 admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:31.555882 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29e64e4-6ef9-498d-bc26-7a56f408d6b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:31.558480 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29e64e4-6ef9-498d-bc26-7a56f408d6b2 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:31.592445 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1032/2079] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:46:31 2022] POST /identity/v3/users => generated 293 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:46:31.596838 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e64e4-6ef9-498d-bc26-7a56f408d6b2 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:31.621767 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e64e4-6ef9-498d-bc26-7a56f408d6b2 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:31.627414 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac22977-82f9-4012-b39a-260654f76781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:31.628173 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac22977-82f9-4012-b39a-260654f76781 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:31.628459 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac22977-82f9-4012-b39a-260654f76781 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:31.628738 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac22977-82f9-4012-b39a-260654f76781 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:31.629413 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac22977-82f9-4012-b39a-260654f76781 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:31.632700 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac22977-82f9-4012-b39a-260654f76781 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:31.654080 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1033/2080] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:46:31 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:46:31.660368 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac22977-82f9-4012-b39a-260654f76781 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:31.682733 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac22977-82f9-4012-b39a-260654f76781 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:31.713538 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d597d99-621e-4526-b0a0-a795790dbb97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:31.714233 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d597d99-621e-4526-b0a0-a795790dbb97 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:31.714518 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d597d99-621e-4526-b0a0-a795790dbb97 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:31.714795 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d597d99-621e-4526-b0a0-a795790dbb97 admin admin] PATH_INFO: `/v3/projects/c3739e4ac26f472b8fdc257a52939015/users/4586e7ed77d6410d8adf1c2c308926b2/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:31.744316 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d597d99-621e-4526-b0a0-a795790dbb97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3739e4ac26f472b8fdc257a52939015, user_id=4586e7ed77d6410d8adf1c2c308926b2, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:31.747909 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1048/2081] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:31 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:46:31.759136 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d597d99-621e-4526-b0a0-a795790dbb97 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:31.773434 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76d3683-6122-4f17-8c86-1355345fac87 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:31.775262 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-c76d3683-6122-4f17-8c86-1355345fac87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:31.794397 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1034/2082] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:46:31 2022] PUT /identity/v3/projects/c3739e4ac26f472b8fdc257a52939015/users/4586e7ed77d6410d8adf1c2c308926b2/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:31.798111 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d597d99-621e-4526-b0a0-a795790dbb97 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:31.909271 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76d3683-6122-4f17-8c86-1355345fac87 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:31.950291 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d597d99-621e-4526-b0a0-a795790dbb97 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:31.963483 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f59289-58cf-409c-87ef-5a6655682c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:31.963869 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f59289-58cf-409c-87ef-5a6655682c8e admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:31.964432 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f59289-58cf-409c-87ef-5a6655682c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:31.972419 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f59289-58cf-409c-87ef-5a6655682c8e admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:31.973052 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f59289-58cf-409c-87ef-5a6655682c8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:31.975213 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f59289-58cf-409c-87ef-5a6655682c8e admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:32.004629 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1035/2083] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:46:31 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:46:32.007132 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f7381c-a704-46b4-92eb-db59dc955380 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:32.007767 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7381c-a704-46b4-92eb-db59dc955380 service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:32.008208 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7381c-a704-46b4-92eb-db59dc955380 service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:32.008586 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7381c-a704-46b4-92eb-db59dc955380 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:32.009944 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f59289-58cf-409c-87ef-5a6655682c8e admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:32.034835 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f59289-58cf-409c-87ef-5a6655682c8e admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:32.054599 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb0def-db5a-43ec-b403-18b69ad80b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:32.055217 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb0def-db5a-43ec-b403-18b69ad80b41 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:32.055536 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb0def-db5a-43ec-b403-18b69ad80b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:32.055779 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb0def-db5a-43ec-b403-18b69ad80b41 admin admin] PATH_INFO: `/v3/projects/c3739e4ac26f472b8fdc257a52939015/users/4586e7ed77d6410d8adf1c2c308926b2/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:32.062169 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cb0def-db5a-43ec-b403-18b69ad80b41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3739e4ac26f472b8fdc257a52939015, user_id=4586e7ed77d6410d8adf1c2c308926b2, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:32.065310 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cb0def-db5a-43ec-b403-18b69ad80b41 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:32.073670 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:32.104682 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1036/2084] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:46:32 2022] PUT /identity/v3/projects/c3739e4ac26f472b8fdc257a52939015/users/4586e7ed77d6410d8adf1c2c308926b2/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:32.122354 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:32.165596 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f7381c-a704-46b4-92eb-db59dc955380 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:32.187720 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f7381c-a704-46b4-92eb-db59dc955380 service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:32.227279 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1049/2085] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:46:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:46:32.999586 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a08d6-e529-44c7-acee-2e9029da2fe6 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:33.000170 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a08d6-e529-44c7-acee-2e9029da2fe6 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:33.000170 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a08d6-e529-44c7-acee-2e9029da2fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:33.032197 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-350a08d6-e529-44c7-acee-2e9029da2fe6 None None] MFA Rules not processed for user `4586e7ed77d6410d8adf1c2c308926b2`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:33.033439 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-350a08d6-e529-44c7-acee-2e9029da2fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:33.135136 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1037/2086] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:32 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:46:33.145667 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ed473-2917-40b9-abaf-04bdeabda6c4 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:33.147068 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ed473-2917-40b9-abaf-04bdeabda6c4 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:33.147068 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ed473-2917-40b9-abaf-04bdeabda6c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:33.167637 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-6a1ed473-2917-40b9-abaf-04bdeabda6c4 None None] MFA Rules not processed for user `2d51831614aa4dccb26410329386b663`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:33.169807 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-6a1ed473-2917-40b9-abaf-04bdeabda6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:33.248814 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1050/2087] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:46:33.260401 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350a08d6-e529-44c7-acee-2e9029da2fe6 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:33.261955 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-350a08d6-e529-44c7-acee-2e9029da2fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:33.345541 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350a08d6-e529-44c7-acee-2e9029da2fe6 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:33.351645 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8413316-97f2-4b61-8b9e-8f71de57ab7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35441c061e514b1b9341e7694ec2c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:33.352258 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8413316-97f2-4b61-8b9e-8f71de57ab7d service nova] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:33.352539 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8413316-97f2-4b61-8b9e-8f71de57ab7d service nova] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:33.352812 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8413316-97f2-4b61-8b9e-8f71de57ab7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:33.361558 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8413316-97f2-4b61-8b9e-8f71de57ab7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:33.363150 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8413316-97f2-4b61-8b9e-8f71de57ab7d service nova] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:33.372798 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1038/2088] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:46:33 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:46:34.728456 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1ed473-2917-40b9-abaf-04bdeabda6c4 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:34.730653 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-6a1ed473-2917-40b9-abaf-04bdeabda6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:34.810141 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1ed473-2917-40b9-abaf-04bdeabda6c4 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:34.815876 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f146a-7959-4ab4-81aa-a293f385aee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:34.816758 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f146a-7959-4ab4-81aa-a293f385aee0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:34.817038 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f146a-7959-4ab4-81aa-a293f385aee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:34.817315 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f146a-7959-4ab4-81aa-a293f385aee0 admin admin] PATH_INFO: `/v3/users/aedc01a664484c479b0fa28b0315eaa9` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:34.818702 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597f146a-7959-4ab4-81aa-a293f385aee0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aedc01a664484c479b0fa28b0315eaa9)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:34.821077 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597f146a-7959-4ab4-81aa-a293f385aee0 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:34.891910 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-597f146a-7959-4ab4-81aa-a293f385aee0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aedc01a664484c479b0fa28b0315eaa9'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:34.914851 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-597f146a-7959-4ab4-81aa-a293f385aee0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aedc01a664484c479b0fa28b0315eaa9'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:34.915699 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-597f146a-7959-4ab4-81aa-a293f385aee0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aedc01a664484c479b0fa28b0315eaa9'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:34.927431 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-597f146a-7959-4ab4-81aa-a293f385aee0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aedc01a664484c479b0fa28b0315eaa9'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:34.928610 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-597f146a-7959-4ab4-81aa-a293f385aee0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aedc01a664484c479b0fa28b0315eaa9'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:34.956452 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1051/2089] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:46:34 2022] DELETE /identity/v3/users/aedc01a664484c479b0fa28b0315eaa9 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:34.961299 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87f0ba-4bcf-4ca8-982c-aff7d36a0c9e None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:34.961847 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87f0ba-4bcf-4ca8-982c-aff7d36a0c9e None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:34.961923 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87f0ba-4bcf-4ca8-982c-aff7d36a0c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:34.984062 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-7e87f0ba-4bcf-4ca8-982c-aff7d36a0c9e None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:34.985441 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-7e87f0ba-4bcf-4ca8-982c-aff7d36a0c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:35.048253 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f146a-7959-4ab4-81aa-a293f385aee0 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:35.053605 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-597f146a-7959-4ab4-81aa-a293f385aee0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:35.068628 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:35.087148 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1039/2090] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:46:35.096964 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e87f0ba-4bcf-4ca8-982c-aff7d36a0c9e None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:35.101265 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-7e87f0ba-4bcf-4ca8-982c-aff7d36a0c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:35.117077 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:35.161172 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f146a-7959-4ab4-81aa-a293f385aee0 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:35.168025 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d9f94-8dae-48aa-84a5-9a7de431b5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:35.168668 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d9f94-8dae-48aa-84a5-9a7de431b5b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:35.168944 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d9f94-8dae-48aa-84a5-9a7de431b5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:35.169415 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d9f94-8dae-48aa-84a5-9a7de431b5b0 admin admin] PATH_INFO: `/v3/users/46898434ad354315924909e59399e155` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:35.170707 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717d9f94-8dae-48aa-84a5-9a7de431b5b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46898434ad354315924909e59399e155)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:35.173001 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717d9f94-8dae-48aa-84a5-9a7de431b5b0 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:35.176259 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e87f0ba-4bcf-4ca8-982c-aff7d36a0c9e None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:35.182067 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7576b88b-022d-4279-8866-90087662021c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:35.182688 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7576b88b-022d-4279-8866-90087662021c service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:35.182966 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7576b88b-022d-4279-8866-90087662021c service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:35.183239 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7576b88b-022d-4279-8866-90087662021c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:35.194985 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7576b88b-022d-4279-8866-90087662021c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:35.196532 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7576b88b-022d-4279-8866-90087662021c service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:35.207480 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1040/2091] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:46:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:46:35.234252 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-717d9f94-8dae-48aa-84a5-9a7de431b5b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46898434ad354315924909e59399e155'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:35.245019 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-717d9f94-8dae-48aa-84a5-9a7de431b5b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46898434ad354315924909e59399e155'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:35.245775 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-717d9f94-8dae-48aa-84a5-9a7de431b5b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46898434ad354315924909e59399e155'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:35.256329 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-717d9f94-8dae-48aa-84a5-9a7de431b5b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46898434ad354315924909e59399e155'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:35.257261 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-717d9f94-8dae-48aa-84a5-9a7de431b5b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46898434ad354315924909e59399e155'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:35.285416 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1052/2092] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:46:35 2022] DELETE /identity/v3/users/46898434ad354315924909e59399e155 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:46:35.289422 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f84f6d0-0a82-4532-b8bf-aaf343603fea None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:35.289843 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f84f6d0-0a82-4532-b8bf-aaf343603fea None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:35.290219 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f84f6d0-0a82-4532-b8bf-aaf343603fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:35.322921 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-6f84f6d0-0a82-4532-b8bf-aaf343603fea None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:35.324972 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-6f84f6d0-0a82-4532-b8bf-aaf343603fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:35.418371 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1041/2093] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:46:35.433659 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d9f94-8dae-48aa-84a5-9a7de431b5b0 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:35.435113 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-717d9f94-8dae-48aa-84a5-9a7de431b5b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:35.528289 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d9f94-8dae-48aa-84a5-9a7de431b5b0 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:35.534997 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639530e0-4757-4304-a69f-edc2aa20264d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:35.535611 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639530e0-4757-4304-a69f-edc2aa20264d service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:35.535886 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639530e0-4757-4304-a69f-edc2aa20264d service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:35.536664 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639530e0-4757-4304-a69f-edc2aa20264d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:35.546906 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639530e0-4757-4304-a69f-edc2aa20264d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:35.550082 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639530e0-4757-4304-a69f-edc2aa20264d service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:35.559895 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1053/2094] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:46:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:46:35.757364 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f84f6d0-0a82-4532-b8bf-aaf343603fea None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:35.761189 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-6f84f6d0-0a82-4532-b8bf-aaf343603fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:35.785235 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f84f6d0-0a82-4532-b8bf-aaf343603fea None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:35.792800 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7076ab2e-5efb-47eb-b315-3043ad577b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:35.793759 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076ab2e-5efb-47eb-b315-3043ad577b1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:35.794045 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076ab2e-5efb-47eb-b315-3043ad577b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:35.794324 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076ab2e-5efb-47eb-b315-3043ad577b1f admin admin] PATH_INFO: `/v3/projects/3ff4826db4e041ecbd7c44a7fee9b9c0` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:35.795947 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7076ab2e-5efb-47eb-b315-3043ad577b1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ff4826db4e041ecbd7c44a7fee9b9c0)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:35.820609 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7076ab2e-5efb-47eb-b315-3043ad577b1f admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:35.974373 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-7076ab2e-5efb-47eb-b315-3043ad577b1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ff4826db4e041ecbd7c44a7fee9b9c0', 'request_id': 'req-7076ab2e-5efb-47eb-b315-3043ad577b1f'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:35.987198 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-7076ab2e-5efb-47eb-b315-3043ad577b1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ff4826db4e041ecbd7c44a7fee9b9c0', 'request_id': 'req-7076ab2e-5efb-47eb-b315-3043ad577b1f'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:36.001926 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-7076ab2e-5efb-47eb-b315-3043ad577b1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ff4826db4e041ecbd7c44a7fee9b9c0', 'request_id': 'req-7076ab2e-5efb-47eb-b315-3043ad577b1f'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:36.029618 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-7076ab2e-5efb-47eb-b315-3043ad577b1f admin admin] The token cache is being invalidate because project 3ff4826db4e041ecbd7c44a7fee9b9c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:46:36.029975 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-7076ab2e-5efb-47eb-b315-3043ad577b1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:36.033568 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-7076ab2e-5efb-47eb-b315-3043ad577b1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:36.039174 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1042/2095] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:46:35 2022] DELETE /identity/v3/projects/3ff4826db4e041ecbd7c44a7fee9b9c0 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:36.044782 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db3f2b2-b0b4-48e3-8973-0c2ef38d3a29 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:36.045406 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db3f2b2-b0b4-48e3-8973-0c2ef38d3a29 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:36.045488 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db3f2b2-b0b4-48e3-8973-0c2ef38d3a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:36.073053 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-6db3f2b2-b0b4-48e3-8973-0c2ef38d3a29 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:36.074415 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-6db3f2b2-b0b4-48e3-8973-0c2ef38d3a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:36.097706 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:36.183961 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1054/2096] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:46:36.186306 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab14fc4-c4f9-4066-b06e-8d796c0096b9 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:36.186600 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab14fc4-c4f9-4066-b06e-8d796c0096b9 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:36.186877 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab14fc4-c4f9-4066-b06e-8d796c0096b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:36.211738 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db3f2b2-b0b4-48e3-8973-0c2ef38d3a29 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:36.211932 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-fab14fc4-c4f9-4066-b06e-8d796c0096b9 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:36.213013 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-fab14fc4-c4f9-4066-b06e-8d796c0096b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:36.214308 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-6db3f2b2-b0b4-48e3-8973-0c2ef38d3a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:36.236261 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1043/2097] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:46:36.242696 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab14fc4-c4f9-4066-b06e-8d796c0096b9 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:36.254668 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db3f2b2-b0b4-48e3-8973-0c2ef38d3a29 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:36.264229 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4caf442-170d-4d4d-83c8-736d7502a3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:36.265115 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab14fc4-c4f9-4066-b06e-8d796c0096b9 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:36.265303 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4caf442-170d-4d4d-83c8-736d7502a3b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:36.265970 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4caf442-170d-4d4d-83c8-736d7502a3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:36.266341 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4caf442-170d-4d4d-83c8-736d7502a3b0 admin admin] PATH_INFO: `/v3/projects/b413994f95124848b4cf98b0dddb2441` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:36.268574 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4caf442-170d-4d4d-83c8-736d7502a3b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b413994f95124848b4cf98b0dddb2441)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:36.271377 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4caf442-170d-4d4d-83c8-736d7502a3b0 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:36.278113 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759a4061-5598-4bfd-99c6-3ca25f76e76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:36.279769 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a4061-5598-4bfd-99c6-3ca25f76e76b admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:36.281440 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a4061-5598-4bfd-99c6-3ca25f76e76b admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:36.281834 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a4061-5598-4bfd-99c6-3ca25f76e76b admin admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:36.283790 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759a4061-5598-4bfd-99c6-3ca25f76e76b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:46:36.284332 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759a4061-5598-4bfd-99c6-3ca25f76e76b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:36.287612 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759a4061-5598-4bfd-99c6-3ca25f76e76b admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:36.314765 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1044/2098] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Aug 29 22:46:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:46:36.320569 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759a4061-5598-4bfd-99c6-3ca25f76e76b admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:36.341764 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759a4061-5598-4bfd-99c6-3ca25f76e76b admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:36.346981 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b5fed-d118-4ef6-b03c-1de83a6db90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:36.347703 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b5fed-d118-4ef6-b03c-1de83a6db90d admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:36.348079 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b5fed-d118-4ef6-b03c-1de83a6db90d admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:36.348422 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b5fed-d118-4ef6-b03c-1de83a6db90d admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:36.349206 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08b5fed-d118-4ef6-b03c-1de83a6db90d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:36.351230 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08b5fed-d118-4ef6-b03c-1de83a6db90d admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:36.368109 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:36.370537 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-c4caf442-170d-4d4d-83c8-736d7502a3b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b413994f95124848b4cf98b0dddb2441', 'request_id': 'req-c4caf442-170d-4d4d-83c8-736d7502a3b0'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:36.384311 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-c4caf442-170d-4d4d-83c8-736d7502a3b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b413994f95124848b4cf98b0dddb2441', 'request_id': 'req-c4caf442-170d-4d4d-83c8-736d7502a3b0'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:36.393980 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1045/2099] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:46:36 2022] POST /identity/v3/projects => generated 369 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:46:36.396922 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b5fed-d118-4ef6-b03c-1de83a6db90d admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:36.402928 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-c4caf442-170d-4d4d-83c8-736d7502a3b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b413994f95124848b4cf98b0dddb2441', 'request_id': 'req-c4caf442-170d-4d4d-83c8-736d7502a3b0'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:36.425690 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-c4caf442-170d-4d4d-83c8-736d7502a3b0 admin admin] The token cache is being invalidate because project b413994f95124848b4cf98b0dddb2441 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:46:36.426256 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-c4caf442-170d-4d4d-83c8-736d7502a3b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:36.428684 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-c4caf442-170d-4d4d-83c8-736d7502a3b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:36.430840 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1055/2100] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:46:36 2022] DELETE /identity/v3/projects/b413994f95124848b4cf98b0dddb2441 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:36.434982 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4caf442-170d-4d4d-83c8-736d7502a3b0 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:36.436808 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-c4caf442-170d-4d4d-83c8-736d7502a3b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:36.496322 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b5fed-d118-4ef6-b03c-1de83a6db90d admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:36.506414 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c64c045-f5cb-40ff-8a22-156dbb0ac682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:36.507484 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c64c045-f5cb-40ff-8a22-156dbb0ac682 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:36.507783 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c64c045-f5cb-40ff-8a22-156dbb0ac682 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:36.508060 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c64c045-f5cb-40ff-8a22-156dbb0ac682 admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:36.508902 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c64c045-f5cb-40ff-8a22-156dbb0ac682 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:36.511110 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c64c045-f5cb-40ff-8a22-156dbb0ac682 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:36.524239 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4caf442-170d-4d4d-83c8-736d7502a3b0 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:36.531560 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad805f42-63f5-4182-bbe0-7b38f427af8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:36.533616 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad805f42-63f5-4182-bbe0-7b38f427af8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:36.533997 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad805f42-63f5-4182-bbe0-7b38f427af8f admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:36.534366 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad805f42-63f5-4182-bbe0-7b38f427af8f admin admin] PATH_INFO: `/v3/users/8f932ac1754544c1b3eadfbaef17045c` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:36.536298 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad805f42-63f5-4182-bbe0-7b38f427af8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f932ac1754544c1b3eadfbaef17045c)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:36.544855 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1046/2101] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:46:36 2022] POST /identity/v3/users => generated 285 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:46:36.545102 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad805f42-63f5-4182-bbe0-7b38f427af8f admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:36.551064 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c64c045-f5cb-40ff-8a22-156dbb0ac682 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:36.554441 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-0c64c045-f5cb-40ff-8a22-156dbb0ac682 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:36.569161 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c64c045-f5cb-40ff-8a22-156dbb0ac682 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:36.574284 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e33c0-c6e8-4999-824d-2e04db735d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:36.574997 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e33c0-c6e8-4999-824d-2e04db735d2c admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:36.575344 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e33c0-c6e8-4999-824d-2e04db735d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:36.575681 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e33c0-c6e8-4999-824d-2e04db735d2c admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:36.576407 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062e33c0-c6e8-4999-824d-2e04db735d2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:36.578094 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062e33c0-c6e8-4999-824d-2e04db735d2c admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:36.592859 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1047/2102] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:46:36.594324 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e33c0-c6e8-4999-824d-2e04db735d2c admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:36.608212 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e33c0-c6e8-4999-824d-2e04db735d2c admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:36.613645 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4703520-4365-485a-b527-ee0259235eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:36.614411 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4703520-4365-485a-b527-ee0259235eca admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:36.615463 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4703520-4365-485a-b527-ee0259235eca admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:36.615942 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4703520-4365-485a-b527-ee0259235eca admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:36.617076 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4703520-4365-485a-b527-ee0259235eca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:36.619394 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4703520-4365-485a-b527-ee0259235eca admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:36.621128 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-ad805f42-63f5-4182-bbe0-7b38f427af8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f932ac1754544c1b3eadfbaef17045c'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:36.624023 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:36.632548 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-ad805f42-63f5-4182-bbe0-7b38f427af8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f932ac1754544c1b3eadfbaef17045c'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:36.633254 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1048/2103] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:46:36.637548 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-ad805f42-63f5-4182-bbe0-7b38f427af8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f932ac1754544c1b3eadfbaef17045c'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:36.638718 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4703520-4365-485a-b527-ee0259235eca admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:36.645697 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-ad805f42-63f5-4182-bbe0-7b38f427af8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f932ac1754544c1b3eadfbaef17045c'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:36.647538 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-ad805f42-63f5-4182-bbe0-7b38f427af8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f932ac1754544c1b3eadfbaef17045c'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:36.650357 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4703520-4365-485a-b527-ee0259235eca admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:36.657044 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce81368-0494-4bdb-9429-fce75c94f8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:36.658446 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce81368-0494-4bdb-9429-fce75c94f8a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:36.659045 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce81368-0494-4bdb-9429-fce75c94f8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:36.659465 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce81368-0494-4bdb-9429-fce75c94f8a4 admin admin] PATH_INFO: `/v3/projects/c99d2782ea4749d7884353a7f37ed4a1/users/defe2125f653417aacf52ac36153c616/roles/0c67797d444d4c929b2ccab47c468848` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:36.669235 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1056/2104] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:46:36 2022] DELETE /identity/v3/users/8f932ac1754544c1b3eadfbaef17045c => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:36.681744 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce81368-0494-4bdb-9429-fce75c94f8a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c99d2782ea4749d7884353a7f37ed4a1, user_id=defe2125f653417aacf52ac36153c616, role_id=0c67797d444d4c929b2ccab47c468848)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:36.684627 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce81368-0494-4bdb-9429-fce75c94f8a4 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:36.707015 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1049/2105] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:46:36 2022] PUT /identity/v3/projects/c99d2782ea4749d7884353a7f37ed4a1/users/defe2125f653417aacf52ac36153c616/roles/0c67797d444d4c929b2ccab47c468848 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:46:36.719195 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd49b4-9643-48c9-9b67-7f0d7ce09046 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:36.720301 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd49b4-9643-48c9-9b67-7f0d7ce09046 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:36.720881 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd49b4-9643-48c9-9b67-7f0d7ce09046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:36.768375 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-f2fd49b4-9643-48c9-9b67-7f0d7ce09046 None None] MFA Rules not processed for user `defe2125f653417aacf52ac36153c616`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:36.770318 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-f2fd49b4-9643-48c9-9b67-7f0d7ce09046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:36.915056 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1057/2106] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:46:36.929100 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce81368-0494-4bdb-9429-fce75c94f8a4 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:36.931526 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-bce81368-0494-4bdb-9429-fce75c94f8a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:37.003494 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce81368-0494-4bdb-9429-fce75c94f8a4 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:37.008669 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c06c7-b75c-4563-ab77-61cd3e83a1a7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5c4e692fd714354b96bd3ef4fcecdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:37.009402 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c06c7-b75c-4563-ab77-61cd3e83a1a7 service glance] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:37.009762 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c06c7-b75c-4563-ab77-61cd3e83a1a7 service glance] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:37.010113 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c06c7-b75c-4563-ab77-61cd3e83a1a7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:37.025406 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3c06c7-b75c-4563-ab77-61cd3e83a1a7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:37.026864 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3c06c7-b75c-4563-ab77-61cd3e83a1a7 service glance] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:37.046734 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1050/2107] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:46:36 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:46:37.155156 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fd49b4-9643-48c9-9b67-7f0d7ce09046 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:37.156806 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-f2fd49b4-9643-48c9-9b67-7f0d7ce09046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:37.269503 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fd49b4-9643-48c9-9b67-7f0d7ce09046 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:37.278005 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b4846-6588-40a9-9cfe-66301627c25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:37.279413 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b4846-6588-40a9-9cfe-66301627c25c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:37.280135 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b4846-6588-40a9-9cfe-66301627c25c admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:37.280619 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b4846-6588-40a9-9cfe-66301627c25c admin admin] PATH_INFO: `/v3/projects/6902da9e177d4b05a37f6035dd4b10a9` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:37.283886 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28b4846-6588-40a9-9cfe-66301627c25c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6902da9e177d4b05a37f6035dd4b10a9)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:37.285960 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28b4846-6588-40a9-9cfe-66301627c25c admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:37.355451 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-b28b4846-6588-40a9-9cfe-66301627c25c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6902da9e177d4b05a37f6035dd4b10a9', 'request_id': 'req-b28b4846-6588-40a9-9cfe-66301627c25c'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:37.366471 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-b28b4846-6588-40a9-9cfe-66301627c25c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6902da9e177d4b05a37f6035dd4b10a9', 'request_id': 'req-b28b4846-6588-40a9-9cfe-66301627c25c'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:37.376988 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:37.380592 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-b28b4846-6588-40a9-9cfe-66301627c25c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6902da9e177d4b05a37f6035dd4b10a9', 'request_id': 'req-b28b4846-6588-40a9-9cfe-66301627c25c'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:37.405666 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-b28b4846-6588-40a9-9cfe-66301627c25c admin admin] The token cache is being invalidate because project 6902da9e177d4b05a37f6035dd4b10a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:46:37.406129 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-b28b4846-6588-40a9-9cfe-66301627c25c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:37.407860 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-b28b4846-6588-40a9-9cfe-66301627c25c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:37.410846 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1058/2108] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:46:37 2022] DELETE /identity/v3/projects/6902da9e177d4b05a37f6035dd4b10a9 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:37.415604 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc651947-9574-41ff-9b8d-38e13a367b82 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:37.415832 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc651947-9574-41ff-9b8d-38e13a367b82 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:37.416111 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc651947-9574-41ff-9b8d-38e13a367b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:37.439783 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-bc651947-9574-41ff-9b8d-38e13a367b82 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:37.441046 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-bc651947-9574-41ff-9b8d-38e13a367b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:37.487128 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:37.542176 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1051/2109] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:46:37.544372 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de599c24-fd0c-41a4-895f-eb1d1053176f None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:37.544843 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de599c24-fd0c-41a4-895f-eb1d1053176f None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:37.545126 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de599c24-fd0c-41a4-895f-eb1d1053176f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:37.609444 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-de599c24-fd0c-41a4-895f-eb1d1053176f None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:37.610887 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-de599c24-fd0c-41a4-895f-eb1d1053176f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:37.628689 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1059/2110] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:46:37.634485 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc651947-9574-41ff-9b8d-38e13a367b82 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:37.665339 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc651947-9574-41ff-9b8d-38e13a367b82 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:37.690682 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37b7ca6-3e53-4e19-b791-86a0f5bf9c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:37.691493 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b7ca6-3e53-4e19-b791-86a0f5bf9c70 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:37.691888 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b7ca6-3e53-4e19-b791-86a0f5bf9c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:37.693766 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b7ca6-3e53-4e19-b791-86a0f5bf9c70 admin admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:37.694737 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37b7ca6-3e53-4e19-b791-86a0f5bf9c70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:46:37.695040 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37b7ca6-3e53-4e19-b791-86a0f5bf9c70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:37.703433 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37b7ca6-3e53-4e19-b791-86a0f5bf9c70 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:37.742028 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1052/2111] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Aug 29 22:46:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:46:37.746366 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de599c24-fd0c-41a4-895f-eb1d1053176f None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:37.758366 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de599c24-fd0c-41a4-895f-eb1d1053176f None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:37.773568 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead72dd-f1fe-4cdc-9e67-31f5433af64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:37.774194 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead72dd-f1fe-4cdc-9e67-31f5433af64d admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:37.774469 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead72dd-f1fe-4cdc-9e67-31f5433af64d admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:37.774738 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead72dd-f1fe-4cdc-9e67-31f5433af64d admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:37.775382 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ead72dd-f1fe-4cdc-9e67-31f5433af64d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:37.785460 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ead72dd-f1fe-4cdc-9e67-31f5433af64d admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:37.859592 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1060/2112] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:46:37 2022] POST /identity/v3/projects => generated 383 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:46:37.866352 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37b7ca6-3e53-4e19-b791-86a0f5bf9c70 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:37.881297 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37b7ca6-3e53-4e19-b791-86a0f5bf9c70 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:37.959467 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23922dee-9ae4-43d9-a2ad-7474be284f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:37.960233 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23922dee-9ae4-43d9-a2ad-7474be284f00 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:37.960577 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23922dee-9ae4-43d9-a2ad-7474be284f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:37.960916 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23922dee-9ae4-43d9-a2ad-7474be284f00 admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:37.961698 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23922dee-9ae4-43d9-a2ad-7474be284f00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:37.963886 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23922dee-9ae4-43d9-a2ad-7474be284f00 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:37.994331 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1053/2113] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:46:37 2022] POST /identity/v3/users => generated 292 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:46:38.012282 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead72dd-f1fe-4cdc-9e67-31f5433af64d admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:38.054954 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead72dd-f1fe-4cdc-9e67-31f5433af64d admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:38.076659 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f0c62b-73e5-444a-af7e-10a58c071143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:38.088784 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0c62b-73e5-444a-af7e-10a58c071143 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:38.089706 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0c62b-73e5-444a-af7e-10a58c071143 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:38.089988 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0c62b-73e5-444a-af7e-10a58c071143 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:38.096928 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f0c62b-73e5-444a-af7e-10a58c071143 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:38.105555 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f0c62b-73e5-444a-af7e-10a58c071143 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:38.148962 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1061/2114] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:46:38 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:46:38.152852 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23922dee-9ae4-43d9-a2ad-7474be284f00 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:38.168774 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23922dee-9ae4-43d9-a2ad-7474be284f00 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:38.215775 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcacbf1-616e-4700-84bb-d8bbf6e37731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:38.216407 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcacbf1-616e-4700-84bb-d8bbf6e37731 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:38.216688 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcacbf1-616e-4700-84bb-d8bbf6e37731 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:38.216980 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcacbf1-616e-4700-84bb-d8bbf6e37731 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:38.219950 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcacbf1-616e-4700-84bb-d8bbf6e37731 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:38.223558 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcacbf1-616e-4700-84bb-d8bbf6e37731 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:38.242865 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1054/2115] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:46:38 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:46:38.247079 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f0c62b-73e5-444a-af7e-10a58c071143 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:38.259871 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f0c62b-73e5-444a-af7e-10a58c071143 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:38.277976 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca767544-769d-47e8-9cbd-aec3948f4685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:38.278495 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca767544-769d-47e8-9cbd-aec3948f4685 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:38.278882 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca767544-769d-47e8-9cbd-aec3948f4685 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:38.279187 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca767544-769d-47e8-9cbd-aec3948f4685 admin admin] PATH_INFO: `/v3/projects/7cf8ffd05e534d2ba275c116b053bc64/users/c355ccf1b1674d5e81ce7803fade3d8e/roles/0c67797d444d4c929b2ccab47c468848` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:38.333066 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca767544-769d-47e8-9cbd-aec3948f4685 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cf8ffd05e534d2ba275c116b053bc64, user_id=c355ccf1b1674d5e81ce7803fade3d8e, role_id=0c67797d444d4c929b2ccab47c468848)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:38.345487 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca767544-769d-47e8-9cbd-aec3948f4685 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:38.379002 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1062/2116] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:46:38 2022] PUT /identity/v3/projects/7cf8ffd05e534d2ba275c116b053bc64/users/c355ccf1b1674d5e81ce7803fade3d8e/roles/0c67797d444d4c929b2ccab47c468848 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:38.393717 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8e1b4-a07f-411e-afc0-265fb8aa9052 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:38.394015 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8e1b4-a07f-411e-afc0-265fb8aa9052 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:38.394379 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8e1b4-a07f-411e-afc0-265fb8aa9052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:38.484823 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-7cc8e1b4-a07f-411e-afc0-265fb8aa9052 None None] MFA Rules not processed for user `c355ccf1b1674d5e81ce7803fade3d8e`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:38.488753 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-7cc8e1b4-a07f-411e-afc0-265fb8aa9052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:38.636631 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1055/2117] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:46:38.637993 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca767544-769d-47e8-9cbd-aec3948f4685 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:38.754036 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca767544-769d-47e8-9cbd-aec3948f4685 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:38.766983 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2a317e-e5d9-43fa-bf95-2cadc9e8ae07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:38.767610 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a317e-e5d9-43fa-bf95-2cadc9e8ae07 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:38.767885 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a317e-e5d9-43fa-bf95-2cadc9e8ae07 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:38.768156 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a317e-e5d9-43fa-bf95-2cadc9e8ae07 admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:38.768853 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2a317e-e5d9-43fa-bf95-2cadc9e8ae07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:38.770892 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2a317e-e5d9-43fa-bf95-2cadc9e8ae07 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:38.833906 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc8e1b4-a07f-411e-afc0-265fb8aa9052 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:38.852549 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1063/2118] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:46:38 2022] POST /identity/v3/projects => generated 383 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:46:38.853204 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc8e1b4-a07f-411e-afc0-265fb8aa9052 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:38.902532 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:38.933733 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a650123a-8d69-4932-ae1e-cf86df0515b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:38.934373 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a650123a-8d69-4932-ae1e-cf86df0515b1 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:38.934659 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a650123a-8d69-4932-ae1e-cf86df0515b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:38.934991 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a650123a-8d69-4932-ae1e-cf86df0515b1 admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:38.935695 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a650123a-8d69-4932-ae1e-cf86df0515b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:38.937620 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a650123a-8d69-4932-ae1e-cf86df0515b1 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:38.964966 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1056/2119] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:46:38 2022] POST /identity/v3/users => generated 292 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:46:38.966375 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2a317e-e5d9-43fa-bf95-2cadc9e8ae07 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:38.979035 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2a317e-e5d9-43fa-bf95-2cadc9e8ae07 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:38.983777 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87bcfbb-7f2e-4813-85ae-a0b73e63e8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:38.984393 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87bcfbb-7f2e-4813-85ae-a0b73e63e8ab admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:38.984672 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87bcfbb-7f2e-4813-85ae-a0b73e63e8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:38.984947 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87bcfbb-7f2e-4813-85ae-a0b73e63e8ab admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:38.985649 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87bcfbb-7f2e-4813-85ae-a0b73e63e8ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:38.987274 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87bcfbb-7f2e-4813-85ae-a0b73e63e8ab admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:39.001373 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1064/2120] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:46:38 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:46:39.004837 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a650123a-8d69-4932-ae1e-cf86df0515b1 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:39.015672 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a650123a-8d69-4932-ae1e-cf86df0515b1 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:39.021152 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d88130f-b41f-415a-8397-aee35ea4e0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:39.021980 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d88130f-b41f-415a-8397-aee35ea4e0fe admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:39.022225 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d88130f-b41f-415a-8397-aee35ea4e0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:39.022505 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d88130f-b41f-415a-8397-aee35ea4e0fe admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:39.025266 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d88130f-b41f-415a-8397-aee35ea4e0fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:39.026833 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d88130f-b41f-415a-8397-aee35ea4e0fe admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:39.043699 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1057/2121] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:46:39 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:46:39.044515 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87bcfbb-7f2e-4813-85ae-a0b73e63e8ab admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:39.060321 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87bcfbb-7f2e-4813-85ae-a0b73e63e8ab admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:39.070227 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4534aebd-2244-4dd6-8ce3-d4d161f8c619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:39.070915 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534aebd-2244-4dd6-8ce3-d4d161f8c619 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:39.071197 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534aebd-2244-4dd6-8ce3-d4d161f8c619 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:39.071474 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534aebd-2244-4dd6-8ce3-d4d161f8c619 admin admin] PATH_INFO: `/v3/projects/a215b1b79e88446388040643c99bbf88/users/62e3052698534eefb8508489dd34e148/roles/0c67797d444d4c929b2ccab47c468848` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:39.090037 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4534aebd-2244-4dd6-8ce3-d4d161f8c619 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a215b1b79e88446388040643c99bbf88, user_id=62e3052698534eefb8508489dd34e148, role_id=0c67797d444d4c929b2ccab47c468848)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:39.098363 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4534aebd-2244-4dd6-8ce3-d4d161f8c619 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:39.117147 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1065/2122] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:46:39 2022] PUT /identity/v3/projects/a215b1b79e88446388040643c99bbf88/users/62e3052698534eefb8508489dd34e148/roles/0c67797d444d4c929b2ccab47c468848 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:46:39.134964 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d643ec-f25d-492a-813e-7c6566b4d7b1 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:39.135614 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d643ec-f25d-492a-813e-7c6566b4d7b1 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:39.136174 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d643ec-f25d-492a-813e-7c6566b4d7b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:39.176316 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-c1d643ec-f25d-492a-813e-7c6566b4d7b1 None None] MFA Rules not processed for user `62e3052698534eefb8508489dd34e148`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:39.178247 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-c1d643ec-f25d-492a-813e-7c6566b4d7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:39.181469 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34febd-28dd-4571-89ab-3d8c66484a5c None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:39.181982 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34febd-28dd-4571-89ab-3d8c66484a5c None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:39.182473 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34febd-28dd-4571-89ab-3d8c66484a5c None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:39.184328 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1066/2123] 10.222.0.47 () {54 vars in 921 bytes} [Mon Aug 29 22:46:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:46:39.199900 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a05b36-c424-4058-8d9f-943b14252808 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:39.200425 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a05b36-c424-4058-8d9f-943b14252808 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:39.210126 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a05b36-c424-4058-8d9f-943b14252808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:39.253415 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-f3a05b36-c424-4058-8d9f-943b14252808 None None] MFA Rules not processed for user `296cbef772104e078971ba93aa2e022c`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:39.254912 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-f3a05b36-c424-4058-8d9f-943b14252808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:39.282953 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1058/2124] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:46:39.287802 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d643ec-f25d-492a-813e-7c6566b4d7b1 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:39.329553 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:DELETE=2,keystone:SELECT=93,keystone:INSERT=5 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:39.399280 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1067/2125] 10.222.0.47 () {58 vars in 1018 bytes} [Mon Aug 29 22:46:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:46:39.400527 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a05b36-c424-4058-8d9f-943b14252808 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:39.402352 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-f3a05b36-c424-4058-8d9f-943b14252808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:39.433212 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d643ec-f25d-492a-813e-7c6566b4d7b1 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:39.439380 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec7dc0d-ea7d-480a-a5b6-84904dce9c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:39.440209 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7dc0d-ea7d-480a-a5b6-84904dce9c6c admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:39.440664 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7dc0d-ea7d-480a-a5b6-84904dce9c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:39.441080 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7dc0d-ea7d-480a-a5b6-84904dce9c6c admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:39.442094 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec7dc0d-ea7d-480a-a5b6-84904dce9c6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:39.445456 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec7dc0d-ea7d-480a-a5b6-84904dce9c6c admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:39.506178 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1059/2126] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:46:39 2022] POST /identity/v3/projects => generated 385 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:46:39.507788 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5e076-6948-4846-9072-7735486b4f10 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:39.507912 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5e076-6948-4846-9072-7735486b4f10 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:39.508155 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5e076-6948-4846-9072-7735486b4f10 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:39.510052 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1060/2127] 10.222.0.47 () {54 vars in 961 bytes} [Mon Aug 29 22:46:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:46:39.510953 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5e076-6948-4846-9072-7735486b4f10 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:39.529965 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a05b36-c424-4058-8d9f-943b14252808 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:39.555205 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:39.619013 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5e076-6948-4846-9072-7735486b4f10 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:39.626988 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f9dfb-35e5-42c3-9211-5a30eeae795e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:39.627622 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f9dfb-35e5-42c3-9211-5a30eeae795e admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:39.627945 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f9dfb-35e5-42c3-9211-5a30eeae795e admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:39.628244 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f9dfb-35e5-42c3-9211-5a30eeae795e admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:39.628810 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48f9dfb-35e5-42c3-9211-5a30eeae795e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:39.631252 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48f9dfb-35e5-42c3-9211-5a30eeae795e admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:39.648116 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e806f1-9658-4e16-962f-708db188511e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:39.649199 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e806f1-9658-4e16-962f-708db188511e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:39.649675 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e806f1-9658-4e16-962f-708db188511e admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:39.650297 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e806f1-9658-4e16-962f-708db188511e admin admin] PATH_INFO: `/v3/users/21070561ca4f4b5fb621cde17195d1cc` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:39.652571 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e806f1-9658-4e16-962f-708db188511e admin admin] RBAC: Authorizing `identity:delete_user(user_id=21070561ca4f4b5fb621cde17195d1cc)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:39.655142 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e806f1-9658-4e16-962f-708db188511e admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:39.670593 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1061/2128] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:46:39 2022] POST /identity/v3/users => generated 299 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:46:39.670593 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcfd1b-8e81-42cb-a236-22e9a1a71711 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:39.670593 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcfd1b-8e81-42cb-a236-22e9a1a71711 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:39.670593 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcfd1b-8e81-42cb-a236-22e9a1a71711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:39.695159 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-67dcfd1b-8e81-42cb-a236-22e9a1a71711 None None] MFA Rules not processed for user `296cbef772104e078971ba93aa2e022c`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:39.701428 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-67dcfd1b-8e81-42cb-a236-22e9a1a71711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:39.729928 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-07e806f1-9658-4e16-962f-708db188511e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21070561ca4f4b5fb621cde17195d1cc'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:39.737795 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-07e806f1-9658-4e16-962f-708db188511e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21070561ca4f4b5fb621cde17195d1cc'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:39.738775 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-07e806f1-9658-4e16-962f-708db188511e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21070561ca4f4b5fb621cde17195d1cc'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:39.748822 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-07e806f1-9658-4e16-962f-708db188511e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21070561ca4f4b5fb621cde17195d1cc'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:39.754580 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-07e806f1-9658-4e16-962f-708db188511e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21070561ca4f4b5fb621cde17195d1cc'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:39.778606 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:39.793401 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1068/2129] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:46:39 2022] DELETE /identity/v3/users/21070561ca4f4b5fb621cde17195d1cc => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:39.794290 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e806f1-9658-4e16-962f-708db188511e admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:39.797123 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-07e806f1-9658-4e16-962f-708db188511e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:39.824380 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1062/2130] 10.222.0.47 () {58 vars in 1058 bytes} [Mon Aug 29 22:46:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:46:39.825250 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dcfd1b-8e81-42cb-a236-22e9a1a71711 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:39.826630 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-67dcfd1b-8e81-42cb-a236-22e9a1a71711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:39.849640 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dcfd1b-8e81-42cb-a236-22e9a1a71711 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:39.895502 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e806f1-9658-4e16-962f-708db188511e admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:39.904549 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb6b00-62fd-4290-8bba-ee465f8b0a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:39.905263 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb6b00-62fd-4290-8bba-ee465f8b0a72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:39.905579 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb6b00-62fd-4290-8bba-ee465f8b0a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:39.905913 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb6b00-62fd-4290-8bba-ee465f8b0a72 admin admin] PATH_INFO: `/v3/users/1848e9b64d824863bd726a3df3a280b4` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:39.907806 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cb6b00-62fd-4290-8bba-ee465f8b0a72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1848e9b64d824863bd726a3df3a280b4)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:39.910584 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cb6b00-62fd-4290-8bba-ee465f8b0a72 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:39.935145 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950cc7e5-f8df-4b4e-8524-16d4d2f53e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:39.936231 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950cc7e5-f8df-4b4e-8524-16d4d2f53e51 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:39.938884 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950cc7e5-f8df-4b4e-8524-16d4d2f53e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:39.939275 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950cc7e5-f8df-4b4e-8524-16d4d2f53e51 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:39.940099 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950cc7e5-f8df-4b4e-8524-16d4d2f53e51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:39.944111 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950cc7e5-f8df-4b4e-8524-16d4d2f53e51 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:39.955803 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1063/2131] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:46:39 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:46:39.956944 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950cc7e5-f8df-4b4e-8524-16d4d2f53e51 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:39.995027 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-b3cb6b00-62fd-4290-8bba-ee465f8b0a72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1848e9b64d824863bd726a3df3a280b4'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:40.003935 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-b3cb6b00-62fd-4290-8bba-ee465f8b0a72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1848e9b64d824863bd726a3df3a280b4'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:40.004738 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-b3cb6b00-62fd-4290-8bba-ee465f8b0a72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1848e9b64d824863bd726a3df3a280b4'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:40.017291 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-b3cb6b00-62fd-4290-8bba-ee465f8b0a72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1848e9b64d824863bd726a3df3a280b4'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:40.018099 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-b3cb6b00-62fd-4290-8bba-ee465f8b0a72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1848e9b64d824863bd726a3df3a280b4'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:40.022928 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:40.045496 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950cc7e5-f8df-4b4e-8524-16d4d2f53e51 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:40.059218 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1069/2132] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:46:39 2022] DELETE /identity/v3/users/1848e9b64d824863bd726a3df3a280b4 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:40.060494 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb6b00-62fd-4290-8bba-ee465f8b0a72 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:40.062507 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-b3cb6b00-62fd-4290-8bba-ee465f8b0a72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:40.128776 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b26c01-b34c-4a07-b0f0-1b5a3ef70387 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296cbef772104e078971ba93aa2e022c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:40.129716 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b26c01-b34c-4a07-b0f0-1b5a3ef70387 service placement] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:40.130033 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b26c01-b34c-4a07-b0f0-1b5a3ef70387 service placement] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:40.130308 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b26c01-b34c-4a07-b0f0-1b5a3ef70387 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:40.133355 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-b8b26c01-b34c-4a07-b0f0-1b5a3ef70387 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:40.143440 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb6b00-62fd-4290-8bba-ee465f8b0a72 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:40.145483 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b26c01-b34c-4a07-b0f0-1b5a3ef70387 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:40.147616 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b26c01-b34c-4a07-b0f0-1b5a3ef70387 service placement] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:40.149146 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05b1226-7d81-4ee5-ac4f-41f9846e4099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:40.149844 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b1226-7d81-4ee5-ac4f-41f9846e4099 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:40.150130 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b1226-7d81-4ee5-ac4f-41f9846e4099 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:40.150520 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b1226-7d81-4ee5-ac4f-41f9846e4099 admin admin] PATH_INFO: `/v3/projects/b6e588778c0b41b2bffac1c09a4f6d4a/users/6af30e05de254c2181ff08a47ede1691/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:40.158103 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1064/2133] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:46:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:46:40.158912 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b26c01-b34c-4a07-b0f0-1b5a3ef70387 service placement] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:40.160297 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-b8b26c01-b34c-4a07-b0f0-1b5a3ef70387 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:40.168202 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05b1226-7d81-4ee5-ac4f-41f9846e4099 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6e588778c0b41b2bffac1c09a4f6d4a, user_id=6af30e05de254c2181ff08a47ede1691, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:40.171072 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05b1226-7d81-4ee5-ac4f-41f9846e4099 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:40.176240 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b26c01-b34c-4a07-b0f0-1b5a3ef70387 service placement] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:40.181862 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:40.182252 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420cb684-c2b1-4e22-acbd-a1d321f0abc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:40.182767 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420cb684-c2b1-4e22-acbd-a1d321f0abc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:40.182997 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420cb684-c2b1-4e22-acbd-a1d321f0abc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:40.183268 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420cb684-c2b1-4e22-acbd-a1d321f0abc5 admin admin] PATH_INFO: `/v3/projects/d485acfa629249d69c5f165bcb2711d9` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:40.186887 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420cb684-c2b1-4e22-acbd-a1d321f0abc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d485acfa629249d69c5f165bcb2711d9)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:40.188715 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420cb684-c2b1-4e22-acbd-a1d321f0abc5 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:40.193018 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1070/2134] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:46:40 2022] PUT /identity/v3/projects/b6e588778c0b41b2bffac1c09a4f6d4a/users/6af30e05de254c2181ff08a47ede1691/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:40.194871 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b093cf-cf9a-4e62-ace1-12ff4895fe80 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:40.195299 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b093cf-cf9a-4e62-ace1-12ff4895fe80 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:40.195592 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b093cf-cf9a-4e62-ace1-12ff4895fe80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:40.219286 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-70b093cf-cf9a-4e62-ace1-12ff4895fe80 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:40.220861 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-70b093cf-cf9a-4e62-ace1-12ff4895fe80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:40.246845 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-420cb684-c2b1-4e22-acbd-a1d321f0abc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd485acfa629249d69c5f165bcb2711d9', 'request_id': 'req-420cb684-c2b1-4e22-acbd-a1d321f0abc5'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:40.253095 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-420cb684-c2b1-4e22-acbd-a1d321f0abc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd485acfa629249d69c5f165bcb2711d9', 'request_id': 'req-420cb684-c2b1-4e22-acbd-a1d321f0abc5'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:40.259088 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-420cb684-c2b1-4e22-acbd-a1d321f0abc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd485acfa629249d69c5f165bcb2711d9', 'request_id': 'req-420cb684-c2b1-4e22-acbd-a1d321f0abc5'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:40.277363 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-420cb684-c2b1-4e22-acbd-a1d321f0abc5 admin admin] The token cache is being invalidate because project d485acfa629249d69c5f165bcb2711d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:46:40.277363 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-420cb684-c2b1-4e22-acbd-a1d321f0abc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:40.278251 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-420cb684-c2b1-4e22-acbd-a1d321f0abc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:40.280167 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1065/2135] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:46:40 2022] DELETE /identity/v3/projects/d485acfa629249d69c5f165bcb2711d9 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:40.280960 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420cb684-c2b1-4e22-acbd-a1d321f0abc5 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:40.282584 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-420cb684-c2b1-4e22-acbd-a1d321f0abc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:40.297946 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1071/2136] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:46:40.299198 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5a357-2988-4803-9cb8-3faab00f39a4 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:40.299484 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5a357-2988-4803-9cb8-3faab00f39a4 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:40.300178 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5a357-2988-4803-9cb8-3faab00f39a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:40.325929 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-7ef5a357-2988-4803-9cb8-3faab00f39a4 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:40.327163 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-7ef5a357-2988-4803-9cb8-3faab00f39a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:40.365500 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420cb684-c2b1-4e22-acbd-a1d321f0abc5 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:40.371227 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd029f22-ebce-4235-8efe-bcb13ffb58f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:40.371853 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd029f22-ebce-4235-8efe-bcb13ffb58f7 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:40.372136 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd029f22-ebce-4235-8efe-bcb13ffb58f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:40.372413 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd029f22-ebce-4235-8efe-bcb13ffb58f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:40.373087 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd029f22-ebce-4235-8efe-bcb13ffb58f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:40.375117 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd029f22-ebce-4235-8efe-bcb13ffb58f7 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:40.387544 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1066/2137] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:46:40 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:46:40.388383 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd029f22-ebce-4235-8efe-bcb13ffb58f7 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:40.390135 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-cd029f22-ebce-4235-8efe-bcb13ffb58f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:40.398280 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:40.410028 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1072/2138] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:46:40.410916 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5a357-2988-4803-9cb8-3faab00f39a4 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:40.425050 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5a357-2988-4803-9cb8-3faab00f39a4 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:40.430815 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efc6944-662a-4dc7-9ede-2a25737fa927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:40.431490 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc6944-662a-4dc7-9ede-2a25737fa927 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:40.431769 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc6944-662a-4dc7-9ede-2a25737fa927 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:40.432171 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc6944-662a-4dc7-9ede-2a25737fa927 admin admin] PATH_INFO: `/v3/projects/b6e588778c0b41b2bffac1c09a4f6d4a/users/6af30e05de254c2181ff08a47ede1691/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:40.434164 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efc6944-662a-4dc7-9ede-2a25737fa927 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6e588778c0b41b2bffac1c09a4f6d4a, user_id=6af30e05de254c2181ff08a47ede1691, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:40.436989 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efc6944-662a-4dc7-9ede-2a25737fa927 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:40.453372 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1073/2139] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:46:40 2022] PUT /identity/v3/projects/b6e588778c0b41b2bffac1c09a4f6d4a/users/6af30e05de254c2181ff08a47ede1691/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:40.453372 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d995d-a6a6-49b4-a351-5b27189dd7ed None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:40.453668 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d995d-a6a6-49b4-a351-5b27189dd7ed None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:40.453763 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d995d-a6a6-49b4-a351-5b27189dd7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:40.480315 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd029f22-ebce-4235-8efe-bcb13ffb58f7 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:40.481125 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-210d995d-a6a6-49b4-a351-5b27189dd7ed None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:40.482562 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-210d995d-a6a6-49b4-a351-5b27189dd7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:40.540170 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d45198-a4f9-48f6-82ce-60d016fdb526 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:40.540879 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d45198-a4f9-48f6-82ce-60d016fdb526 service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:40.541277 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d45198-a4f9-48f6-82ce-60d016fdb526 service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:40.541593 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d45198-a4f9-48f6-82ce-60d016fdb526 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:40.559667 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1074/2140] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:46:40.561971 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150f729-7208-49ca-93c1-ea00f13bd2e1 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:40.562430 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150f729-7208-49ca-93c1-ea00f13bd2e1 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:40.563083 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150f729-7208-49ca-93c1-ea00f13bd2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:40.594462 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-f150f729-7208-49ca-93c1-ea00f13bd2e1 None None] MFA Rules not processed for user `6af30e05de254c2181ff08a47ede1691`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:40.595697 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-f150f729-7208-49ca-93c1-ea00f13bd2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:40.610918 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:40.612445 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d45198-a4f9-48f6-82ce-60d016fdb526 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:40.614060 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d45198-a4f9-48f6-82ce-60d016fdb526 service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:40.625771 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1067/2141] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:46:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:46:40.626715 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d45198-a4f9-48f6-82ce-60d016fdb526 service neutron] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:40.637855 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d45198-a4f9-48f6-82ce-60d016fdb526 service neutron] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:40.643293 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba042bf-9072-412d-b210-457c66fbb7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:40.644626 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba042bf-9072-412d-b210-457c66fbb7e4 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:40.644862 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba042bf-9072-412d-b210-457c66fbb7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:40.645142 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba042bf-9072-412d-b210-457c66fbb7e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:40.645943 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba042bf-9072-412d-b210-457c66fbb7e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:46:40.646357 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba042bf-9072-412d-b210-457c66fbb7e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:40.648096 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba042bf-9072-412d-b210-457c66fbb7e4 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:40.667470 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1068/2142] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Aug 29 22:46:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:46:40.668939 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba042bf-9072-412d-b210-457c66fbb7e4 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:40.680351 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1075/2143] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:40 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:46:40.687109 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba042bf-9072-412d-b210-457c66fbb7e4 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:40.693997 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150f729-7208-49ca-93c1-ea00f13bd2e1 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:40.695523 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0a1ca2-678c-4a0e-86e6-5dc087675062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:40.695886 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-f150f729-7208-49ca-93c1-ea00f13bd2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:40.696280 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a1ca2-678c-4a0e-86e6-5dc087675062 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:40.696609 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a1ca2-678c-4a0e-86e6-5dc087675062 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:40.696883 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a1ca2-678c-4a0e-86e6-5dc087675062 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:40.697995 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0a1ca2-678c-4a0e-86e6-5dc087675062 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:40.700334 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0a1ca2-678c-4a0e-86e6-5dc087675062 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:40.742200 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1069/2144] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:46:40 2022] POST /identity/v3/projects => generated 377 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:46:40.743199 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0a1ca2-678c-4a0e-86e6-5dc087675062 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:40.772660 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150f729-7208-49ca-93c1-ea00f13bd2e1 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:40.788543 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:40.836755 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0a1ca2-678c-4a0e-86e6-5dc087675062 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:40.844099 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8eb576-d9f1-4229-90f9-025268157dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:40.844827 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8eb576-d9f1-4229-90f9-025268157dee admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:40.845177 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8eb576-d9f1-4229-90f9-025268157dee admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:40.845553 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8eb576-d9f1-4229-90f9-025268157dee admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:40.846362 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8eb576-d9f1-4229-90f9-025268157dee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:40.848837 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8eb576-d9f1-4229-90f9-025268157dee admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:40.865731 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b272937-0ba9-4189-863c-437a1e48900f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:40.869535 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b272937-0ba9-4189-863c-437a1e48900f service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:40.870811 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b272937-0ba9-4189-863c-437a1e48900f service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:40.871109 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b272937-0ba9-4189-863c-437a1e48900f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:40.879570 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-7b272937-0ba9-4189-863c-437a1e48900f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:40.888617 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1070/2145] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:46:40 2022] POST /identity/v3/users => generated 289 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:46:40.893151 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8eb576-d9f1-4229-90f9-025268157dee admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:40.913117 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8eb576-d9f1-4229-90f9-025268157dee admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:40.922844 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a7973-8ee8-4235-8133-7143f419692e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:40.923798 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a7973-8ee8-4235-8133-7143f419692e admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:40.924083 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a7973-8ee8-4235-8133-7143f419692e admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:40.924355 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a7973-8ee8-4235-8133-7143f419692e admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:40.925019 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3a7973-8ee8-4235-8133-7143f419692e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:40.928371 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3a7973-8ee8-4235-8133-7143f419692e admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:40.945919 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1071/2146] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:46:40 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:46:40.950424 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a7973-8ee8-4235-8133-7143f419692e admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:40.975564 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a7973-8ee8-4235-8133-7143f419692e admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:40.983884 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b272937-0ba9-4189-863c-437a1e48900f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:40.984758 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae97c9bb-00a8-4bd7-abeb-81feb00f846e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:40.986511 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97c9bb-00a8-4bd7-abeb-81feb00f846e admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:40.986511 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97c9bb-00a8-4bd7-abeb-81feb00f846e admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:40.986886 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97c9bb-00a8-4bd7-abeb-81feb00f846e admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:40.987210 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b272937-0ba9-4189-863c-437a1e48900f service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:40.987869 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae97c9bb-00a8-4bd7-abeb-81feb00f846e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:40.990536 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae97c9bb-00a8-4bd7-abeb-81feb00f846e admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:41.010147 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1072/2147] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:46:40 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:46:41.014989 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1076/2148] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:46:40 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:46:41.017730 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae97c9bb-00a8-4bd7-abeb-81feb00f846e admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:41.047409 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae97c9bb-00a8-4bd7-abeb-81feb00f846e admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:41.056847 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb6d5d6-99b4-4f39-8d69-e744ba22f4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:41.062145 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb6d5d6-99b4-4f39-8d69-e744ba22f4aa admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:41.064461 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb6d5d6-99b4-4f39-8d69-e744ba22f4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:41.064715 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb6d5d6-99b4-4f39-8d69-e744ba22f4aa admin admin] PATH_INFO: `/v3/projects/8ce1893ba48f42c3b04ebd6f51f2d0e9/users/7b42516e12d346eea1561b745bf724a7/roles/0c67797d444d4c929b2ccab47c468848` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:41.095961 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb6d5d6-99b4-4f39-8d69-e744ba22f4aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ce1893ba48f42c3b04ebd6f51f2d0e9, user_id=7b42516e12d346eea1561b745bf724a7, role_id=0c67797d444d4c929b2ccab47c468848)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:41.096200 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b272937-0ba9-4189-863c-437a1e48900f service cinder] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:41.096200 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-7b272937-0ba9-4189-863c-437a1e48900f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:41.100343 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb6d5d6-99b4-4f39-8d69-e744ba22f4aa admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:41.129014 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b272937-0ba9-4189-863c-437a1e48900f service cinder] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:41.141750 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1073/2149] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:46:41 2022] PUT /identity/v3/projects/8ce1893ba48f42c3b04ebd6f51f2d0e9/users/7b42516e12d346eea1561b745bf724a7/roles/0c67797d444d4c929b2ccab47c468848 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:41.148583 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24296a-bab5-46fa-8fe3-286c04426ae0 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:41.149002 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24296a-bab5-46fa-8fe3-286c04426ae0 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:41.149298 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24296a-bab5-46fa-8fe3-286c04426ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:41.172666 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:41.189027 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-dd24296a-bab5-46fa-8fe3-286c04426ae0 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:41.190549 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-dd24296a-bab5-46fa-8fe3-286c04426ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:41.232406 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46696d5-600e-435d-8c90-527c89bf90ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:41.233480 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46696d5-600e-435d-8c90-527c89bf90ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:41.233867 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46696d5-600e-435d-8c90-527c89bf90ac admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:41.234246 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46696d5-600e-435d-8c90-527c89bf90ac admin admin] PATH_INFO: `/v3/projects/a14591886c814f59abd9aae40ecaf3de` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:41.235580 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46696d5-600e-435d-8c90-527c89bf90ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=a14591886c814f59abd9aae40ecaf3de)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:41.237654 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46696d5-600e-435d-8c90-527c89bf90ac admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:41.279340 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1074/2150] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:46:41.291515 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd24296a-bab5-46fa-8fe3-286c04426ae0 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:41.295152 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-dd24296a-bab5-46fa-8fe3-286c04426ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:41.328363 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-a46696d5-600e-435d-8c90-527c89bf90ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a14591886c814f59abd9aae40ecaf3de', 'request_id': 'req-a46696d5-600e-435d-8c90-527c89bf90ac'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:41.337115 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-a46696d5-600e-435d-8c90-527c89bf90ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a14591886c814f59abd9aae40ecaf3de', 'request_id': 'req-a46696d5-600e-435d-8c90-527c89bf90ac'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:41.347536 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-a46696d5-600e-435d-8c90-527c89bf90ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a14591886c814f59abd9aae40ecaf3de', 'request_id': 'req-a46696d5-600e-435d-8c90-527c89bf90ac'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:41.373828 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-a46696d5-600e-435d-8c90-527c89bf90ac admin admin] The token cache is being invalidate because project a14591886c814f59abd9aae40ecaf3de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:46:41.374493 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-a46696d5-600e-435d-8c90-527c89bf90ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:41.375015 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-a46696d5-600e-435d-8c90-527c89bf90ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:41.376889 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1077/2151] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:46:41 2022] DELETE /identity/v3/projects/a14591886c814f59abd9aae40ecaf3de => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:46:41.382775 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7364ff-e0c6-4a11-a544-d7b1ba9750a9 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:41.383364 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7364ff-e0c6-4a11-a544-d7b1ba9750a9 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:41.383720 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7364ff-e0c6-4a11-a544-d7b1ba9750a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:41.407273 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-8a7364ff-e0c6-4a11-a544-d7b1ba9750a9 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:41.409293 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-8a7364ff-e0c6-4a11-a544-d7b1ba9750a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:41.423813 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd24296a-bab5-46fa-8fe3-286c04426ae0 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:41.499284 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:41.531580 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b362ab1-8bf3-4c17-ac80-e6266f0cd193 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:41.532279 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b362ab1-8bf3-4c17-ac80-e6266f0cd193 service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:41.532811 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b362ab1-8bf3-4c17-ac80-e6266f0cd193 service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:41.533084 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b362ab1-8bf3-4c17-ac80-e6266f0cd193 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:41.535083 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-2b362ab1-8bf3-4c17-ac80-e6266f0cd193 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:41.543122 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1078/2152] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:46:41.552629 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d65227-02ca-41b4-ad14-3c911d28e1e8 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:41.553022 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d65227-02ca-41b4-ad14-3c911d28e1e8 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:41.553460 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d65227-02ca-41b4-ad14-3c911d28e1e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:41.555610 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b362ab1-8bf3-4c17-ac80-e6266f0cd193 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:41.557070 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b362ab1-8bf3-4c17-ac80-e6266f0cd193 service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:41.570114 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1075/2153] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:46:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:46:41.589880 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-f3d65227-02ca-41b4-ad14-3c911d28e1e8 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:41.591302 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-f3d65227-02ca-41b4-ad14-3c911d28e1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:41.604785 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1079/2154] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:46:41.606339 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b362ab1-8bf3-4c17-ac80-e6266f0cd193 service neutron] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:41.618279 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b362ab1-8bf3-4c17-ac80-e6266f0cd193 service neutron] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:41.623059 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6845f1-5010-40c5-abe6-2aaa7d9119cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:41.623674 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6845f1-5010-40c5-abe6-2aaa7d9119cd admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:41.623984 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6845f1-5010-40c5-abe6-2aaa7d9119cd admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:41.624259 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6845f1-5010-40c5-abe6-2aaa7d9119cd admin admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:41.624924 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6845f1-5010-40c5-abe6-2aaa7d9119cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:46:41.625228 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6845f1-5010-40c5-abe6-2aaa7d9119cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:41.626882 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6845f1-5010-40c5-abe6-2aaa7d9119cd admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:41.641039 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1076/2155] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Aug 29 22:46:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:46:41.645465 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d65227-02ca-41b4-ad14-3c911d28e1e8 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:41.655268 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d65227-02ca-41b4-ad14-3c911d28e1e8 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:41.660772 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4de8371-6a4a-4454-9652-3ba7edfdb852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:41.661495 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de8371-6a4a-4454-9652-3ba7edfdb852 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:41.661833 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de8371-6a4a-4454-9652-3ba7edfdb852 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:41.662197 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de8371-6a4a-4454-9652-3ba7edfdb852 admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:41.662862 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4de8371-6a4a-4454-9652-3ba7edfdb852 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:41.664782 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4de8371-6a4a-4454-9652-3ba7edfdb852 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:41.699980 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1080/2156] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:46:41 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:46:41.704140 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6845f1-5010-40c5-abe6-2aaa7d9119cd admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:41.714817 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6845f1-5010-40c5-abe6-2aaa7d9119cd admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:41.783893 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf50a1-ade3-4ee4-86a9-6fbc0cc4cff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:41.784527 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf50a1-ade3-4ee4-86a9-6fbc0cc4cff2 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:41.785458 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf50a1-ade3-4ee4-86a9-6fbc0cc4cff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:41.785741 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf50a1-ade3-4ee4-86a9-6fbc0cc4cff2 admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:41.786390 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacf50a1-ade3-4ee4-86a9-6fbc0cc4cff2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:41.789112 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacf50a1-ade3-4ee4-86a9-6fbc0cc4cff2 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:41.820367 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1077/2157] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:46:41 2022] POST /identity/v3/users => generated 289 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:46:41.821513 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4de8371-6a4a-4454-9652-3ba7edfdb852 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:41.833062 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4de8371-6a4a-4454-9652-3ba7edfdb852 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:41.838005 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b831aea-85bf-4574-aa7b-8454b5c2de45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:41.838652 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b831aea-85bf-4574-aa7b-8454b5c2de45 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:41.839064 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b831aea-85bf-4574-aa7b-8454b5c2de45 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:41.839460 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b831aea-85bf-4574-aa7b-8454b5c2de45 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:41.839975 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b831aea-85bf-4574-aa7b-8454b5c2de45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:41.841969 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b831aea-85bf-4574-aa7b-8454b5c2de45 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:41.854019 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1081/2158] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:46:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:46:41.858011 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf50a1-ade3-4ee4-86a9-6fbc0cc4cff2 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:41.870085 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf50a1-ade3-4ee4-86a9-6fbc0cc4cff2 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:41.877837 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d837bd-493e-416e-bd48-3e2360654e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:41.878876 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d837bd-493e-416e-bd48-3e2360654e29 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:41.879172 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d837bd-493e-416e-bd48-3e2360654e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:41.879475 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d837bd-493e-416e-bd48-3e2360654e29 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:41.880114 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d837bd-493e-416e-bd48-3e2360654e29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:41.882487 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d837bd-493e-416e-bd48-3e2360654e29 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:41.897859 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1078/2159] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:46:41 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:46:41.900930 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b831aea-85bf-4574-aa7b-8454b5c2de45 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:41.913248 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b831aea-85bf-4574-aa7b-8454b5c2de45 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:41.919045 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f70cf8-c564-4980-87da-feed8f929c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:41.919861 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f70cf8-c564-4980-87da-feed8f929c37 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:41.920147 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f70cf8-c564-4980-87da-feed8f929c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:41.920428 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f70cf8-c564-4980-87da-feed8f929c37 admin admin] PATH_INFO: `/v3/projects/11b4177b44ed4c97b4ea1f211f6d721a/users/502198ca408149579e319d758f116998/roles/0c67797d444d4c929b2ccab47c468848` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:41.934267 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:41.938338 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f70cf8-c564-4980-87da-feed8f929c37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11b4177b44ed4c97b4ea1f211f6d721a, user_id=502198ca408149579e319d758f116998, role_id=0c67797d444d4c929b2ccab47c468848)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:41.941976 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f70cf8-c564-4980-87da-feed8f929c37 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:41.957851 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1082/2160] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:46:41 2022] PUT /identity/v3/projects/11b4177b44ed4c97b4ea1f211f6d721a/users/502198ca408149579e319d758f116998/roles/0c67797d444d4c929b2ccab47c468848 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:41.969910 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95d54f-e5fb-4712-beab-35d21d7f6288 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:41.970244 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95d54f-e5fb-4712-beab-35d21d7f6288 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:41.970522 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95d54f-e5fb-4712-beab-35d21d7f6288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:42.002878 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-cb95d54f-e5fb-4712-beab-35d21d7f6288 None None] MFA Rules not processed for user `502198ca408149579e319d758f116998`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:42.002878 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-cb95d54f-e5fb-4712-beab-35d21d7f6288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:42.100827 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1079/2161] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:46:42.109524 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f70cf8-c564-4980-87da-feed8f929c37 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:42.111316 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-e0f70cf8-c564-4980-87da-feed8f929c37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:42.191726 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f70cf8-c564-4980-87da-feed8f929c37 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:42.196773 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7337ed-cc04-4956-a3e6-d0ea57bc9a26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:42.197412 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7337ed-cc04-4956-a3e6-d0ea57bc9a26 service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:42.197690 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7337ed-cc04-4956-a3e6-d0ea57bc9a26 service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:42.197959 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7337ed-cc04-4956-a3e6-d0ea57bc9a26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:42.211899 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7337ed-cc04-4956-a3e6-d0ea57bc9a26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:42.218730 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7337ed-cc04-4956-a3e6-d0ea57bc9a26 service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:42.230358 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1083/2162] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:46:42 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:46:42.876955 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb95d54f-e5fb-4712-beab-35d21d7f6288 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:42.878796 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-cb95d54f-e5fb-4712-beab-35d21d7f6288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:42.899462 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb95d54f-e5fb-4712-beab-35d21d7f6288 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:42.904056 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a5715-6869-49b3-bd96-5ed16dafac25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:42.904876 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a5715-6869-49b3-bd96-5ed16dafac25 service cinder] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:42.905431 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a5715-6869-49b3-bd96-5ed16dafac25 service cinder] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:42.905721 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a5715-6869-49b3-bd96-5ed16dafac25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:42.908035 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-728a5715-6869-49b3-bd96-5ed16dafac25 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:42.956427 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:43.026420 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728a5715-6869-49b3-bd96-5ed16dafac25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:43.027883 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728a5715-6869-49b3-bd96-5ed16dafac25 service cinder] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:43.042163 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1080/2163] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:46:42 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:46:44.028003 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7337ed-cc04-4956-a3e6-d0ea57bc9a26 service cinder] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:44.039366 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7337ed-cc04-4956-a3e6-d0ea57bc9a26 service cinder] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:44.045293 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c2bdca-9ecb-4f19-a1ce-9b833a055a71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:44.046391 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2bdca-9ecb-4f19-a1ce-9b833a055a71 service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:44.046391 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2bdca-9ecb-4f19-a1ce-9b833a055a71 service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:44.046606 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2bdca-9ecb-4f19-a1ce-9b833a055a71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:44.048687 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-e3c2bdca-9ecb-4f19-a1ce-9b833a055a71 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:44.257226 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c2bdca-9ecb-4f19-a1ce-9b833a055a71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:44.259226 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c2bdca-9ecb-4f19-a1ce-9b833a055a71 service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:44.287205 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1084/2164] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:46:44 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:46:47.348687 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aceefc4-0c7c-42ab-b884-4c5f2b0fa6f8 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:47.351515 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aceefc4-0c7c-42ab-b884-4c5f2b0fa6f8 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:47.352666 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aceefc4-0c7c-42ab-b884-4c5f2b0fa6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:47.393761 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-2aceefc4-0c7c-42ab-b884-4c5f2b0fa6f8 None None] MFA Rules not processed for user `7b42516e12d346eea1561b745bf724a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:47.395224 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-2aceefc4-0c7c-42ab-b884-4c5f2b0fa6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:47.489500 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1081/2165] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:46:47.506160 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c2bdca-9ecb-4f19-a1ce-9b833a055a71 service cinder] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:47.508319 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-e3c2bdca-9ecb-4f19-a1ce-9b833a055a71 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:47.691616 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c2bdca-9ecb-4f19-a1ce-9b833a055a71 service cinder] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:47.700045 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3051ffe4-2b6e-4ad0-9331-e6b00cb8132a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35441c061e514b1b9341e7694ec2c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:47.700687 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051ffe4-2b6e-4ad0-9331-e6b00cb8132a service nova] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:47.700972 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051ffe4-2b6e-4ad0-9331-e6b00cb8132a service nova] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:47.701245 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051ffe4-2b6e-4ad0-9331-e6b00cb8132a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:47.713890 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3051ffe4-2b6e-4ad0-9331-e6b00cb8132a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:47.715561 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3051ffe4-2b6e-4ad0-9331-e6b00cb8132a service nova] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:47.731023 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1085/2166] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:46:47 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:46:48.833189 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aceefc4-0c7c-42ab-b884-4c5f2b0fa6f8 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:48.835515 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-2aceefc4-0c7c-42ab-b884-4c5f2b0fa6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:48.926059 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aceefc4-0c7c-42ab-b884-4c5f2b0fa6f8 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:48.932251 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddcbee0-1ee4-4722-ac1d-799ee90af335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:48.933073 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddcbee0-1ee4-4722-ac1d-799ee90af335 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:48.933437 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddcbee0-1ee4-4722-ac1d-799ee90af335 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:48.933715 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddcbee0-1ee4-4722-ac1d-799ee90af335 admin admin] PATH_INFO: `/v3/users/c355ccf1b1674d5e81ce7803fade3d8e` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:48.934915 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddcbee0-1ee4-4722-ac1d-799ee90af335 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c355ccf1b1674d5e81ce7803fade3d8e)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:48.936990 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddcbee0-1ee4-4722-ac1d-799ee90af335 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:49.004365 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-fddcbee0-1ee4-4722-ac1d-799ee90af335 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c355ccf1b1674d5e81ce7803fade3d8e'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:49.012419 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-fddcbee0-1ee4-4722-ac1d-799ee90af335 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c355ccf1b1674d5e81ce7803fade3d8e'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:49.013135 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-fddcbee0-1ee4-4722-ac1d-799ee90af335 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c355ccf1b1674d5e81ce7803fade3d8e'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:49.018026 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:49.033611 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-fddcbee0-1ee4-4722-ac1d-799ee90af335 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c355ccf1b1674d5e81ce7803fade3d8e'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:49.042592 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-fddcbee0-1ee4-4722-ac1d-799ee90af335 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c355ccf1b1674d5e81ce7803fade3d8e'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:49.048932 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1082/2167] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:46:48 2022] DELETE /identity/v3/users/c355ccf1b1674d5e81ce7803fade3d8e => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:49.053715 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9e85f-9aa8-4d30-b189-d97968b89326 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:49.054536 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9e85f-9aa8-4d30-b189-d97968b89326 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:49.055002 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9e85f-9aa8-4d30-b189-d97968b89326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:49.075550 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-f1c9e85f-9aa8-4d30-b189-d97968b89326 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:49.076783 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-f1c9e85f-9aa8-4d30-b189-d97968b89326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:49.082638 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:49.171391 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1086/2168] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:46:49.178781 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddcbee0-1ee4-4722-ac1d-799ee90af335 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:49.180715 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-fddcbee0-1ee4-4722-ac1d-799ee90af335 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:49.267041 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddcbee0-1ee4-4722-ac1d-799ee90af335 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:49.271476 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24478ece-1f6a-42de-8cf6-59b8cc06734f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:49.272177 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24478ece-1f6a-42de-8cf6-59b8cc06734f service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:49.272530 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24478ece-1f6a-42de-8cf6-59b8cc06734f service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:49.272871 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24478ece-1f6a-42de-8cf6-59b8cc06734f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:49.285554 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24478ece-1f6a-42de-8cf6-59b8cc06734f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:49.287217 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24478ece-1f6a-42de-8cf6-59b8cc06734f service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:49.298176 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81807fe9-6c39-4356-8511-b874374ab2e1 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:49.298490 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81807fe9-6c39-4356-8511-b874374ab2e1 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:49.298747 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81807fe9-6c39-4356-8511-b874374ab2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:49.299649 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1083/2169] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:46:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:46:49.335718 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-81807fe9-6c39-4356-8511-b874374ab2e1 None None] MFA Rules not processed for user `7b42516e12d346eea1561b745bf724a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:49.337367 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-81807fe9-6c39-4356-8511-b874374ab2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:49.423945 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1087/2170] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:46:49.969225 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24478ece-1f6a-42de-8cf6-59b8cc06734f service neutron] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:49.970789 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-24478ece-1f6a-42de-8cf6-59b8cc06734f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:49.992118 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24478ece-1f6a-42de-8cf6-59b8cc06734f service neutron] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:50.016936 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b6778c-ff92-4c6b-8b4e-c1e6e33843e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:50.017669 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6778c-ff92-4c6b-8b4e-c1e6e33843e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:50.017954 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6778c-ff92-4c6b-8b4e-c1e6e33843e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:50.018241 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6778c-ff92-4c6b-8b4e-c1e6e33843e6 admin admin] PATH_INFO: `/v3/projects/7cf8ffd05e534d2ba275c116b053bc64` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:50.019670 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b6778c-ff92-4c6b-8b4e-c1e6e33843e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cf8ffd05e534d2ba275c116b053bc64)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:50.022982 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b6778c-ff92-4c6b-8b4e-c1e6e33843e6 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:50.166403 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-33b6778c-ff92-4c6b-8b4e-c1e6e33843e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cf8ffd05e534d2ba275c116b053bc64', 'request_id': 'req-33b6778c-ff92-4c6b-8b4e-c1e6e33843e6'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:50.179318 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-33b6778c-ff92-4c6b-8b4e-c1e6e33843e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cf8ffd05e534d2ba275c116b053bc64', 'request_id': 'req-33b6778c-ff92-4c6b-8b4e-c1e6e33843e6'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:50.187214 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-33b6778c-ff92-4c6b-8b4e-c1e6e33843e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cf8ffd05e534d2ba275c116b053bc64', 'request_id': 'req-33b6778c-ff92-4c6b-8b4e-c1e6e33843e6'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:50.224185 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-33b6778c-ff92-4c6b-8b4e-c1e6e33843e6 admin admin] The token cache is being invalidate because project 7cf8ffd05e534d2ba275c116b053bc64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:46:50.227106 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-33b6778c-ff92-4c6b-8b4e-c1e6e33843e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:50.228524 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-33b6778c-ff92-4c6b-8b4e-c1e6e33843e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:50.233844 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1084/2171] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:46:49 2022] DELETE /identity/v3/projects/7cf8ffd05e534d2ba275c116b053bc64 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:50.239033 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81807fe9-6c39-4356-8511-b874374ab2e1 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:50.254974 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81807fe9-6c39-4356-8511-b874374ab2e1 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:50.391139 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e974bba6-94c8-4c07-8770-3aa6abee87b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:50.391801 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974bba6-94c8-4c07-8770-3aa6abee87b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:50.392800 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974bba6-94c8-4c07-8770-3aa6abee87b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:50.392800 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974bba6-94c8-4c07-8770-3aa6abee87b8 admin admin] PATH_INFO: `/v3/users/62e3052698534eefb8508489dd34e148` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:50.395849 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e974bba6-94c8-4c07-8770-3aa6abee87b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62e3052698534eefb8508489dd34e148)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:50.398584 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e974bba6-94c8-4c07-8770-3aa6abee87b8 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:50.476888 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-e974bba6-94c8-4c07-8770-3aa6abee87b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62e3052698534eefb8508489dd34e148'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:50.488825 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-e974bba6-94c8-4c07-8770-3aa6abee87b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62e3052698534eefb8508489dd34e148'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:50.489829 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-e974bba6-94c8-4c07-8770-3aa6abee87b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62e3052698534eefb8508489dd34e148'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:50.495248 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:50.503680 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-e974bba6-94c8-4c07-8770-3aa6abee87b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62e3052698534eefb8508489dd34e148'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:50.505529 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-e974bba6-94c8-4c07-8770-3aa6abee87b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62e3052698534eefb8508489dd34e148'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:50.555888 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1088/2172] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:46:50 2022] DELETE /identity/v3/users/62e3052698534eefb8508489dd34e148 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:51.103413 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b6778c-ff92-4c6b-8b4e-c1e6e33843e6 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:51.105564 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-33b6778c-ff92-4c6b-8b4e-c1e6e33843e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:51.141374 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b6778c-ff92-4c6b-8b4e-c1e6e33843e6 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:51.237692 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eace217-3f22-412b-8f76-0db4be21c51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:51.238465 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eace217-3f22-412b-8f76-0db4be21c51f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:51.238969 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eace217-3f22-412b-8f76-0db4be21c51f admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:51.239419 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eace217-3f22-412b-8f76-0db4be21c51f admin admin] PATH_INFO: `/v3/projects/a215b1b79e88446388040643c99bbf88` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:51.240950 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eace217-3f22-412b-8f76-0db4be21c51f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a215b1b79e88446388040643c99bbf88)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:51.243417 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eace217-3f22-412b-8f76-0db4be21c51f admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:51.251721 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:51.322057 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-9eace217-3f22-412b-8f76-0db4be21c51f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a215b1b79e88446388040643c99bbf88', 'request_id': 'req-9eace217-3f22-412b-8f76-0db4be21c51f'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:51.335453 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-9eace217-3f22-412b-8f76-0db4be21c51f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a215b1b79e88446388040643c99bbf88', 'request_id': 'req-9eace217-3f22-412b-8f76-0db4be21c51f'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:51.347709 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-9eace217-3f22-412b-8f76-0db4be21c51f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a215b1b79e88446388040643c99bbf88', 'request_id': 'req-9eace217-3f22-412b-8f76-0db4be21c51f'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:51.366811 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-9eace217-3f22-412b-8f76-0db4be21c51f admin admin] The token cache is being invalidate because project a215b1b79e88446388040643c99bbf88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:46:51.367131 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-9eace217-3f22-412b-8f76-0db4be21c51f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:51.368120 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-9eace217-3f22-412b-8f76-0db4be21c51f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:51.369910 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1085/2173] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:46:51 2022] DELETE /identity/v3/projects/a215b1b79e88446388040643c99bbf88 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:51.375650 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e974bba6-94c8-4c07-8770-3aa6abee87b8 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:51.377108 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-e974bba6-94c8-4c07-8770-3aa6abee87b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:51.392921 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e974bba6-94c8-4c07-8770-3aa6abee87b8 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:51.476260 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6444c-3fda-4f7f-a487-09c561d5f659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:51.476959 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6444c-3fda-4f7f-a487-09c561d5f659 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:51.477238 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6444c-3fda-4f7f-a487-09c561d5f659 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:51.477549 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6444c-3fda-4f7f-a487-09c561d5f659 admin admin] PATH_INFO: `/v3/users/6af30e05de254c2181ff08a47ede1691` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:51.478706 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc6444c-3fda-4f7f-a487-09c561d5f659 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6af30e05de254c2181ff08a47ede1691)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:51.480652 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc6444c-3fda-4f7f-a487-09c561d5f659 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:51.535951 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-cbc6444c-3fda-4f7f-a487-09c561d5f659 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6af30e05de254c2181ff08a47ede1691'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:51.545151 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-cbc6444c-3fda-4f7f-a487-09c561d5f659 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6af30e05de254c2181ff08a47ede1691'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:51.546395 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-cbc6444c-3fda-4f7f-a487-09c561d5f659 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6af30e05de254c2181ff08a47ede1691'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:51.555007 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-cbc6444c-3fda-4f7f-a487-09c561d5f659 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6af30e05de254c2181ff08a47ede1691'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:51.556180 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-cbc6444c-3fda-4f7f-a487-09c561d5f659 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6af30e05de254c2181ff08a47ede1691'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:51.585561 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1089/2174] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:46:51 2022] DELETE /identity/v3/users/6af30e05de254c2181ff08a47ede1691 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:51.930415 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eace217-3f22-412b-8f76-0db4be21c51f admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:51.931863 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-9eace217-3f22-412b-8f76-0db4be21c51f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:52.065059 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eace217-3f22-412b-8f76-0db4be21c51f admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:52.087588 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6444c-3fda-4f7f-a487-09c561d5f659 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:52.089915 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-cbc6444c-3fda-4f7f-a487-09c561d5f659 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:52.232658 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f50c80-6145-4ce9-9469-467a7adc5893 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:52.233385 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f50c80-6145-4ce9-9469-467a7adc5893 service cinder] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:52.233987 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f50c80-6145-4ce9-9469-467a7adc5893 service cinder] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:52.234413 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f50c80-6145-4ce9-9469-467a7adc5893 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:52.236548 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-02f50c80-6145-4ce9-9469-467a7adc5893 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:52.239717 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:52.253996 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6444c-3fda-4f7f-a487-09c561d5f659 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:52.268708 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9936c2-017b-405b-97ce-f405348fda6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:52.269397 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9936c2-017b-405b-97ce-f405348fda6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:52.269678 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9936c2-017b-405b-97ce-f405348fda6d admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:52.269946 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9936c2-017b-405b-97ce-f405348fda6d admin admin] PATH_INFO: `/v3/projects/b6e588778c0b41b2bffac1c09a4f6d4a` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:52.279097 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9936c2-017b-405b-97ce-f405348fda6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6e588778c0b41b2bffac1c09a4f6d4a)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:52.281380 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9936c2-017b-405b-97ce-f405348fda6d admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:52.372370 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f50c80-6145-4ce9-9469-467a7adc5893 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:52.373887 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f50c80-6145-4ce9-9469-467a7adc5893 service cinder] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:52.380302 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:52.389422 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1086/2175] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:46:51 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:46:52.411362 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-4b9936c2-017b-405b-97ce-f405348fda6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6e588778c0b41b2bffac1c09a4f6d4a', 'request_id': 'req-4b9936c2-017b-405b-97ce-f405348fda6d'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:52.435609 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-4b9936c2-017b-405b-97ce-f405348fda6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6e588778c0b41b2bffac1c09a4f6d4a', 'request_id': 'req-4b9936c2-017b-405b-97ce-f405348fda6d'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:52.452021 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-4b9936c2-017b-405b-97ce-f405348fda6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6e588778c0b41b2bffac1c09a4f6d4a', 'request_id': 'req-4b9936c2-017b-405b-97ce-f405348fda6d'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:52.480810 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-4b9936c2-017b-405b-97ce-f405348fda6d admin admin] The token cache is being invalidate because project b6e588778c0b41b2bffac1c09a4f6d4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:46:52.481529 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-4b9936c2-017b-405b-97ce-f405348fda6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:52.482157 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-4b9936c2-017b-405b-97ce-f405348fda6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:52.484020 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1090/2176] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:46:52 2022] DELETE /identity/v3/projects/b6e588778c0b41b2bffac1c09a4f6d4a => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:56.484059 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f50c80-6145-4ce9-9469-467a7adc5893 service cinder] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:56.485562 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-02f50c80-6145-4ce9-9469-467a7adc5893 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:56.499074 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f50c80-6145-4ce9-9469-467a7adc5893 service cinder] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:56.561075 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da24109c-36ad-4fd3-91d5-2fc3be02c04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:56.561748 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24109c-36ad-4fd3-91d5-2fc3be02c04e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:56.562032 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24109c-36ad-4fd3-91d5-2fc3be02c04e admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:56.562309 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24109c-36ad-4fd3-91d5-2fc3be02c04e admin admin] PATH_INFO: `/v3/users/502198ca408149579e319d758f116998` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:56.563479 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da24109c-36ad-4fd3-91d5-2fc3be02c04e admin admin] RBAC: Authorizing `identity:delete_user(user_id=502198ca408149579e319d758f116998)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:56.565500 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da24109c-36ad-4fd3-91d5-2fc3be02c04e admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:56.626365 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-da24109c-36ad-4fd3-91d5-2fc3be02c04e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '502198ca408149579e319d758f116998'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:56.635843 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-da24109c-36ad-4fd3-91d5-2fc3be02c04e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '502198ca408149579e319d758f116998'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:56.636680 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-da24109c-36ad-4fd3-91d5-2fc3be02c04e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '502198ca408149579e319d758f116998'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:56.653580 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-da24109c-36ad-4fd3-91d5-2fc3be02c04e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '502198ca408149579e319d758f116998'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:56.662152 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-da24109c-36ad-4fd3-91d5-2fc3be02c04e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '502198ca408149579e319d758f116998'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:56.673481 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1087/2177] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:46:56 2022] DELETE /identity/v3/users/502198ca408149579e319d758f116998 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:56.675081 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c70a863-7605-4cfe-b1f3-9451adc51d5b None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:56.675546 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c70a863-7605-4cfe-b1f3-9451adc51d5b None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:56.675645 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c70a863-7605-4cfe-b1f3-9451adc51d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:56.702687 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-9c70a863-7605-4cfe-b1f3-9451adc51d5b None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:56.704203 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-9c70a863-7605-4cfe-b1f3-9451adc51d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:56.773754 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1091/2178] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:46:56.783836 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da24109c-36ad-4fd3-91d5-2fc3be02c04e admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:56.785273 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-da24109c-36ad-4fd3-91d5-2fc3be02c04e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:56.848046 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da24109c-36ad-4fd3-91d5-2fc3be02c04e admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:56.852011 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a98b34-d62e-4671-b578-e80ca99a0e1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:56.852703 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a98b34-d62e-4671-b578-e80ca99a0e1a service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:56.853079 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a98b34-d62e-4671-b578-e80ca99a0e1a service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:56.853452 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a98b34-d62e-4671-b578-e80ca99a0e1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:56.862933 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a98b34-d62e-4671-b578-e80ca99a0e1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:56.864360 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a98b34-d62e-4671-b578-e80ca99a0e1a service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:56.874572 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1088/2179] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:46:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:46:57.251168 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c70a863-7605-4cfe-b1f3-9451adc51d5b None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:57.252864 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-9c70a863-7605-4cfe-b1f3-9451adc51d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:57.268349 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c70a863-7605-4cfe-b1f3-9451adc51d5b None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:57.279946 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb2ad68-629a-432f-8d1c-025fc403fd44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:57.280608 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2ad68-629a-432f-8d1c-025fc403fd44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:57.280890 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2ad68-629a-432f-8d1c-025fc403fd44 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:57.281590 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2ad68-629a-432f-8d1c-025fc403fd44 admin admin] PATH_INFO: `/v3/projects/11b4177b44ed4c97b4ea1f211f6d721a` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:57.282564 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb2ad68-629a-432f-8d1c-025fc403fd44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11b4177b44ed4c97b4ea1f211f6d721a)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:57.284862 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb2ad68-629a-432f-8d1c-025fc403fd44 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:57.344770 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-0bb2ad68-629a-432f-8d1c-025fc403fd44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11b4177b44ed4c97b4ea1f211f6d721a', 'request_id': 'req-0bb2ad68-629a-432f-8d1c-025fc403fd44'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:57.352315 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-0bb2ad68-629a-432f-8d1c-025fc403fd44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11b4177b44ed4c97b4ea1f211f6d721a', 'request_id': 'req-0bb2ad68-629a-432f-8d1c-025fc403fd44'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:57.358006 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-0bb2ad68-629a-432f-8d1c-025fc403fd44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11b4177b44ed4c97b4ea1f211f6d721a', 'request_id': 'req-0bb2ad68-629a-432f-8d1c-025fc403fd44'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:57.370908 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-0bb2ad68-629a-432f-8d1c-025fc403fd44 admin admin] The token cache is being invalidate because project 11b4177b44ed4c97b4ea1f211f6d721a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:46:57.371195 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-0bb2ad68-629a-432f-8d1c-025fc403fd44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:57.371824 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-0bb2ad68-629a-432f-8d1c-025fc403fd44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:46:57.373313 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1092/2180] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:46:57 2022] DELETE /identity/v3/projects/11b4177b44ed4c97b4ea1f211f6d721a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:57.378288 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b592755b-3c29-455a-b0f7-13d1e1fc0015 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:57.378610 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b592755b-3c29-455a-b0f7-13d1e1fc0015 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:57.378892 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b592755b-3c29-455a-b0f7-13d1e1fc0015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:57.399151 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-b592755b-3c29-455a-b0f7-13d1e1fc0015 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:57.400373 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-b592755b-3c29-455a-b0f7-13d1e1fc0015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:57.418940 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:57.463683 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1089/2181] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:46:57.472515 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad39034-2625-47d1-99a7-0901759cfbfa None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:57.472802 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad39034-2625-47d1-99a7-0901759cfbfa None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:57.473075 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad39034-2625-47d1-99a7-0901759cfbfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:57.495800 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-2ad39034-2625-47d1-99a7-0901759cfbfa None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:57.497024 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-2ad39034-2625-47d1-99a7-0901759cfbfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:57.504852 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1093/2182] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:46:57.510176 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b592755b-3c29-455a-b0f7-13d1e1fc0015 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:57.519873 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b592755b-3c29-455a-b0f7-13d1e1fc0015 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:57.524803 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bcbaa7-03be-43fc-8806-747e20c4872a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:57.525440 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bcbaa7-03be-43fc-8806-747e20c4872a admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:57.525718 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bcbaa7-03be-43fc-8806-747e20c4872a admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:57.525989 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bcbaa7-03be-43fc-8806-747e20c4872a admin admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:57.526633 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bcbaa7-03be-43fc-8806-747e20c4872a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:46:57.526935 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bcbaa7-03be-43fc-8806-747e20c4872a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:57.528524 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bcbaa7-03be-43fc-8806-747e20c4872a admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:57.540260 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1090/2183] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Aug 29 22:46:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:46:57.545619 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad39034-2625-47d1-99a7-0901759cfbfa None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:57.551661 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:57.558961 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad39034-2625-47d1-99a7-0901759cfbfa None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:57.564685 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b3b12-fa12-4606-860d-aaf19518b17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:57.565290 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b3b12-fa12-4606-860d-aaf19518b17a admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:57.565612 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b3b12-fa12-4606-860d-aaf19518b17a admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:57.565886 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b3b12-fa12-4606-860d-aaf19518b17a admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:57.566523 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7b3b12-fa12-4606-860d-aaf19518b17a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:57.569159 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7b3b12-fa12-4606-860d-aaf19518b17a admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:57.596260 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1094/2184] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:46:57 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:46:57.600479 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bcbaa7-03be-43fc-8806-747e20c4872a admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:57.610848 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bcbaa7-03be-43fc-8806-747e20c4872a admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:57.673060 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1427aff3-2859-4a1c-b3cd-c7db4defb560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:57.673690 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1427aff3-2859-4a1c-b3cd-c7db4defb560 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:57.673968 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1427aff3-2859-4a1c-b3cd-c7db4defb560 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:57.674309 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1427aff3-2859-4a1c-b3cd-c7db4defb560 admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:57.674928 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1427aff3-2859-4a1c-b3cd-c7db4defb560 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:57.676842 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1427aff3-2859-4a1c-b3cd-c7db4defb560 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:57.697766 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1091/2185] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:46:57 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:46:57.701982 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b3b12-fa12-4606-860d-aaf19518b17a admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:57.713257 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b3b12-fa12-4606-860d-aaf19518b17a admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:57.717971 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db2da5c-9b1c-4198-85fe-f47b4194039e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:57.718566 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2da5c-9b1c-4198-85fe-f47b4194039e admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:57.718873 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2da5c-9b1c-4198-85fe-f47b4194039e admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:57.719161 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2da5c-9b1c-4198-85fe-f47b4194039e admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:57.719806 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db2da5c-9b1c-4198-85fe-f47b4194039e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:57.721439 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db2da5c-9b1c-4198-85fe-f47b4194039e admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:57.732049 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1095/2186] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:46:57.735903 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1427aff3-2859-4a1c-b3cd-c7db4defb560 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:57.746081 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1427aff3-2859-4a1c-b3cd-c7db4defb560 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:57.750697 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6c3c88-02e5-4028-9964-cfc42b980b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:57.751393 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c3c88-02e5-4028-9964-cfc42b980b03 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:57.751569 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c3c88-02e5-4028-9964-cfc42b980b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:57.751868 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c3c88-02e5-4028-9964-cfc42b980b03 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:57.752579 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6c3c88-02e5-4028-9964-cfc42b980b03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:57.754257 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6c3c88-02e5-4028-9964-cfc42b980b03 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:57.765627 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1092/2187] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:46:57.770477 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db2da5c-9b1c-4198-85fe-f47b4194039e admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:57.782275 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db2da5c-9b1c-4198-85fe-f47b4194039e admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:57.787349 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d8d30c-d656-46f3-a563-83b6b54cdcbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:57.788136 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8d30c-d656-46f3-a563-83b6b54cdcbe admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:57.788421 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8d30c-d656-46f3-a563-83b6b54cdcbe admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:57.788701 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8d30c-d656-46f3-a563-83b6b54cdcbe admin admin] PATH_INFO: `/v3/projects/74aca0ada82a483e897dd8c96191aa17/users/2f00f45ee3074f7d99140cb34b7f9a11/roles/0c67797d444d4c929b2ccab47c468848` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:57.803717 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d8d30c-d656-46f3-a563-83b6b54cdcbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=74aca0ada82a483e897dd8c96191aa17, user_id=2f00f45ee3074f7d99140cb34b7f9a11, role_id=0c67797d444d4c929b2ccab47c468848)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:57.806461 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d8d30c-d656-46f3-a563-83b6b54cdcbe admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:57.822002 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1096/2188] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:46:57 2022] PUT /identity/v3/projects/74aca0ada82a483e897dd8c96191aa17/users/2f00f45ee3074f7d99140cb34b7f9a11/roles/0c67797d444d4c929b2ccab47c468848 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:57.832274 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f9e67-d967-422d-9b11-0ffc6979ecf7 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:57.832563 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f9e67-d967-422d-9b11-0ffc6979ecf7 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:57.832835 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f9e67-d967-422d-9b11-0ffc6979ecf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:57.862669 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-eb1f9e67-d967-422d-9b11-0ffc6979ecf7 None None] MFA Rules not processed for user `2f00f45ee3074f7d99140cb34b7f9a11`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:57.863460 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-eb1f9e67-d967-422d-9b11-0ffc6979ecf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:57.932936 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1093/2189] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:46:57.937281 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d8d30c-d656-46f3-a563-83b6b54cdcbe admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:57.999029 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d8d30c-d656-46f3-a563-83b6b54cdcbe admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:58.004546 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07c73d1-9f94-446d-9cc3-f0e3b82bb711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:58.005152 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c73d1-9f94-446d-9cc3-f0e3b82bb711 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:58.005462 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c73d1-9f94-446d-9cc3-f0e3b82bb711 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:58.005737 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c73d1-9f94-446d-9cc3-f0e3b82bb711 admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:58.007046 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07c73d1-9f94-446d-9cc3-f0e3b82bb711 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:58.009079 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07c73d1-9f94-446d-9cc3-f0e3b82bb711 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:58.036232 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1097/2190] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:46:57 2022] POST /identity/v3/projects => generated 383 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:46:58.040350 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f9e67-d967-422d-9b11-0ffc6979ecf7 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:58.051412 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f9e67-d967-422d-9b11-0ffc6979ecf7 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:58.063763 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:58.112801 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61fa07f-afd3-413a-a833-7353e942bb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:58.113457 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61fa07f-afd3-413a-a833-7353e942bb79 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:58.113742 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61fa07f-afd3-413a-a833-7353e942bb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:58.114016 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61fa07f-afd3-413a-a833-7353e942bb79 admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:58.114654 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61fa07f-afd3-413a-a833-7353e942bb79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:58.117577 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61fa07f-afd3-413a-a833-7353e942bb79 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:58.142494 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1094/2191] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:46:58 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:46:58.148663 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07c73d1-9f94-446d-9cc3-f0e3b82bb711 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:58.163175 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07c73d1-9f94-446d-9cc3-f0e3b82bb711 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:58.168075 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4be36-b1a2-45dc-a4fc-72d0da25e5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:58.168686 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4be36-b1a2-45dc-a4fc-72d0da25e5a9 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:58.169119 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4be36-b1a2-45dc-a4fc-72d0da25e5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:58.169439 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4be36-b1a2-45dc-a4fc-72d0da25e5a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:58.170091 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e4be36-b1a2-45dc-a4fc-72d0da25e5a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:58.171698 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e4be36-b1a2-45dc-a4fc-72d0da25e5a9 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:58.183145 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1098/2192] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:46:58 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:46:58.187100 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61fa07f-afd3-413a-a833-7353e942bb79 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:58.197963 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61fa07f-afd3-413a-a833-7353e942bb79 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:58.202853 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd7d26-730f-4c90-b8b4-f7934a415517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:58.203460 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd7d26-730f-4c90-b8b4-f7934a415517 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:58.203741 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd7d26-730f-4c90-b8b4-f7934a415517 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:58.204012 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd7d26-730f-4c90-b8b4-f7934a415517 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:58.204726 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cd7d26-730f-4c90-b8b4-f7934a415517 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:58.206324 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cd7d26-730f-4c90-b8b4-f7934a415517 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:58.217652 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1095/2193] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:46:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:46:58.222013 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4be36-b1a2-45dc-a4fc-72d0da25e5a9 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:58.236379 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4be36-b1a2-45dc-a4fc-72d0da25e5a9 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:58.242488 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a8dbc4-477c-4464-b58a-7580886cd032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:58.243673 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8dbc4-477c-4464-b58a-7580886cd032 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:58.243673 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8dbc4-477c-4464-b58a-7580886cd032 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:58.243897 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8dbc4-477c-4464-b58a-7580886cd032 admin admin] PATH_INFO: `/v3/projects/cd5b3d311e1c414cbf3e8f0575060bae/users/7752a41ad3ac4f489cda97afd13edeb3/roles/0c67797d444d4c929b2ccab47c468848` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:58.260417 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a8dbc4-477c-4464-b58a-7580886cd032 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd5b3d311e1c414cbf3e8f0575060bae, user_id=7752a41ad3ac4f489cda97afd13edeb3, role_id=0c67797d444d4c929b2ccab47c468848)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:58.263817 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a8dbc4-477c-4464-b58a-7580886cd032 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:58.280293 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1099/2194] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:46:58 2022] PUT /identity/v3/projects/cd5b3d311e1c414cbf3e8f0575060bae/users/7752a41ad3ac4f489cda97afd13edeb3/roles/0c67797d444d4c929b2ccab47c468848 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:58.291705 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc93e82-bdfc-4868-a9b1-cd5ed71f056f None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:58.291996 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc93e82-bdfc-4868-a9b1-cd5ed71f056f None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:58.292275 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc93e82-bdfc-4868-a9b1-cd5ed71f056f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:58.322503 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-8dc93e82-bdfc-4868-a9b1-cd5ed71f056f None None] MFA Rules not processed for user `7752a41ad3ac4f489cda97afd13edeb3`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:58.323831 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-8dc93e82-bdfc-4868-a9b1-cd5ed71f056f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:58.396894 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1096/2195] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:46:58.401848 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a8dbc4-477c-4464-b58a-7580886cd032 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:58.477438 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:58.483770 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a8dbc4-477c-4464-b58a-7580886cd032 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:58.488894 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2772dfca-9ff9-46a1-bff8-9d1e11b3c196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:58.489635 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2772dfca-9ff9-46a1-bff8-9d1e11b3c196 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:58.489981 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2772dfca-9ff9-46a1-bff8-9d1e11b3c196 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:58.490359 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2772dfca-9ff9-46a1-bff8-9d1e11b3c196 admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:58.491449 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2772dfca-9ff9-46a1-bff8-9d1e11b3c196 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:58.493523 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2772dfca-9ff9-46a1-bff8-9d1e11b3c196 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:58.521393 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1100/2196] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:46:58 2022] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:46:58.526790 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc93e82-bdfc-4868-a9b1-cd5ed71f056f None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:58.540119 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc93e82-bdfc-4868-a9b1-cd5ed71f056f None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:58.606901 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb8bdb-edbb-4862-ad69-ca8878ad860d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:58.607525 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb8bdb-edbb-4862-ad69-ca8878ad860d admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:58.607806 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb8bdb-edbb-4862-ad69-ca8878ad860d admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:58.608077 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb8bdb-edbb-4862-ad69-ca8878ad860d admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:58.608888 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbb8bdb-edbb-4862-ad69-ca8878ad860d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:58.610876 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbb8bdb-edbb-4862-ad69-ca8878ad860d admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:58.636564 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1097/2197] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:46:58 2022] POST /identity/v3/users => generated 299 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:46:58.640669 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2772dfca-9ff9-46a1-bff8-9d1e11b3c196 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:58.652353 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2772dfca-9ff9-46a1-bff8-9d1e11b3c196 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:58.657023 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92d7a08-515c-4bb7-ab8c-fdc02e789ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:58.657653 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d7a08-515c-4bb7-ab8c-fdc02e789ada admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:58.657931 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d7a08-515c-4bb7-ab8c-fdc02e789ada admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:58.658202 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d7a08-515c-4bb7-ab8c-fdc02e789ada admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:58.659096 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92d7a08-515c-4bb7-ab8c-fdc02e789ada admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:58.660840 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92d7a08-515c-4bb7-ab8c-fdc02e789ada admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:58.672869 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1101/2198] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:46:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:46:58.677177 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb8bdb-edbb-4862-ad69-ca8878ad860d admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:58.688488 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb8bdb-edbb-4862-ad69-ca8878ad860d admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:58.694181 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e8e085-1f6b-475f-8ba0-7fccdba7d4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:58.695349 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e8e085-1f6b-475f-8ba0-7fccdba7d4dd admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:58.695349 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e8e085-1f6b-475f-8ba0-7fccdba7d4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:58.695713 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e8e085-1f6b-475f-8ba0-7fccdba7d4dd admin admin] PATH_INFO: `/v3/projects/1ac7821db1aa434a9cc4cf4551cf7c8d/users/0e2ff0eee55d49edad0069228506f096/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:58.712743 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:58.716401 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e8e085-1f6b-475f-8ba0-7fccdba7d4dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ac7821db1aa434a9cc4cf4551cf7c8d, user_id=0e2ff0eee55d49edad0069228506f096, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:58.719378 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e8e085-1f6b-475f-8ba0-7fccdba7d4dd admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:58.736369 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1098/2199] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:46:58 2022] PUT /identity/v3/projects/1ac7821db1aa434a9cc4cf4551cf7c8d/users/0e2ff0eee55d49edad0069228506f096/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:46:58.737919 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92d7a08-515c-4bb7-ab8c-fdc02e789ada admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:58.751082 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92d7a08-515c-4bb7-ab8c-fdc02e789ada admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:58.816407 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6099290-e8b1-4b17-b0c7-83c735d0211e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:58.817138 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6099290-e8b1-4b17-b0c7-83c735d0211e admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:58.817474 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6099290-e8b1-4b17-b0c7-83c735d0211e admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:58.817752 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6099290-e8b1-4b17-b0c7-83c735d0211e admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:58.819085 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6099290-e8b1-4b17-b0c7-83c735d0211e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:58.820771 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6099290-e8b1-4b17-b0c7-83c735d0211e admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:58.833362 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1102/2200] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:46:58 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:46:58.836389 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e8e085-1f6b-475f-8ba0-7fccdba7d4dd admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:58.847014 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e8e085-1f6b-475f-8ba0-7fccdba7d4dd admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:58.852640 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87825e37-add0-4eee-89ef-cc48d38cb560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:58.853537 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87825e37-add0-4eee-89ef-cc48d38cb560 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:58.853880 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87825e37-add0-4eee-89ef-cc48d38cb560 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:58.854220 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87825e37-add0-4eee-89ef-cc48d38cb560 admin admin] PATH_INFO: `/v3/projects/1ac7821db1aa434a9cc4cf4551cf7c8d/users/0e2ff0eee55d49edad0069228506f096/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:58.856253 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87825e37-add0-4eee-89ef-cc48d38cb560 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ac7821db1aa434a9cc4cf4551cf7c8d, user_id=0e2ff0eee55d49edad0069228506f096, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:58.859038 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87825e37-add0-4eee-89ef-cc48d38cb560 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:58.871227 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1099/2201] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:46:58 2022] PUT /identity/v3/projects/1ac7821db1aa434a9cc4cf4551cf7c8d/users/0e2ff0eee55d49edad0069228506f096/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:46:58.882712 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c43032-fa27-4f4a-8fa0-356e03d276d2 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:58.882994 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c43032-fa27-4f4a-8fa0-356e03d276d2 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:58.883261 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c43032-fa27-4f4a-8fa0-356e03d276d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:58.910974 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-d8c43032-fa27-4f4a-8fa0-356e03d276d2 None None] MFA Rules not processed for user `0e2ff0eee55d49edad0069228506f096`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:46:58.912224 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-d8c43032-fa27-4f4a-8fa0-356e03d276d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:58.983237 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1103/2202] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:46:58 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:46:58.995899 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87825e37-add0-4eee-89ef-cc48d38cb560 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:46:58.997655 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-87825e37-add0-4eee-89ef-cc48d38cb560 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:46:59.057267 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87825e37-add0-4eee-89ef-cc48d38cb560 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:46:59.060981 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68a05c9-c92a-464a-9555-cbfea2be0177 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:46:59.061670 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a05c9-c92a-464a-9555-cbfea2be0177 service cinder] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:46:59.061951 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a05c9-c92a-464a-9555-cbfea2be0177 service cinder] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:46:59.062226 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a05c9-c92a-464a-9555-cbfea2be0177 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:46:59.120741 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68a05c9-c92a-464a-9555-cbfea2be0177 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:46:59.122220 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68a05c9-c92a-464a-9555-cbfea2be0177 service cinder] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:46:59.133372 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1100/2203] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:46:58 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:47:00.756895 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c43032-fa27-4f4a-8fa0-356e03d276d2 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:47:00.766641 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c43032-fa27-4f4a-8fa0-356e03d276d2 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:47:00.770661 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b7f919-4507-420c-9e84-bf926e102814 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:47:00.771275 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b7f919-4507-420c-9e84-bf926e102814 service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:00.771591 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b7f919-4507-420c-9e84-bf926e102814 service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:00.771870 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b7f919-4507-420c-9e84-bf926e102814 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:00.841064 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:47:00.856028 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b7f919-4507-420c-9e84-bf926e102814 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:47:00.857534 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b7f919-4507-420c-9e84-bf926e102814 service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:47:00.868816 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1104/2204] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:47:00 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:47:01.473221 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68a05c9-c92a-464a-9555-cbfea2be0177 service cinder] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:47:01.482632 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68a05c9-c92a-464a-9555-cbfea2be0177 service cinder] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:47:01.486325 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7eee3e-1183-402a-b561-b06462629898 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:47:01.486919 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7eee3e-1183-402a-b561-b06462629898 service cinder] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:01.487215 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7eee3e-1183-402a-b561-b06462629898 service cinder] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:01.487504 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7eee3e-1183-402a-b561-b06462629898 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:01.497076 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7eee3e-1183-402a-b561-b06462629898 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:47:01.498466 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7eee3e-1183-402a-b561-b06462629898 service cinder] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:47:01.507834 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1101/2205] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:47:01 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:47:05.661852 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b7f919-4507-420c-9e84-bf926e102814 service cinder] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:47:05.729316 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b7f919-4507-420c-9e84-bf926e102814 service cinder] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:47:05.734100 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887824cb-af63-4af1-a0d3-df7bf1699a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:47:05.734731 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887824cb-af63-4af1-a0d3-df7bf1699a54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:05.735013 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887824cb-af63-4af1-a0d3-df7bf1699a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:05.735289 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887824cb-af63-4af1-a0d3-df7bf1699a54 admin admin] PATH_INFO: `/v3/users/2f00f45ee3074f7d99140cb34b7f9a11` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:05.736421 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887824cb-af63-4af1-a0d3-df7bf1699a54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f00f45ee3074f7d99140cb34b7f9a11)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:47:05.738404 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887824cb-af63-4af1-a0d3-df7bf1699a54 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:47:05.788912 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-887824cb-af63-4af1-a0d3-df7bf1699a54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f00f45ee3074f7d99140cb34b7f9a11'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:05.796227 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-887824cb-af63-4af1-a0d3-df7bf1699a54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f00f45ee3074f7d99140cb34b7f9a11'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:05.797196 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-887824cb-af63-4af1-a0d3-df7bf1699a54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f00f45ee3074f7d99140cb34b7f9a11'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:05.807299 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-887824cb-af63-4af1-a0d3-df7bf1699a54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f00f45ee3074f7d99140cb34b7f9a11'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:05.807938 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-887824cb-af63-4af1-a0d3-df7bf1699a54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f00f45ee3074f7d99140cb34b7f9a11'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:05.832144 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1105/2206] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:47:05 2022] DELETE /identity/v3/users/2f00f45ee3074f7d99140cb34b7f9a11 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:47:05.836833 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79062c-c300-4c93-be08-501b388f3ac6 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:05.837415 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79062c-c300-4c93-be08-501b388f3ac6 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:05.837415 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79062c-c300-4c93-be08-501b388f3ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:05.858025 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-3f79062c-c300-4c93-be08-501b388f3ac6 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:47:05.859213 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-3f79062c-c300-4c93-be08-501b388f3ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:47:05.922577 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1102/2207] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:47:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:47:05.932922 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887824cb-af63-4af1-a0d3-df7bf1699a54 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:47:05.934395 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-887824cb-af63-4af1-a0d3-df7bf1699a54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:47:05.996100 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887824cb-af63-4af1-a0d3-df7bf1699a54 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:47:05.999976 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c850a-0465-48ef-8e7e-f1dbcb2744e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:47:06.000658 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c850a-0465-48ef-8e7e-f1dbcb2744e1 service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:06.001013 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c850a-0465-48ef-8e7e-f1dbcb2744e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:06.001393 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c850a-0465-48ef-8e7e-f1dbcb2744e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:06.011206 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9c850a-0465-48ef-8e7e-f1dbcb2744e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:47:06.012674 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9c850a-0465-48ef-8e7e-f1dbcb2744e1 service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:47:06.023716 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1106/2208] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:47:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:47:06.389150 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f79062c-c300-4c93-be08-501b388f3ac6 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:47:06.390773 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-3f79062c-c300-4c93-be08-501b388f3ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:47:06.404974 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f79062c-c300-4c93-be08-501b388f3ac6 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:47:06.409855 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e3ab39-2e1a-4a9e-b4df-05167f76a4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:47:06.410500 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e3ab39-2e1a-4a9e-b4df-05167f76a4d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:06.410781 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e3ab39-2e1a-4a9e-b4df-05167f76a4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:06.411488 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e3ab39-2e1a-4a9e-b4df-05167f76a4d1 admin admin] PATH_INFO: `/v3/projects/74aca0ada82a483e897dd8c96191aa17` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:06.412437 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e3ab39-2e1a-4a9e-b4df-05167f76a4d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74aca0ada82a483e897dd8c96191aa17)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:47:06.415257 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e3ab39-2e1a-4a9e-b4df-05167f76a4d1 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:47:06.432780 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:47:06.465739 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-e3e3ab39-2e1a-4a9e-b4df-05167f76a4d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74aca0ada82a483e897dd8c96191aa17', 'request_id': 'req-e3e3ab39-2e1a-4a9e-b4df-05167f76a4d1'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:06.472073 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-e3e3ab39-2e1a-4a9e-b4df-05167f76a4d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74aca0ada82a483e897dd8c96191aa17', 'request_id': 'req-e3e3ab39-2e1a-4a9e-b4df-05167f76a4d1'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:06.478944 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-e3e3ab39-2e1a-4a9e-b4df-05167f76a4d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74aca0ada82a483e897dd8c96191aa17', 'request_id': 'req-e3e3ab39-2e1a-4a9e-b4df-05167f76a4d1'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:06.490830 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-e3e3ab39-2e1a-4a9e-b4df-05167f76a4d1 admin admin] The token cache is being invalidate because project 74aca0ada82a483e897dd8c96191aa17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:47:06.491733 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-e3e3ab39-2e1a-4a9e-b4df-05167f76a4d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:06.491733 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-e3e3ab39-2e1a-4a9e-b4df-05167f76a4d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:06.493230 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1103/2209] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:47:06 2022] DELETE /identity/v3/projects/74aca0ada82a483e897dd8c96191aa17 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:47:06.497196 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c850a-0465-48ef-8e7e-f1dbcb2744e1 service neutron] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:47:06.507128 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c850a-0465-48ef-8e7e-f1dbcb2744e1 service neutron] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:47:06.514785 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:47:06.567034 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c502c9-a8e8-4f6f-a43c-77146348efe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:47:06.567711 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c502c9-a8e8-4f6f-a43c-77146348efe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:06.568034 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c502c9-a8e8-4f6f-a43c-77146348efe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:06.568309 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c502c9-a8e8-4f6f-a43c-77146348efe4 admin admin] PATH_INFO: `/v3/users/7752a41ad3ac4f489cda97afd13edeb3` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:06.569805 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c502c9-a8e8-4f6f-a43c-77146348efe4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7752a41ad3ac4f489cda97afd13edeb3)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:47:06.571939 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c502c9-a8e8-4f6f-a43c-77146348efe4 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:47:06.622464 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-e8c502c9-a8e8-4f6f-a43c-77146348efe4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7752a41ad3ac4f489cda97afd13edeb3'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:06.629814 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-e8c502c9-a8e8-4f6f-a43c-77146348efe4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7752a41ad3ac4f489cda97afd13edeb3'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:06.630608 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-e8c502c9-a8e8-4f6f-a43c-77146348efe4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7752a41ad3ac4f489cda97afd13edeb3'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:06.638290 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-e8c502c9-a8e8-4f6f-a43c-77146348efe4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7752a41ad3ac4f489cda97afd13edeb3'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:06.639061 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-e8c502c9-a8e8-4f6f-a43c-77146348efe4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7752a41ad3ac4f489cda97afd13edeb3'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:06.663155 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1107/2210] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:47:06 2022] DELETE /identity/v3/users/7752a41ad3ac4f489cda97afd13edeb3 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:47:06.992565 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e3ab39-2e1a-4a9e-b4df-05167f76a4d1 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:47:06.995012 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-e3e3ab39-2e1a-4a9e-b4df-05167f76a4d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:47:07.021027 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e3ab39-2e1a-4a9e-b4df-05167f76a4d1 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:47:07.086948 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcee121-a841-480e-8475-c78f278daece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:47:07.087629 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcee121-a841-480e-8475-c78f278daece admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:07.087894 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcee121-a841-480e-8475-c78f278daece admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:07.088307 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcee121-a841-480e-8475-c78f278daece admin admin] PATH_INFO: `/v3/projects/cd5b3d311e1c414cbf3e8f0575060bae` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:07.089523 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcee121-a841-480e-8475-c78f278daece admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd5b3d311e1c414cbf3e8f0575060bae)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:47:07.091526 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcee121-a841-480e-8475-c78f278daece admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:47:07.143668 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-3dcee121-a841-480e-8475-c78f278daece admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd5b3d311e1c414cbf3e8f0575060bae', 'request_id': 'req-3dcee121-a841-480e-8475-c78f278daece'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:07.150392 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-3dcee121-a841-480e-8475-c78f278daece admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd5b3d311e1c414cbf3e8f0575060bae', 'request_id': 'req-3dcee121-a841-480e-8475-c78f278daece'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:07.156425 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-3dcee121-a841-480e-8475-c78f278daece admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd5b3d311e1c414cbf3e8f0575060bae', 'request_id': 'req-3dcee121-a841-480e-8475-c78f278daece'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:07.172236 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-3dcee121-a841-480e-8475-c78f278daece admin admin] The token cache is being invalidate because project cd5b3d311e1c414cbf3e8f0575060bae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:47:07.172462 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-3dcee121-a841-480e-8475-c78f278daece admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:07.173115 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-3dcee121-a841-480e-8475-c78f278daece admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:07.174750 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1104/2211] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:47:06 2022] DELETE /identity/v3/projects/cd5b3d311e1c414cbf3e8f0575060bae => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:47:07.179377 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c502c9-a8e8-4f6f-a43c-77146348efe4 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:47:07.180923 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-e8c502c9-a8e8-4f6f-a43c-77146348efe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:47:07.194694 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c502c9-a8e8-4f6f-a43c-77146348efe4 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:47:07.261885 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6800e53b-09b8-420e-ab97-187c1284ba05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:47:07.262730 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800e53b-09b8-420e-ab97-187c1284ba05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:07.263105 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800e53b-09b8-420e-ab97-187c1284ba05 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:07.263479 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800e53b-09b8-420e-ab97-187c1284ba05 admin admin] PATH_INFO: `/v3/users/0e2ff0eee55d49edad0069228506f096` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:07.264747 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6800e53b-09b8-420e-ab97-187c1284ba05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e2ff0eee55d49edad0069228506f096)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:47:07.267129 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6800e53b-09b8-420e-ab97-187c1284ba05 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:47:07.312578 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:47:07.328686 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-6800e53b-09b8-420e-ab97-187c1284ba05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e2ff0eee55d49edad0069228506f096'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:07.340697 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-6800e53b-09b8-420e-ab97-187c1284ba05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e2ff0eee55d49edad0069228506f096'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:07.341510 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-6800e53b-09b8-420e-ab97-187c1284ba05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e2ff0eee55d49edad0069228506f096'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:07.350205 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-6800e53b-09b8-420e-ab97-187c1284ba05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e2ff0eee55d49edad0069228506f096'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:07.353296 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-6800e53b-09b8-420e-ab97-187c1284ba05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e2ff0eee55d49edad0069228506f096'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:07.379726 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1108/2212] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:47:07 2022] DELETE /identity/v3/users/0e2ff0eee55d49edad0069228506f096 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:47:07.700267 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcee121-a841-480e-8475-c78f278daece admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:47:07.701885 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-3dcee121-a841-480e-8475-c78f278daece admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:47:07.715710 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcee121-a841-480e-8475-c78f278daece admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:47:07.750516 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:47:07.783343 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a6f6b1-610e-4f83-a36e-a2ad0a5a0119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:47:07.784148 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6f6b1-610e-4f83-a36e-a2ad0a5a0119 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:07.784496 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6f6b1-610e-4f83-a36e-a2ad0a5a0119 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:07.784725 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6f6b1-610e-4f83-a36e-a2ad0a5a0119 admin admin] PATH_INFO: `/v3/projects/1ac7821db1aa434a9cc4cf4551cf7c8d` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:07.786084 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a6f6b1-610e-4f83-a36e-a2ad0a5a0119 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ac7821db1aa434a9cc4cf4551cf7c8d)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:47:07.788933 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a6f6b1-610e-4f83-a36e-a2ad0a5a0119 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:47:07.842440 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-b3a6f6b1-610e-4f83-a36e-a2ad0a5a0119 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ac7821db1aa434a9cc4cf4551cf7c8d', 'request_id': 'req-b3a6f6b1-610e-4f83-a36e-a2ad0a5a0119'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:07.850513 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-b3a6f6b1-610e-4f83-a36e-a2ad0a5a0119 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ac7821db1aa434a9cc4cf4551cf7c8d', 'request_id': 'req-b3a6f6b1-610e-4f83-a36e-a2ad0a5a0119'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:07.857770 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-b3a6f6b1-610e-4f83-a36e-a2ad0a5a0119 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ac7821db1aa434a9cc4cf4551cf7c8d', 'request_id': 'req-b3a6f6b1-610e-4f83-a36e-a2ad0a5a0119'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:07.872657 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-b3a6f6b1-610e-4f83-a36e-a2ad0a5a0119 admin admin] The token cache is being invalidate because project 1ac7821db1aa434a9cc4cf4551cf7c8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:47:07.872947 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-b3a6f6b1-610e-4f83-a36e-a2ad0a5a0119 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:07.873691 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-b3a6f6b1-610e-4f83-a36e-a2ad0a5a0119 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:07.875553 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1105/2213] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:47:07 2022] DELETE /identity/v3/projects/1ac7821db1aa434a9cc4cf4551cf7c8d => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:47:07.881963 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a19594-4b5c-4230-a8f9-f6cacbf610ff None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:07.882490 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a19594-4b5c-4230-a8f9-f6cacbf610ff None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:07.882730 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a19594-4b5c-4230-a8f9-f6cacbf610ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:07.903542 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-a0a19594-4b5c-4230-a8f9-f6cacbf610ff None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:47:07.904925 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-a0a19594-4b5c-4230-a8f9-f6cacbf610ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:47:07.969772 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1109/2214] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:47:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:47:07.977659 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4fd14-043b-4820-9b40-05a450728032 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:07.977947 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4fd14-043b-4820-9b40-05a450728032 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:07.978224 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4fd14-043b-4820-9b40-05a450728032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:07.999937 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-99f4fd14-043b-4820-9b40-05a450728032 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:47:08.001153 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-99f4fd14-043b-4820-9b40-05a450728032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:47:08.010174 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1106/2215] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:47:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:47:08.015006 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a19594-4b5c-4230-a8f9-f6cacbf610ff None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:47:08.026216 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a19594-4b5c-4230-a8f9-f6cacbf610ff None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:47:08.031284 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e6a49-5fe0-4046-ba50-a10a0a9f00ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:47:08.031959 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e6a49-5fe0-4046-ba50-a10a0a9f00ae admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:08.032307 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e6a49-5fe0-4046-ba50-a10a0a9f00ae admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:08.032668 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e6a49-5fe0-4046-ba50-a10a0a9f00ae admin admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:08.033524 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e6a49-5fe0-4046-ba50-a10a0a9f00ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:47:08.033805 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e6a49-5fe0-4046-ba50-a10a0a9f00ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:47:08.036577 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e6a49-5fe0-4046-ba50-a10a0a9f00ae admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:47:08.048940 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1110/2216] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Aug 29 22:47:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:47:08.054392 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f4fd14-043b-4820-9b40-05a450728032 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:47:08.064779 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f4fd14-043b-4820-9b40-05a450728032 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:47:08.071144 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b2a82-b233-4c0b-915c-5d244278062e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:47:08.071794 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b2a82-b233-4c0b-915c-5d244278062e admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:08.072072 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b2a82-b233-4c0b-915c-5d244278062e admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:08.072348 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b2a82-b233-4c0b-915c-5d244278062e admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:08.073227 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2b2a82-b233-4c0b-915c-5d244278062e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:47:08.075439 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2b2a82-b233-4c0b-915c-5d244278062e admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:47:08.113084 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1107/2217] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:47:08 2022] POST /identity/v3/projects => generated 371 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:47:08.114577 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e6a49-5fe0-4046-ba50-a10a0a9f00ae admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:47:08.128411 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e6a49-5fe0-4046-ba50-a10a0a9f00ae admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:47:08.192162 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed2550-ca46-4519-8d40-0fa3c9021bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:47:08.192780 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed2550-ca46-4519-8d40-0fa3c9021bfa admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:08.193058 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed2550-ca46-4519-8d40-0fa3c9021bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:08.193355 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed2550-ca46-4519-8d40-0fa3c9021bfa admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:08.194667 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ed2550-ca46-4519-8d40-0fa3c9021bfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:47:08.196792 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ed2550-ca46-4519-8d40-0fa3c9021bfa admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:47:08.223375 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1111/2218] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:47:08 2022] POST /identity/v3/users => generated 286 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:47:08.224483 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b2a82-b233-4c0b-915c-5d244278062e admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:47:08.235656 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b2a82-b233-4c0b-915c-5d244278062e admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:47:08.240595 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08d29e2-6ce7-44e6-b2a9-aff8906fe434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:47:08.242486 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d29e2-6ce7-44e6-b2a9-aff8906fe434 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:08.242770 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d29e2-6ce7-44e6-b2a9-aff8906fe434 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:08.243046 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d29e2-6ce7-44e6-b2a9-aff8906fe434 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:08.243693 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08d29e2-6ce7-44e6-b2a9-aff8906fe434 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:47:08.245319 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08d29e2-6ce7-44e6-b2a9-aff8906fe434 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:47:08.257491 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1108/2219] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:47:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:47:08.261561 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed2550-ca46-4519-8d40-0fa3c9021bfa admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:47:08.272708 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed2550-ca46-4519-8d40-0fa3c9021bfa admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:47:08.279102 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c047a11c-a0bb-4455-a0a5-f3bc6d0fc299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:47:08.279775 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047a11c-a0bb-4455-a0a5-f3bc6d0fc299 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:08.280058 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047a11c-a0bb-4455-a0a5-f3bc6d0fc299 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:08.280331 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047a11c-a0bb-4455-a0a5-f3bc6d0fc299 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:08.281023 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c047a11c-a0bb-4455-a0a5-f3bc6d0fc299 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:47:08.282681 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c047a11c-a0bb-4455-a0a5-f3bc6d0fc299 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:47:08.295455 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1112/2220] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:47:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:47:08.299541 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08d29e2-6ce7-44e6-b2a9-aff8906fe434 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:47:08.310940 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08d29e2-6ce7-44e6-b2a9-aff8906fe434 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:47:08.320410 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79acde68-689b-4fca-ab06-cf55e64b6c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:47:08.321196 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79acde68-689b-4fca-ab06-cf55e64b6c0f admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:08.322094 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79acde68-689b-4fca-ab06-cf55e64b6c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:08.322461 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79acde68-689b-4fca-ab06-cf55e64b6c0f admin admin] PATH_INFO: `/v3/projects/faf3775c3d1c4622906bf11a335e793e/users/41749e641b7b4f7ebed0908e663f7cd3/roles/0c67797d444d4c929b2ccab47c468848` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:08.340456 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79acde68-689b-4fca-ab06-cf55e64b6c0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=faf3775c3d1c4622906bf11a335e793e, user_id=41749e641b7b4f7ebed0908e663f7cd3, role_id=0c67797d444d4c929b2ccab47c468848)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:47:08.343320 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79acde68-689b-4fca-ab06-cf55e64b6c0f admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:47:08.364051 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1109/2221] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:47:08 2022] PUT /identity/v3/projects/faf3775c3d1c4622906bf11a335e793e/users/41749e641b7b4f7ebed0908e663f7cd3/roles/0c67797d444d4c929b2ccab47c468848 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:47:08.375869 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6bb60d-ecf5-4f82-8ab1-6a9d7bafb77c None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:08.376173 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6bb60d-ecf5-4f82-8ab1-6a9d7bafb77c None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:08.376453 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6bb60d-ecf5-4f82-8ab1-6a9d7bafb77c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:08.425540 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-da6bb60d-ecf5-4f82-8ab1-6a9d7bafb77c None None] MFA Rules not processed for user `41749e641b7b4f7ebed0908e663f7cd3`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:47:08.427108 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-da6bb60d-ecf5-4f82-8ab1-6a9d7bafb77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:47:08.432644 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:47:08.514507 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1113/2222] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:47:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:47:08.527793 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79acde68-689b-4fca-ab06-cf55e64b6c0f admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:47:08.529588 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-79acde68-689b-4fca-ab06-cf55e64b6c0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:47:08.593982 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79acde68-689b-4fca-ab06-cf55e64b6c0f admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:47:08.597675 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad830e14-2e30-48e2-9442-8bc50ebc7dab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:47:08.598291 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad830e14-2e30-48e2-9442-8bc50ebc7dab service cinder] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:08.598571 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad830e14-2e30-48e2-9442-8bc50ebc7dab service cinder] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:08.598845 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad830e14-2e30-48e2-9442-8bc50ebc7dab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:08.608144 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad830e14-2e30-48e2-9442-8bc50ebc7dab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:47:08.609627 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad830e14-2e30-48e2-9442-8bc50ebc7dab service cinder] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:47:08.619463 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1110/2223] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:47:08 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:47:08.644510 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6bb60d-ecf5-4f82-8ab1-6a9d7bafb77c None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:47:08.727549 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6bb60d-ecf5-4f82-8ab1-6a9d7bafb77c None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:47:08.738069 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2a987-5d69-43e5-984d-31cd4e0b73c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:47:08.739345 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2a987-5d69-43e5-984d-31cd4e0b73c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:08.739973 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2a987-5d69-43e5-984d-31cd4e0b73c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:08.740450 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2a987-5d69-43e5-984d-31cd4e0b73c2 admin admin] PATH_INFO: `/v3/users/41749e641b7b4f7ebed0908e663f7cd3` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:08.742828 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff2a987-5d69-43e5-984d-31cd4e0b73c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41749e641b7b4f7ebed0908e663f7cd3)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:47:08.745006 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff2a987-5d69-43e5-984d-31cd4e0b73c2 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:47:08.839409 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-0ff2a987-5d69-43e5-984d-31cd4e0b73c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41749e641b7b4f7ebed0908e663f7cd3'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:08.857678 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-0ff2a987-5d69-43e5-984d-31cd4e0b73c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41749e641b7b4f7ebed0908e663f7cd3'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:08.859718 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-0ff2a987-5d69-43e5-984d-31cd4e0b73c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41749e641b7b4f7ebed0908e663f7cd3'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:08.874701 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-0ff2a987-5d69-43e5-984d-31cd4e0b73c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41749e641b7b4f7ebed0908e663f7cd3'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:08.876876 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-0ff2a987-5d69-43e5-984d-31cd4e0b73c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41749e641b7b4f7ebed0908e663f7cd3'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:08.909916 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1114/2224] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:47:08 2022] DELETE /identity/v3/users/41749e641b7b4f7ebed0908e663f7cd3 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:47:08.915054 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ee8d5-879f-4280-bf25-4bc0ca718ff1 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:08.915345 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ee8d5-879f-4280-bf25-4bc0ca718ff1 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:08.915623 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ee8d5-879f-4280-bf25-4bc0ca718ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:08.923430 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:47:08.945545 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-ec8ee8d5-879f-4280-bf25-4bc0ca718ff1 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:47:08.947637 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-ec8ee8d5-879f-4280-bf25-4bc0ca718ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:47:09.039299 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1111/2225] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:47:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:47:09.049738 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2a987-5d69-43e5-984d-31cd4e0b73c2 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:47:09.052019 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-0ff2a987-5d69-43e5-984d-31cd4e0b73c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:47:09.111921 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:47:09.151393 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2a987-5d69-43e5-984d-31cd4e0b73c2 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:47:09.156682 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073de0d1-15cc-4938-8bfb-8f1bb3d6654d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:47:09.157464 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073de0d1-15cc-4938-8bfb-8f1bb3d6654d service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:09.157743 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073de0d1-15cc-4938-8bfb-8f1bb3d6654d service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:09.158010 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073de0d1-15cc-4938-8bfb-8f1bb3d6654d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:09.169589 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073de0d1-15cc-4938-8bfb-8f1bb3d6654d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:47:09.170788 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073de0d1-15cc-4938-8bfb-8f1bb3d6654d service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:47:09.181692 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8ee8d5-879f-4280-bf25-4bc0ca718ff1 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:47:09.182949 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-ec8ee8d5-879f-4280-bf25-4bc0ca718ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:47:09.184284 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1115/2226] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:47:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:47:09.196772 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8ee8d5-879f-4280-bf25-4bc0ca718ff1 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:47:09.202100 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8937eb2-308c-4577-83ae-3443a27ac37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:47:09.202746 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8937eb2-308c-4577-83ae-3443a27ac37c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:09.203028 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8937eb2-308c-4577-83ae-3443a27ac37c admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:09.203388 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8937eb2-308c-4577-83ae-3443a27ac37c admin admin] PATH_INFO: `/v3/users/defe2125f653417aacf52ac36153c616` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:09.204572 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8937eb2-308c-4577-83ae-3443a27ac37c admin admin] RBAC: Authorizing `identity:delete_user(user_id=defe2125f653417aacf52ac36153c616)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:47:09.206574 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8937eb2-308c-4577-83ae-3443a27ac37c admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:47:09.265067 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-e8937eb2-308c-4577-83ae-3443a27ac37c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'defe2125f653417aacf52ac36153c616'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:09.277837 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-e8937eb2-308c-4577-83ae-3443a27ac37c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'defe2125f653417aacf52ac36153c616'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:09.277837 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-e8937eb2-308c-4577-83ae-3443a27ac37c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'defe2125f653417aacf52ac36153c616'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:09.288648 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-e8937eb2-308c-4577-83ae-3443a27ac37c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'defe2125f653417aacf52ac36153c616'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:09.296331 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-e8937eb2-308c-4577-83ae-3443a27ac37c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'defe2125f653417aacf52ac36153c616'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:09.305578 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1112/2227] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:47:09 2022] DELETE /identity/v3/users/defe2125f653417aacf52ac36153c616 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:47:09.307238 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7249da9-d53e-4ce0-931e-b07a0f50fb62 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:09.307531 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7249da9-d53e-4ce0-931e-b07a0f50fb62 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:09.307811 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7249da9-d53e-4ce0-931e-b07a0f50fb62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:09.330336 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-e7249da9-d53e-4ce0-931e-b07a0f50fb62 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:47:09.331625 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-e7249da9-d53e-4ce0-931e-b07a0f50fb62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:47:09.421500 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1116/2228] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:47:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:47:09.428972 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8937eb2-308c-4577-83ae-3443a27ac37c admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:47:09.431191 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-e8937eb2-308c-4577-83ae-3443a27ac37c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:47:09.505145 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8937eb2-308c-4577-83ae-3443a27ac37c admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:47:09.510206 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b21d9f7-ca77-4d4f-8c9f-ecdf607eeaf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:47:09.510982 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b21d9f7-ca77-4d4f-8c9f-ecdf607eeaf2 service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:09.511265 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b21d9f7-ca77-4d4f-8c9f-ecdf607eeaf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:09.511535 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b21d9f7-ca77-4d4f-8c9f-ecdf607eeaf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:09.522438 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b21d9f7-ca77-4d4f-8c9f-ecdf607eeaf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:47:09.524099 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b21d9f7-ca77-4d4f-8c9f-ecdf607eeaf2 service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:47:09.536852 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1113/2229] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:47:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:47:09.655392 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7249da9-d53e-4ce0-931e-b07a0f50fb62 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:47:09.657073 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-e7249da9-d53e-4ce0-931e-b07a0f50fb62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:47:09.672566 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7249da9-d53e-4ce0-931e-b07a0f50fb62 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:47:09.678669 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6986194b-2994-4129-8ebe-646bbd86f8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:47:09.680442 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6986194b-2994-4129-8ebe-646bbd86f8cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:09.681020 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6986194b-2994-4129-8ebe-646bbd86f8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:09.681431 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6986194b-2994-4129-8ebe-646bbd86f8cc admin admin] PATH_INFO: `/v3/projects/faf3775c3d1c4622906bf11a335e793e` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:09.682770 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6986194b-2994-4129-8ebe-646bbd86f8cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=faf3775c3d1c4622906bf11a335e793e)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:47:09.685548 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6986194b-2994-4129-8ebe-646bbd86f8cc admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:47:09.754431 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-6986194b-2994-4129-8ebe-646bbd86f8cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faf3775c3d1c4622906bf11a335e793e', 'request_id': 'req-6986194b-2994-4129-8ebe-646bbd86f8cc'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:09.765506 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-6986194b-2994-4129-8ebe-646bbd86f8cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faf3775c3d1c4622906bf11a335e793e', 'request_id': 'req-6986194b-2994-4129-8ebe-646bbd86f8cc'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:09.775366 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-6986194b-2994-4129-8ebe-646bbd86f8cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faf3775c3d1c4622906bf11a335e793e', 'request_id': 'req-6986194b-2994-4129-8ebe-646bbd86f8cc'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:09.800670 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-6986194b-2994-4129-8ebe-646bbd86f8cc admin admin] The token cache is being invalidate because project faf3775c3d1c4622906bf11a335e793e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:47:09.801317 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-6986194b-2994-4129-8ebe-646bbd86f8cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:09.804712 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-6986194b-2994-4129-8ebe-646bbd86f8cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:09.811520 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1117/2230] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:47:09 2022] DELETE /identity/v3/projects/faf3775c3d1c4622906bf11a335e793e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:47:09.811834 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b0ac29-27af-47a6-993d-80d34140d0c5 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:09.812128 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b0ac29-27af-47a6-993d-80d34140d0c5 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:09.812543 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b0ac29-27af-47a6-993d-80d34140d0c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:09.841518 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-90b0ac29-27af-47a6-993d-80d34140d0c5 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:47:09.843099 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-90b0ac29-27af-47a6-993d-80d34140d0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:47:09.856857 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:47:09.872905 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6986194b-2994-4129-8ebe-646bbd86f8cc admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:47:09.874378 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-6986194b-2994-4129-8ebe-646bbd86f8cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:47:09.940709 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1114/2231] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:47:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:47:09.945530 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:47:09.949538 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce3b20-57ad-466f-890c-20370392c6c7 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:09.949823 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce3b20-57ad-466f-890c-20370392c6c7 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:09.950095 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce3b20-57ad-466f-890c-20370392c6c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:09.961321 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6986194b-2994-4129-8ebe-646bbd86f8cc admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:47:09.969259 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e023c9-4c8f-470f-92bd-1451b8be6491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:47:09.970052 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e023c9-4c8f-470f-92bd-1451b8be6491 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:09.970333 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e023c9-4c8f-470f-92bd-1451b8be6491 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:09.970604 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e023c9-4c8f-470f-92bd-1451b8be6491 admin admin] PATH_INFO: `/v3/projects/c99d2782ea4749d7884353a7f37ed4a1` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:09.971742 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e023c9-4c8f-470f-92bd-1451b8be6491 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c99d2782ea4749d7884353a7f37ed4a1)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:47:09.972129 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-55ce3b20-57ad-466f-890c-20370392c6c7 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:47:09.973347 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-55ce3b20-57ad-466f-890c-20370392c6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:47:09.973706 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e023c9-4c8f-470f-92bd-1451b8be6491 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:47:09.982482 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1115/2232] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:47:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:47:09.986632 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce3b20-57ad-466f-890c-20370392c6c7 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:47:09.996542 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce3b20-57ad-466f-890c-20370392c6c7 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:47:10.001484 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19969c44-bc61-412c-b0cc-fede95c975e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:47:10.002089 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19969c44-bc61-412c-b0cc-fede95c975e8 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:10.002362 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19969c44-bc61-412c-b0cc-fede95c975e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:10.002798 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19969c44-bc61-412c-b0cc-fede95c975e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:10.003441 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19969c44-bc61-412c-b0cc-fede95c975e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:47:10.003739 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19969c44-bc61-412c-b0cc-fede95c975e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:47:10.005505 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19969c44-bc61-412c-b0cc-fede95c975e8 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:47:10.022414 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1116/2233] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Aug 29 22:47:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:47:10.024931 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19969c44-bc61-412c-b0cc-fede95c975e8 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:47:10.035563 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-a0e023c9-4c8f-470f-92bd-1451b8be6491 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c99d2782ea4749d7884353a7f37ed4a1', 'request_id': 'req-a0e023c9-4c8f-470f-92bd-1451b8be6491'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:10.042807 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19969c44-bc61-412c-b0cc-fede95c975e8 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:47:10.054639 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-a0e023c9-4c8f-470f-92bd-1451b8be6491 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c99d2782ea4749d7884353a7f37ed4a1', 'request_id': 'req-a0e023c9-4c8f-470f-92bd-1451b8be6491'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:10.061661 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-a0e023c9-4c8f-470f-92bd-1451b8be6491 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c99d2782ea4749d7884353a7f37ed4a1', 'request_id': 'req-a0e023c9-4c8f-470f-92bd-1451b8be6491'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:10.076511 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-a0e023c9-4c8f-470f-92bd-1451b8be6491 admin admin] The token cache is being invalidate because project c99d2782ea4749d7884353a7f37ed4a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:47:10.076807 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-a0e023c9-4c8f-470f-92bd-1451b8be6491 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:10.077502 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-a0e023c9-4c8f-470f-92bd-1451b8be6491 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:10.081377 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1118/2234] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:47:09 2022] DELETE /identity/v3/projects/c99d2782ea4749d7884353a7f37ed4a1 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:47:10.084519 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e05225-3674-4e75-8c08-c30537ae7927 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:10.084803 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e05225-3674-4e75-8c08-c30537ae7927 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:10.085101 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e05225-3674-4e75-8c08-c30537ae7927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:10.105889 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-f0e05225-3674-4e75-8c08-c30537ae7927 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:47:10.107167 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-f0e05225-3674-4e75-8c08-c30537ae7927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:47:10.115127 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab75315-5fa3-4fd6-bed1-78cd5481636c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:47:10.116707 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab75315-5fa3-4fd6-bed1-78cd5481636c admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:10.117218 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab75315-5fa3-4fd6-bed1-78cd5481636c admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:10.117632 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab75315-5fa3-4fd6-bed1-78cd5481636c admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:10.118580 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab75315-5fa3-4fd6-bed1-78cd5481636c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:47:10.120840 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab75315-5fa3-4fd6-bed1-78cd5481636c admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:47:10.154667 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1117/2235] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:47:10 2022] POST /identity/v3/projects => generated 375 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:47:10.158650 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab75315-5fa3-4fd6-bed1-78cd5481636c admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:47:10.161552 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-bab75315-5fa3-4fd6-bed1-78cd5481636c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:47:10.189213 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1119/2236] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:47:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:47:10.198859 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfb4abb-8ad3-4edd-bbdc-7898d3a48ac4 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:10.199231 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfb4abb-8ad3-4edd-bbdc-7898d3a48ac4 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:10.199579 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfb4abb-8ad3-4edd-bbdc-7898d3a48ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:10.222102 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-4cfb4abb-8ad3-4edd-bbdc-7898d3a48ac4 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:47:10.223973 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-4cfb4abb-8ad3-4edd-bbdc-7898d3a48ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:47:10.233939 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1120/2237] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:47:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:47:10.235581 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab75315-5fa3-4fd6-bed1-78cd5481636c admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:47:10.237964 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfb4abb-8ad3-4edd-bbdc-7898d3a48ac4 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:47:10.246733 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae5545-8f56-4cc5-966e-37a6b80c0557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:47:10.247384 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae5545-8f56-4cc5-966e-37a6b80c0557 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:10.247665 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae5545-8f56-4cc5-966e-37a6b80c0557 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:10.247789 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfb4abb-8ad3-4edd-bbdc-7898d3a48ac4 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:47:10.247931 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae5545-8f56-4cc5-966e-37a6b80c0557 admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:10.248566 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fae5545-8f56-4cc5-966e-37a6b80c0557 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:47:10.250536 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fae5545-8f56-4cc5-966e-37a6b80c0557 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:47:10.253570 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6032272a-a600-4ce9-87c0-05bffa6894ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:47:10.254194 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6032272a-a600-4ce9-87c0-05bffa6894ad admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:10.254491 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6032272a-a600-4ce9-87c0-05bffa6894ad admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:10.254751 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6032272a-a600-4ce9-87c0-05bffa6894ad admin admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:10.255410 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6032272a-a600-4ce9-87c0-05bffa6894ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:47:10.255713 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6032272a-a600-4ce9-87c0-05bffa6894ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:47:10.257499 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6032272a-a600-4ce9-87c0-05bffa6894ad admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:47:10.270876 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1121/2238] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Aug 29 22:47:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:47:10.280819 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6032272a-a600-4ce9-87c0-05bffa6894ad admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:47:10.285539 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1118/2239] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:47:10 2022] POST /identity/v3/users => generated 288 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:47:10.288371 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae5545-8f56-4cc5-966e-37a6b80c0557 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:47:10.292826 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6032272a-a600-4ce9-87c0-05bffa6894ad admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:47:10.301117 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae5545-8f56-4cc5-966e-37a6b80c0557 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:47:10.302216 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2378c3-4e30-47dd-b2b9-7a94db110278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:47:10.303277 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2378c3-4e30-47dd-b2b9-7a94db110278 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:10.303277 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2378c3-4e30-47dd-b2b9-7a94db110278 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:10.303700 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2378c3-4e30-47dd-b2b9-7a94db110278 admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:10.304440 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2378c3-4e30-47dd-b2b9-7a94db110278 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:47:10.306510 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2378c3-4e30-47dd-b2b9-7a94db110278 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:47:10.307596 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273a6baf-2cbb-44fa-8ba0-f56ef859cdd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:47:10.308217 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a6baf-2cbb-44fa-8ba0-f56ef859cdd7 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:10.308669 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a6baf-2cbb-44fa-8ba0-f56ef859cdd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:10.309213 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a6baf-2cbb-44fa-8ba0-f56ef859cdd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:10.309966 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273a6baf-2cbb-44fa-8ba0-f56ef859cdd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:47:10.311942 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273a6baf-2cbb-44fa-8ba0-f56ef859cdd7 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:47:10.326231 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1119/2240] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:47:10.330126 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273a6baf-2cbb-44fa-8ba0-f56ef859cdd7 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:47:10.335861 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:47:10.344307 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273a6baf-2cbb-44fa-8ba0-f56ef859cdd7 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:47:10.352210 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55446430-39ca-44a0-9aa1-70b924a2b766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:47:10.352855 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55446430-39ca-44a0-9aa1-70b924a2b766 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:10.353141 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55446430-39ca-44a0-9aa1-70b924a2b766 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:10.353655 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55446430-39ca-44a0-9aa1-70b924a2b766 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:10.354484 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55446430-39ca-44a0-9aa1-70b924a2b766 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:47:10.356432 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55446430-39ca-44a0-9aa1-70b924a2b766 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:47:10.357371 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1122/2241] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:47:10 2022] POST /identity/v3/projects => generated 369 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:47:10.362481 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2378c3-4e30-47dd-b2b9-7a94db110278 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:47:10.374645 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1120/2242] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:47:10.379777 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55446430-39ca-44a0-9aa1-70b924a2b766 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:47:10.394559 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55446430-39ca-44a0-9aa1-70b924a2b766 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:47:10.422699 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:47:10.448562 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2378c3-4e30-47dd-b2b9-7a94db110278 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:47:10.453312 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e71c39-1997-41f4-8247-c1ea4568455e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:47:10.453970 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e71c39-1997-41f4-8247-c1ea4568455e admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:10.454254 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e71c39-1997-41f4-8247-c1ea4568455e admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:10.454526 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e71c39-1997-41f4-8247-c1ea4568455e admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:10.455158 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e71c39-1997-41f4-8247-c1ea4568455e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:47:10.457095 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e71c39-1997-41f4-8247-c1ea4568455e admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:47:10.482429 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a9a42d-ac78-4363-a0b0-66a75d8aa28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:47:10.483211 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a9a42d-ac78-4363-a0b0-66a75d8aa28a admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:10.483602 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a9a42d-ac78-4363-a0b0-66a75d8aa28a admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:10.483958 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a9a42d-ac78-4363-a0b0-66a75d8aa28a admin admin] PATH_INFO: `/v3/projects/f51762d82f924368913b0d1a7e9c7962/users/03e28c2472e04e3684bde5faae86077e/roles/0c67797d444d4c929b2ccab47c468848` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:10.484898 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1123/2243] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:47:10 2022] POST /identity/v3/users => generated 285 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:47:10.488643 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e71c39-1997-41f4-8247-c1ea4568455e admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:47:10.503964 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a9a42d-ac78-4363-a0b0-66a75d8aa28a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f51762d82f924368913b0d1a7e9c7962, user_id=03e28c2472e04e3684bde5faae86077e, role_id=0c67797d444d4c929b2ccab47c468848)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:47:10.504854 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e71c39-1997-41f4-8247-c1ea4568455e admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:47:10.508628 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a9a42d-ac78-4363-a0b0-66a75d8aa28a admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:47:10.511391 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08a8315-a012-4bb0-a863-f8c2fcb056d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:47:10.512309 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a8315-a012-4bb0-a863-f8c2fcb056d8 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:10.512592 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a8315-a012-4bb0-a863-f8c2fcb056d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:10.513229 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a8315-a012-4bb0-a863-f8c2fcb056d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:10.514065 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08a8315-a012-4bb0-a863-f8c2fcb056d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:47:10.515721 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08a8315-a012-4bb0-a863-f8c2fcb056d8 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:47:10.525933 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1121/2244] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:47:10 2022] PUT /identity/v3/projects/f51762d82f924368913b0d1a7e9c7962/users/03e28c2472e04e3684bde5faae86077e/roles/0c67797d444d4c929b2ccab47c468848 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:47:10.534826 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1124/2245] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:47:10.536653 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a9a42d-ac78-4363-a0b0-66a75d8aa28a admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:47:10.538520 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5842d41c-e6be-493b-bf59-17955652078e None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:10.538887 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5842d41c-e6be-493b-bf59-17955652078e None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:10.539750 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5842d41c-e6be-493b-bf59-17955652078e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:10.569599 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-5842d41c-e6be-493b-bf59-17955652078e None None] MFA Rules not processed for user `03e28c2472e04e3684bde5faae86077e`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:47:10.571199 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-5842d41c-e6be-493b-bf59-17955652078e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:47:10.612274 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a9a42d-ac78-4363-a0b0-66a75d8aa28a admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:47:10.618636 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb02dee-46a4-4e0a-bb20-261f3e9258cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:47:10.619424 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb02dee-46a4-4e0a-bb20-261f3e9258cd admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:10.619784 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb02dee-46a4-4e0a-bb20-261f3e9258cd admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:10.620061 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb02dee-46a4-4e0a-bb20-261f3e9258cd admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:10.620709 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb02dee-46a4-4e0a-bb20-261f3e9258cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:47:10.622351 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb02dee-46a4-4e0a-bb20-261f3e9258cd admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:47:10.641418 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1122/2246] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:47:10.644933 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1125/2247] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:47:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:47:10.645760 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb02dee-46a4-4e0a-bb20-261f3e9258cd admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:47:10.656958 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5842d41c-e6be-493b-bf59-17955652078e None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:47:10.658443 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-5842d41c-e6be-493b-bf59-17955652078e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:47:10.664026 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb02dee-46a4-4e0a-bb20-261f3e9258cd admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:47:10.670792 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61396f58-2166-4084-91ea-16b3982e7e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:47:10.671488 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61396f58-2166-4084-91ea-16b3982e7e80 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:10.671763 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61396f58-2166-4084-91ea-16b3982e7e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:10.672036 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61396f58-2166-4084-91ea-16b3982e7e80 admin admin] PATH_INFO: `/v3/projects/35030b1c6e8c403f9fc3ced2c9f43cb3/users/9d870ec64dcc4c879a34bdf16ede45fd/roles/0c67797d444d4c929b2ccab47c468848` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:10.689265 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61396f58-2166-4084-91ea-16b3982e7e80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35030b1c6e8c403f9fc3ced2c9f43cb3, user_id=9d870ec64dcc4c879a34bdf16ede45fd, role_id=0c67797d444d4c929b2ccab47c468848)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:47:10.691985 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61396f58-2166-4084-91ea-16b3982e7e80 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:47:10.711897 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1123/2248] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:47:10 2022] PUT /identity/v3/projects/35030b1c6e8c403f9fc3ced2c9f43cb3/users/9d870ec64dcc4c879a34bdf16ede45fd/roles/0c67797d444d4c929b2ccab47c468848 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:47:10.722400 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5842d41c-e6be-493b-bf59-17955652078e None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:47:10.723631 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49920bc1-a89f-44cc-ab80-edecfb21f18a None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:10.723908 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49920bc1-a89f-44cc-ab80-edecfb21f18a None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:10.724175 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49920bc1-a89f-44cc-ab80-edecfb21f18a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:10.755910 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-49920bc1-a89f-44cc-ab80-edecfb21f18a None None] MFA Rules not processed for user `9d870ec64dcc4c879a34bdf16ede45fd`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:47:10.757989 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-49920bc1-a89f-44cc-ab80-edecfb21f18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:47:10.774012 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c69bcba-282c-4849-ab71-e26901a0d27b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:47:10.774613 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69bcba-282c-4849-ab71-e26901a0d27b service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:10.774889 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69bcba-282c-4849-ab71-e26901a0d27b service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:10.775157 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69bcba-282c-4849-ab71-e26901a0d27b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:10.794550 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:47:10.795563 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:47:10.828393 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1124/2249] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:47:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:47:10.840349 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c69bcba-282c-4849-ab71-e26901a0d27b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:47:10.840711 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49920bc1-a89f-44cc-ab80-edecfb21f18a None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:47:10.842254 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-49920bc1-a89f-44cc-ab80-edecfb21f18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:47:10.842515 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c69bcba-282c-4849-ab71-e26901a0d27b service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:47:10.852821 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1126/2250] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:47:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:47:10.854754 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49920bc1-a89f-44cc-ab80-edecfb21f18a None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:47:10.858504 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77640e58-b87e-4d75-ae43-a7bd3cc5c95d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:47:10.859114 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77640e58-b87e-4d75-ae43-a7bd3cc5c95d service cinder] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:10.859398 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77640e58-b87e-4d75-ae43-a7bd3cc5c95d service cinder] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:10.859678 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77640e58-b87e-4d75-ae43-a7bd3cc5c95d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:10.869873 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77640e58-b87e-4d75-ae43-a7bd3cc5c95d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:47:10.871323 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77640e58-b87e-4d75-ae43-a7bd3cc5c95d service cinder] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:47:10.880818 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1125/2251] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:47:10 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:47:12.241885 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f6383-dbfc-41d9-934c-8f2555115ef5 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:12.242804 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f6383-dbfc-41d9-934c-8f2555115ef5 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:12.242804 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f6383-dbfc-41d9-934c-8f2555115ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:12.263851 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-c25f6383-dbfc-41d9-934c-8f2555115ef5 None None] MFA Rules not processed for user `03e28c2472e04e3684bde5faae86077e`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:47:12.265081 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-c25f6383-dbfc-41d9-934c-8f2555115ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:47:12.272676 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1127/2252] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:47:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:47:17.373433 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77640e58-b87e-4d75-ae43-a7bd3cc5c95d service cinder] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:47:17.375004 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-77640e58-b87e-4d75-ae43-a7bd3cc5c95d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:47:17.462032 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77640e58-b87e-4d75-ae43-a7bd3cc5c95d service cinder] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:47:17.466872 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c963e4c-bf21-4fcf-85a0-3375d4dff516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:47:17.467640 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c963e4c-bf21-4fcf-85a0-3375d4dff516 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:17.468017 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c963e4c-bf21-4fcf-85a0-3375d4dff516 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:17.468398 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c963e4c-bf21-4fcf-85a0-3375d4dff516 admin admin] PATH_INFO: `/v3/users/2d51831614aa4dccb26410329386b663` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:17.469761 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c963e4c-bf21-4fcf-85a0-3375d4dff516 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d51831614aa4dccb26410329386b663)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:47:17.472177 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c963e4c-bf21-4fcf-85a0-3375d4dff516 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:47:17.544379 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-1c963e4c-bf21-4fcf-85a0-3375d4dff516 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d51831614aa4dccb26410329386b663'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:17.553963 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-1c963e4c-bf21-4fcf-85a0-3375d4dff516 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d51831614aa4dccb26410329386b663'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:17.561854 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-1c963e4c-bf21-4fcf-85a0-3375d4dff516 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d51831614aa4dccb26410329386b663'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:17.580020 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-1c963e4c-bf21-4fcf-85a0-3375d4dff516 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d51831614aa4dccb26410329386b663'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:17.595586 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-1c963e4c-bf21-4fcf-85a0-3375d4dff516 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d51831614aa4dccb26410329386b663'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:17.604013 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1126/2253] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:47:17 2022] DELETE /identity/v3/users/2d51831614aa4dccb26410329386b663 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:47:17.851429 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25f6383-dbfc-41d9-934c-8f2555115ef5 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:47:17.864324 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25f6383-dbfc-41d9-934c-8f2555115ef5 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:47:17.936738 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b821bb9a-8301-49a9-8eb9-4b089df6c2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:47:17.937423 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b821bb9a-8301-49a9-8eb9-4b089df6c2f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:17.937708 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b821bb9a-8301-49a9-8eb9-4b089df6c2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:17.937985 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b821bb9a-8301-49a9-8eb9-4b089df6c2f8 admin admin] PATH_INFO: `/v3/projects/88d706377de942e6ac6b47b00c1445ff` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:17.939135 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b821bb9a-8301-49a9-8eb9-4b089df6c2f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88d706377de942e6ac6b47b00c1445ff)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:47:17.941145 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b821bb9a-8301-49a9-8eb9-4b089df6c2f8 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:47:18.002507 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-b821bb9a-8301-49a9-8eb9-4b089df6c2f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88d706377de942e6ac6b47b00c1445ff', 'request_id': 'req-b821bb9a-8301-49a9-8eb9-4b089df6c2f8'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:18.010711 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-b821bb9a-8301-49a9-8eb9-4b089df6c2f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88d706377de942e6ac6b47b00c1445ff', 'request_id': 'req-b821bb9a-8301-49a9-8eb9-4b089df6c2f8'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:18.019050 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-b821bb9a-8301-49a9-8eb9-4b089df6c2f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88d706377de942e6ac6b47b00c1445ff', 'request_id': 'req-b821bb9a-8301-49a9-8eb9-4b089df6c2f8'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:18.035162 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-b821bb9a-8301-49a9-8eb9-4b089df6c2f8 admin admin] The token cache is being invalidate because project 88d706377de942e6ac6b47b00c1445ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:47:18.035451 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-b821bb9a-8301-49a9-8eb9-4b089df6c2f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:18.036538 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-b821bb9a-8301-49a9-8eb9-4b089df6c2f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:18.038328 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1128/2254] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:47:17 2022] DELETE /identity/v3/projects/88d706377de942e6ac6b47b00c1445ff => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:47:18.042410 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c963e4c-bf21-4fcf-85a0-3375d4dff516 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:47:18.043764 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-1c963e4c-bf21-4fcf-85a0-3375d4dff516 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:47:18.058068 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c963e4c-bf21-4fcf-85a0-3375d4dff516 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:47:18.104535 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:47:18.123520 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926eb5a2-217c-410e-976c-9cd7dd3a7caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:47:18.124297 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926eb5a2-217c-410e-976c-9cd7dd3a7caf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:18.124648 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926eb5a2-217c-410e-976c-9cd7dd3a7caf admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:18.124935 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926eb5a2-217c-410e-976c-9cd7dd3a7caf admin admin] PATH_INFO: `/v3/users/4586e7ed77d6410d8adf1c2c308926b2` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:18.126402 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926eb5a2-217c-410e-976c-9cd7dd3a7caf admin admin] RBAC: Authorizing `identity:delete_user(user_id=4586e7ed77d6410d8adf1c2c308926b2)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:47:18.128903 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926eb5a2-217c-410e-976c-9cd7dd3a7caf admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:47:18.182747 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-926eb5a2-217c-410e-976c-9cd7dd3a7caf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4586e7ed77d6410d8adf1c2c308926b2'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:18.190374 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-926eb5a2-217c-410e-976c-9cd7dd3a7caf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4586e7ed77d6410d8adf1c2c308926b2'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:18.191144 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-926eb5a2-217c-410e-976c-9cd7dd3a7caf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4586e7ed77d6410d8adf1c2c308926b2'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:18.203604 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-926eb5a2-217c-410e-976c-9cd7dd3a7caf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4586e7ed77d6410d8adf1c2c308926b2'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:18.212706 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-926eb5a2-217c-410e-976c-9cd7dd3a7caf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4586e7ed77d6410d8adf1c2c308926b2'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:18.218775 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1127/2255] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:47:18 2022] DELETE /identity/v3/users/4586e7ed77d6410d8adf1c2c308926b2 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:47:18.411469 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b821bb9a-8301-49a9-8eb9-4b089df6c2f8 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:47:18.414219 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-b821bb9a-8301-49a9-8eb9-4b089df6c2f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:47:18.430001 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b821bb9a-8301-49a9-8eb9-4b089df6c2f8 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:47:18.490145 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:47:18.512907 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eb1b3a-2ee8-4c3a-b329-42c40378d910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:47:18.513758 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb1b3a-2ee8-4c3a-b329-42c40378d910 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:18.514043 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb1b3a-2ee8-4c3a-b329-42c40378d910 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:18.514336 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb1b3a-2ee8-4c3a-b329-42c40378d910 admin admin] PATH_INFO: `/v3/projects/c3739e4ac26f472b8fdc257a52939015` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:18.516117 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eb1b3a-2ee8-4c3a-b329-42c40378d910 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3739e4ac26f472b8fdc257a52939015)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:47:18.518576 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eb1b3a-2ee8-4c3a-b329-42c40378d910 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:47:18.594393 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-13eb1b3a-2ee8-4c3a-b329-42c40378d910 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3739e4ac26f472b8fdc257a52939015', 'request_id': 'req-13eb1b3a-2ee8-4c3a-b329-42c40378d910'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:18.601627 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-13eb1b3a-2ee8-4c3a-b329-42c40378d910 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3739e4ac26f472b8fdc257a52939015', 'request_id': 'req-13eb1b3a-2ee8-4c3a-b329-42c40378d910'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:18.608135 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-13eb1b3a-2ee8-4c3a-b329-42c40378d910 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3739e4ac26f472b8fdc257a52939015', 'request_id': 'req-13eb1b3a-2ee8-4c3a-b329-42c40378d910'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:18.622947 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-13eb1b3a-2ee8-4c3a-b329-42c40378d910 admin admin] The token cache is being invalidate because project c3739e4ac26f472b8fdc257a52939015 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:47:18.623329 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-13eb1b3a-2ee8-4c3a-b329-42c40378d910 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:18.624012 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-13eb1b3a-2ee8-4c3a-b329-42c40378d910 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:18.625848 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1129/2256] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:47:18 2022] DELETE /identity/v3/projects/c3739e4ac26f472b8fdc257a52939015 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:47:18.630651 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c490c-f52b-45f1-abb9-9d9f6fcfd93d None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:18.631123 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c490c-f52b-45f1-abb9-9d9f6fcfd93d None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:18.631237 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c490c-f52b-45f1-abb9-9d9f6fcfd93d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:18.651768 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-260c490c-f52b-45f1-abb9-9d9f6fcfd93d None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:47:18.653102 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-260c490c-f52b-45f1-abb9-9d9f6fcfd93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:47:18.724571 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1128/2257] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:47:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:47:18.733277 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca6ea5-3cef-4684-becf-c7bd462e6d5b None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:18.733600 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca6ea5-3cef-4684-becf-c7bd462e6d5b None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:18.733877 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca6ea5-3cef-4684-becf-c7bd462e6d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:18.754739 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-0cca6ea5-3cef-4684-becf-c7bd462e6d5b None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:47:18.755958 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-0cca6ea5-3cef-4684-becf-c7bd462e6d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:47:18.765138 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1130/2258] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:47:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:47:18.769543 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c490c-f52b-45f1-abb9-9d9f6fcfd93d None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:47:18.808269 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c490c-f52b-45f1-abb9-9d9f6fcfd93d None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:47:18.814627 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb7f42-da31-4bf3-a33a-d7eb270f8aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:47:18.816275 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb7f42-da31-4bf3-a33a-d7eb270f8aa2 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:18.816565 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb7f42-da31-4bf3-a33a-d7eb270f8aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:18.816846 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb7f42-da31-4bf3-a33a-d7eb270f8aa2 admin admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:18.817565 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfb7f42-da31-4bf3-a33a-d7eb270f8aa2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:47:18.817870 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfb7f42-da31-4bf3-a33a-d7eb270f8aa2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:47:18.819660 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfb7f42-da31-4bf3-a33a-d7eb270f8aa2 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:47:18.832549 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1129/2259] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Aug 29 22:47:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:47:18.838020 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cca6ea5-3cef-4684-becf-c7bd462e6d5b None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:47:18.849609 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cca6ea5-3cef-4684-becf-c7bd462e6d5b None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:47:18.858265 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5f721e-afba-4a8c-8e5f-49f929e9f382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:47:18.859849 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f721e-afba-4a8c-8e5f-49f929e9f382 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:18.860286 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f721e-afba-4a8c-8e5f-49f929e9f382 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:18.860849 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f721e-afba-4a8c-8e5f-49f929e9f382 admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:18.861986 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5f721e-afba-4a8c-8e5f-49f929e9f382 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:47:18.864370 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5f721e-afba-4a8c-8e5f-49f929e9f382 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:47:18.899659 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1131/2260] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:47:18 2022] POST /identity/v3/projects => generated 365 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:47:18.904476 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb7f42-da31-4bf3-a33a-d7eb270f8aa2 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:47:18.918087 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb7f42-da31-4bf3-a33a-d7eb270f8aa2 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:47:18.990496 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:47:19.007353 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d306cf62-0c67-49cc-843a-c8234d61dbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:47:19.008129 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306cf62-0c67-49cc-843a-c8234d61dbed admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:19.008243 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306cf62-0c67-49cc-843a-c8234d61dbed admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:19.008508 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306cf62-0c67-49cc-843a-c8234d61dbed admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:19.009169 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d306cf62-0c67-49cc-843a-c8234d61dbed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:47:19.011131 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d306cf62-0c67-49cc-843a-c8234d61dbed admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:47:19.038518 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1130/2261] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:47:18 2022] POST /identity/v3/users => generated 283 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:47:19.039760 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5f721e-afba-4a8c-8e5f-49f929e9f382 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:47:19.051013 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5f721e-afba-4a8c-8e5f-49f929e9f382 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:47:19.056009 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbac6f2-b37d-4bd5-94d4-895e95ae0ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:47:19.056621 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbac6f2-b37d-4bd5-94d4-895e95ae0ab2 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:19.057195 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbac6f2-b37d-4bd5-94d4-895e95ae0ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:19.057195 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbac6f2-b37d-4bd5-94d4-895e95ae0ab2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:19.057823 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbac6f2-b37d-4bd5-94d4-895e95ae0ab2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:47:19.059433 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbac6f2-b37d-4bd5-94d4-895e95ae0ab2 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:47:19.073793 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1132/2262] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:47:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:47:19.074801 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d306cf62-0c67-49cc-843a-c8234d61dbed admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:47:19.086658 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d306cf62-0c67-49cc-843a-c8234d61dbed admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:47:19.091899 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27783967-c211-476f-ae07-4e8d8193ecdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:47:19.092538 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27783967-c211-476f-ae07-4e8d8193ecdc admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:19.092815 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27783967-c211-476f-ae07-4e8d8193ecdc admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:19.093086 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27783967-c211-476f-ae07-4e8d8193ecdc admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:19.093773 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27783967-c211-476f-ae07-4e8d8193ecdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:47:19.095385 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27783967-c211-476f-ae07-4e8d8193ecdc admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:47:19.106772 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1131/2263] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:47:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:47:19.111198 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbac6f2-b37d-4bd5-94d4-895e95ae0ab2 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:47:19.122745 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbac6f2-b37d-4bd5-94d4-895e95ae0ab2 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:47:19.127857 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c67e9ea-9d3f-4012-aaec-89d7fd80f751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:47:19.128713 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67e9ea-9d3f-4012-aaec-89d7fd80f751 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:19.129158 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67e9ea-9d3f-4012-aaec-89d7fd80f751 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:19.129650 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67e9ea-9d3f-4012-aaec-89d7fd80f751 admin admin] PATH_INFO: `/v3/projects/4e009165b3a9479fb0be7809ea3dd9b3/users/750e4f54a0694e22b84ff912e49fe6be/roles/0c67797d444d4c929b2ccab47c468848` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:19.150845 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c67e9ea-9d3f-4012-aaec-89d7fd80f751 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e009165b3a9479fb0be7809ea3dd9b3, user_id=750e4f54a0694e22b84ff912e49fe6be, role_id=0c67797d444d4c929b2ccab47c468848)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:47:19.153894 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c67e9ea-9d3f-4012-aaec-89d7fd80f751 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:47:19.169694 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1133/2264] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:47:19 2022] PUT /identity/v3/projects/4e009165b3a9479fb0be7809ea3dd9b3/users/750e4f54a0694e22b84ff912e49fe6be/roles/0c67797d444d4c929b2ccab47c468848 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:47:19.181233 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab315c6b-23c9-4741-a6f2-ea863740a261 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:19.181695 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab315c6b-23c9-4741-a6f2-ea863740a261 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:19.182148 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab315c6b-23c9-4741-a6f2-ea863740a261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:19.214903 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-ab315c6b-23c9-4741-a6f2-ea863740a261 None None] MFA Rules not processed for user `750e4f54a0694e22b84ff912e49fe6be`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:47:19.216245 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-ab315c6b-23c9-4741-a6f2-ea863740a261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:47:19.285357 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6806913-0f81-4ffc-a104-7ab3a2b34445 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:19.285995 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6806913-0f81-4ffc-a104-7ab3a2b34445 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:19.286335 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6806913-0f81-4ffc-a104-7ab3a2b34445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:19.311944 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1132/2265] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:47:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:47:19.314035 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-e6806913-0f81-4ffc-a104-7ab3a2b34445 None None] MFA Rules not processed for user `c9d2b7dc4c6f4061a2606e514d2a4c88`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:47:19.323434 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-e6806913-0f81-4ffc-a104-7ab3a2b34445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:47:19.324265 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab315c6b-23c9-4741-a6f2-ea863740a261 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:47:19.328474 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-ab315c6b-23c9-4741-a6f2-ea863740a261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:47:19.399955 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1134/2266] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:47:19 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:47:19.403570 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab315c6b-23c9-4741-a6f2-ea863740a261 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:47:19.408418 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f4c164-b0a5-4d72-9fed-d176aa5ed773 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:47:19.409260 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4c164-b0a5-4d72-9fed-d176aa5ed773 service cinder] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:19.410185 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4c164-b0a5-4d72-9fed-d176aa5ed773 service cinder] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:19.410613 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4c164-b0a5-4d72-9fed-d176aa5ed773 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:19.421437 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f4c164-b0a5-4d72-9fed-d176aa5ed773 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:47:19.423108 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f4c164-b0a5-4d72-9fed-d176aa5ed773 service cinder] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:47:19.433575 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1133/2267] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:47:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:47:21.157947 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6806913-0f81-4ffc-a104-7ab3a2b34445 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:47:21.160141 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-e6806913-0f81-4ffc-a104-7ab3a2b34445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:47:21.183301 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:47:21.293759 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6806913-0f81-4ffc-a104-7ab3a2b34445 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:47:21.298913 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9929f4e-8708-447a-b811-82d8683d1566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:47:21.299465 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9929f4e-8708-447a-b811-82d8683d1566 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:21.299747 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9929f4e-8708-447a-b811-82d8683d1566 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:21.300027 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9929f4e-8708-447a-b811-82d8683d1566 admin admin] PATH_INFO: `/v3/users/9d870ec64dcc4c879a34bdf16ede45fd` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:21.301166 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9929f4e-8708-447a-b811-82d8683d1566 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d870ec64dcc4c879a34bdf16ede45fd)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:47:21.306860 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9929f4e-8708-447a-b811-82d8683d1566 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:47:21.388128 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-a9929f4e-8708-447a-b811-82d8683d1566 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d870ec64dcc4c879a34bdf16ede45fd'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:21.397703 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-a9929f4e-8708-447a-b811-82d8683d1566 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d870ec64dcc4c879a34bdf16ede45fd'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:21.398192 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-a9929f4e-8708-447a-b811-82d8683d1566 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d870ec64dcc4c879a34bdf16ede45fd'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:21.419781 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-a9929f4e-8708-447a-b811-82d8683d1566 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d870ec64dcc4c879a34bdf16ede45fd'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:21.420516 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-a9929f4e-8708-447a-b811-82d8683d1566 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d870ec64dcc4c879a34bdf16ede45fd'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:21.473461 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1135/2268] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:47:21 2022] DELETE /identity/v3/users/9d870ec64dcc4c879a34bdf16ede45fd => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:47:21.475876 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c75e17-49d8-4837-8d1a-f9e04651e478 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:21.476343 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c75e17-49d8-4837-8d1a-f9e04651e478 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:21.476741 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c75e17-49d8-4837-8d1a-f9e04651e478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:21.513742 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-a6c75e17-49d8-4837-8d1a-f9e04651e478 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:47:21.514916 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-a6c75e17-49d8-4837-8d1a-f9e04651e478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:47:21.583100 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:47:21.597215 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1134/2269] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:47:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:47:21.607724 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9929f4e-8708-447a-b811-82d8683d1566 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:47:21.609352 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-a9929f4e-8708-447a-b811-82d8683d1566 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:47:21.670039 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9929f4e-8708-447a-b811-82d8683d1566 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:47:21.673648 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec7376-b9ce-4009-9909-1107dfbc5bd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:47:21.674248 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec7376-b9ce-4009-9909-1107dfbc5bd0 service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:21.674522 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec7376-b9ce-4009-9909-1107dfbc5bd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:21.674789 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec7376-b9ce-4009-9909-1107dfbc5bd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:21.685632 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ec7376-b9ce-4009-9909-1107dfbc5bd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:47:21.687068 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ec7376-b9ce-4009-9909-1107dfbc5bd0 service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:47:21.697506 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1136/2270] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:47:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:47:21.969499 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c75e17-49d8-4837-8d1a-f9e04651e478 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:47:21.971007 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-a6c75e17-49d8-4837-8d1a-f9e04651e478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:47:22.003746 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c75e17-49d8-4837-8d1a-f9e04651e478 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:47:22.008733 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7927f0-a45b-4f64-ae9d-02b3b9a966d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:47:22.009441 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7927f0-a45b-4f64-ae9d-02b3b9a966d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:22.009673 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7927f0-a45b-4f64-ae9d-02b3b9a966d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:22.009944 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7927f0-a45b-4f64-ae9d-02b3b9a966d7 admin admin] PATH_INFO: `/v3/projects/35030b1c6e8c403f9fc3ced2c9f43cb3` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:22.011064 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7927f0-a45b-4f64-ae9d-02b3b9a966d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35030b1c6e8c403f9fc3ced2c9f43cb3)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:47:22.012971 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7927f0-a45b-4f64-ae9d-02b3b9a966d7 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:47:22.065795 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-ab7927f0-a45b-4f64-ae9d-02b3b9a966d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35030b1c6e8c403f9fc3ced2c9f43cb3', 'request_id': 'req-ab7927f0-a45b-4f64-ae9d-02b3b9a966d7'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:22.075349 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-ab7927f0-a45b-4f64-ae9d-02b3b9a966d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35030b1c6e8c403f9fc3ced2c9f43cb3', 'request_id': 'req-ab7927f0-a45b-4f64-ae9d-02b3b9a966d7'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:22.086406 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-ab7927f0-a45b-4f64-ae9d-02b3b9a966d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35030b1c6e8c403f9fc3ced2c9f43cb3', 'request_id': 'req-ab7927f0-a45b-4f64-ae9d-02b3b9a966d7'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:22.105732 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-ab7927f0-a45b-4f64-ae9d-02b3b9a966d7 admin admin] The token cache is being invalidate because project 35030b1c6e8c403f9fc3ced2c9f43cb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:47:22.106032 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-ab7927f0-a45b-4f64-ae9d-02b3b9a966d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:22.106767 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-ab7927f0-a45b-4f64-ae9d-02b3b9a966d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:22.108611 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1135/2271] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:47:21 2022] DELETE /identity/v3/projects/35030b1c6e8c403f9fc3ced2c9f43cb3 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:47:31.693033 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=73,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:47:32.103306 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=27,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:47:37.187008 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da3032-5fc4-4cd4-9b8b-a8f01218dd63 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:37.187478 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da3032-5fc4-4cd4-9b8b-a8f01218dd63 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:37.187595 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da3032-5fc4-4cd4-9b8b-a8f01218dd63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:37.215881 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-27da3032-5fc4-4cd4-9b8b-a8f01218dd63 None None] MFA Rules not processed for user `e49a4666712746d098ace9e1cb0bf07c`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:47:37.217314 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-27da3032-5fc4-4cd4-9b8b-a8f01218dd63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:47:37.298636 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1137/2272] 10.222.0.47 () {58 vars in 1009 bytes} [Mon Aug 29 22:47:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:47:37.355980 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7927f0-a45b-4f64-ae9d-02b3b9a966d7 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:47:37.358435 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-ab7927f0-a45b-4f64-ae9d-02b3b9a966d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:47:37.489479 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7927f0-a45b-4f64-ae9d-02b3b9a966d7 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:47:37.503641 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba03fce-8ed1-420a-b51a-0a89ed7c17b6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '388d8dea2edf4fb888d42ca878c1434d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:47:37.504284 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba03fce-8ed1-420a-b51a-0a89ed7c17b6 service swift] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:37.504563 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba03fce-8ed1-420a-b51a-0a89ed7c17b6 service swift] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:37.504842 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba03fce-8ed1-420a-b51a-0a89ed7c17b6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:37.526133 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba03fce-8ed1-420a-b51a-0a89ed7c17b6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:47:37.528005 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba03fce-8ed1-420a-b51a-0a89ed7c17b6 service swift] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:47:37.540014 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1136/2273] 10.222.0.47 () {60 vars in 1384 bytes} [Mon Aug 29 22:47:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 22:47:38.092886 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f58937-048d-4bcb-aeee-e30af0f7228a None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:38.093180 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f58937-048d-4bcb-aeee-e30af0f7228a None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:38.093500 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f58937-048d-4bcb-aeee-e30af0f7228a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:38.112553 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-15f58937-048d-4bcb-aeee-e30af0f7228a None None] MFA Rules not processed for user `e49a4666712746d098ace9e1cb0bf07c`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:47:38.113805 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-15f58937-048d-4bcb-aeee-e30af0f7228a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:47:38.121611 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1138/2274] 10.222.0.47 () {58 vars in 967 bytes} [Mon Aug 29 22:47:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:47:38.134604 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba03fce-8ed1-420a-b51a-0a89ed7c17b6 service swift] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:47:38.145125 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba03fce-8ed1-420a-b51a-0a89ed7c17b6 service swift] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:47:38.150225 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d95be0b-98b3-469b-9648-5ecd43f0011f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '388d8dea2edf4fb888d42ca878c1434d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:47:38.150819 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95be0b-98b3-469b-9648-5ecd43f0011f service swift] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:38.151098 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95be0b-98b3-469b-9648-5ecd43f0011f service swift] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:38.151366 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95be0b-98b3-469b-9648-5ecd43f0011f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:38.160326 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d95be0b-98b3-469b-9648-5ecd43f0011f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:47:38.162386 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d95be0b-98b3-469b-9648-5ecd43f0011f service swift] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:47:38.172016 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1137/2275] 10.222.0.47 () {60 vars in 1384 bytes} [Mon Aug 29 22:47:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 22:47:38.405789 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874ef1f-f888-4951-b4e1-b3df63c98eae None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:38.406235 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874ef1f-f888-4951-b4e1-b3df63c98eae None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:38.406332 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874ef1f-f888-4951-b4e1-b3df63c98eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:38.426525 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-1874ef1f-f888-4951-b4e1-b3df63c98eae None None] MFA Rules not processed for user `e49a4666712746d098ace9e1cb0bf07c`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:47:38.427728 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-1874ef1f-f888-4951-b4e1-b3df63c98eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:47:38.435758 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1139/2276] 10.222.0.47 () {58 vars in 1009 bytes} [Mon Aug 29 22:47:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:47:38.447536 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d95be0b-98b3-469b-9648-5ecd43f0011f service swift] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:47:38.458743 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d95be0b-98b3-469b-9648-5ecd43f0011f service swift] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:47:38.463980 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de56c548-335b-463b-ba6b-4f494a0aaeef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '388d8dea2edf4fb888d42ca878c1434d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:47:38.464587 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de56c548-335b-463b-ba6b-4f494a0aaeef service swift] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:38.464870 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de56c548-335b-463b-ba6b-4f494a0aaeef service swift] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:38.465144 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de56c548-335b-463b-ba6b-4f494a0aaeef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:38.473511 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de56c548-335b-463b-ba6b-4f494a0aaeef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:47:38.475090 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de56c548-335b-463b-ba6b-4f494a0aaeef service swift] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:47:38.483803 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1138/2277] 10.222.0.47 () {60 vars in 1384 bytes} [Mon Aug 29 22:47:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 22:47:38.859399 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab4636-8bdc-477c-a623-8f0602114b15 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:38.860112 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab4636-8bdc-477c-a623-8f0602114b15 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:38.860638 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab4636-8bdc-477c-a623-8f0602114b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:38.882156 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-a2ab4636-8bdc-477c-a623-8f0602114b15 None None] MFA Rules not processed for user `e49a4666712746d098ace9e1cb0bf07c`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:47:38.883414 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-a2ab4636-8bdc-477c-a623-8f0602114b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:47:38.890870 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1140/2278] 10.222.0.47 () {58 vars in 967 bytes} [Mon Aug 29 22:47:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:47:38.905227 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de56c548-335b-463b-ba6b-4f494a0aaeef service swift] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:47:38.926193 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de56c548-335b-463b-ba6b-4f494a0aaeef service swift] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:47:38.932218 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6212d5-3916-4877-b6b3-245eb01ff67d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '388d8dea2edf4fb888d42ca878c1434d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:47:38.932963 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6212d5-3916-4877-b6b3-245eb01ff67d service swift] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:38.933366 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6212d5-3916-4877-b6b3-245eb01ff67d service swift] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:38.933750 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6212d5-3916-4877-b6b3-245eb01ff67d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:38.942432 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6212d5-3916-4877-b6b3-245eb01ff67d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:47:38.944065 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6212d5-3916-4877-b6b3-245eb01ff67d service swift] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:47:38.953598 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1139/2279] 10.222.0.47 () {60 vars in 1384 bytes} [Mon Aug 29 22:47:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 22:47:41.120432 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab4636-8bdc-477c-a623-8f0602114b15 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:47:41.122176 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-a2ab4636-8bdc-477c-a623-8f0602114b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:47:41.194118 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab4636-8bdc-477c-a623-8f0602114b15 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:47:41.199942 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcc9262-9388-4a04-81ce-ff436d995a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:47:41.200755 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc9262-9388-4a04-81ce-ff436d995a84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:41.200881 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc9262-9388-4a04-81ce-ff436d995a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:41.201124 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc9262-9388-4a04-81ce-ff436d995a84 admin admin] PATH_INFO: `/v3/users/03e28c2472e04e3684bde5faae86077e` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:41.202659 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcc9262-9388-4a04-81ce-ff436d995a84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03e28c2472e04e3684bde5faae86077e)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:47:41.208930 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcc9262-9388-4a04-81ce-ff436d995a84 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:47:41.258280 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-9bcc9262-9388-4a04-81ce-ff436d995a84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03e28c2472e04e3684bde5faae86077e'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:41.267260 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-9bcc9262-9388-4a04-81ce-ff436d995a84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03e28c2472e04e3684bde5faae86077e'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:41.268163 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-9bcc9262-9388-4a04-81ce-ff436d995a84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03e28c2472e04e3684bde5faae86077e'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:41.281371 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-9bcc9262-9388-4a04-81ce-ff436d995a84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03e28c2472e04e3684bde5faae86077e'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:41.281968 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-9bcc9262-9388-4a04-81ce-ff436d995a84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03e28c2472e04e3684bde5faae86077e'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:41.303555 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1141/2280] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:47:41 2022] DELETE /identity/v3/users/03e28c2472e04e3684bde5faae86077e => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:47:41.310914 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc11ba-c394-4ea7-942b-7e0aafdb2590 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:41.311418 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc11ba-c394-4ea7-942b-7e0aafdb2590 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:41.311514 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc11ba-c394-4ea7-942b-7e0aafdb2590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:41.333570 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-a8cc11ba-c394-4ea7-942b-7e0aafdb2590 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:47:41.334797 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-a8cc11ba-c394-4ea7-942b-7e0aafdb2590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:47:41.411654 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1140/2281] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:47:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:47:41.427878 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcc9262-9388-4a04-81ce-ff436d995a84 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:47:41.429524 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-9bcc9262-9388-4a04-81ce-ff436d995a84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:47:41.437492 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:47:41.511365 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcc9262-9388-4a04-81ce-ff436d995a84 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:47:41.515855 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bb8e75-eb6c-4fb4-857b-364b440c2a93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:47:41.516523 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb8e75-eb6c-4fb4-857b-364b440c2a93 service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:41.516746 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb8e75-eb6c-4fb4-857b-364b440c2a93 service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:41.517021 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb8e75-eb6c-4fb4-857b-364b440c2a93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:41.530273 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bb8e75-eb6c-4fb4-857b-364b440c2a93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:47:41.531843 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bb8e75-eb6c-4fb4-857b-364b440c2a93 service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:47:41.542787 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1142/2282] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:47:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:47:41.735459 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cc11ba-c394-4ea7-942b-7e0aafdb2590 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:47:41.736897 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-a8cc11ba-c394-4ea7-942b-7e0aafdb2590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:47:41.763673 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cc11ba-c394-4ea7-942b-7e0aafdb2590 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:47:41.769006 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d89eeee-6348-48f1-9436-1aebafac6fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:47:41.769815 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d89eeee-6348-48f1-9436-1aebafac6fda admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:41.770296 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d89eeee-6348-48f1-9436-1aebafac6fda admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:41.770610 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d89eeee-6348-48f1-9436-1aebafac6fda admin admin] PATH_INFO: `/v3/projects/f51762d82f924368913b0d1a7e9c7962` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:41.771812 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d89eeee-6348-48f1-9436-1aebafac6fda admin admin] RBAC: Authorizing `identity:delete_project(project_id=f51762d82f924368913b0d1a7e9c7962)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:47:41.774179 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d89eeee-6348-48f1-9436-1aebafac6fda admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:47:41.833885 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:47:41.837874 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-6d89eeee-6348-48f1-9436-1aebafac6fda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f51762d82f924368913b0d1a7e9c7962', 'request_id': 'req-6d89eeee-6348-48f1-9436-1aebafac6fda'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:41.845956 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-6d89eeee-6348-48f1-9436-1aebafac6fda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f51762d82f924368913b0d1a7e9c7962', 'request_id': 'req-6d89eeee-6348-48f1-9436-1aebafac6fda'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:41.853122 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-6d89eeee-6348-48f1-9436-1aebafac6fda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f51762d82f924368913b0d1a7e9c7962', 'request_id': 'req-6d89eeee-6348-48f1-9436-1aebafac6fda'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:41.868245 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-6d89eeee-6348-48f1-9436-1aebafac6fda admin admin] The token cache is being invalidate because project f51762d82f924368913b0d1a7e9c7962 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:47:41.868626 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-6d89eeee-6348-48f1-9436-1aebafac6fda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:41.869527 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-6d89eeee-6348-48f1-9436-1aebafac6fda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:47:41.871144 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1141/2283] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:47:41 2022] DELETE /identity/v3/projects/f51762d82f924368913b0d1a7e9c7962 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:47:42.594328 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1faa13-71c9-4297-8d44-e50c17cab5de None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:47:42.594855 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1faa13-71c9-4297-8d44-e50c17cab5de None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:47:42.594855 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1faa13-71c9-4297-8d44-e50c17cab5de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:47:42.613914 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-fe1faa13-71c9-4297-8d44-e50c17cab5de None None] MFA Rules not processed for user `50f7df9dc9f2455d9426b1737770140f`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:47:42.615115 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-fe1faa13-71c9-4297-8d44-e50c17cab5de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:47:42.674469 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1143/2284] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:47:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:47:51.863909 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:DELETE=4,keystone:SELECT=7,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:47:52.667599 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=49 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:48:00.232413 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d89eeee-6348-48f1-9436-1aebafac6fda admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:48:00.234081 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-6d89eeee-6348-48f1-9436-1aebafac6fda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:48:00.316575 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d89eeee-6348-48f1-9436-1aebafac6fda admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:48:00.324173 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f0815f-8895-489a-849d-6f77ae39941e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:48:00.324737 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f0815f-8895-489a-849d-6f77ae39941e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:48:00.325069 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f0815f-8895-489a-849d-6f77ae39941e admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:48:00.325376 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f0815f-8895-489a-849d-6f77ae39941e admin admin] PATH_INFO: `/v3/users/750e4f54a0694e22b84ff912e49fe6be` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:48:00.326647 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f0815f-8895-489a-849d-6f77ae39941e admin admin] RBAC: Authorizing `identity:delete_user(user_id=750e4f54a0694e22b84ff912e49fe6be)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:48:00.328662 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f0815f-8895-489a-849d-6f77ae39941e admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:48:00.384507 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-c6f0815f-8895-489a-849d-6f77ae39941e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '750e4f54a0694e22b84ff912e49fe6be'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:48:00.392400 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-c6f0815f-8895-489a-849d-6f77ae39941e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '750e4f54a0694e22b84ff912e49fe6be'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:48:00.393146 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-c6f0815f-8895-489a-849d-6f77ae39941e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '750e4f54a0694e22b84ff912e49fe6be'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:48:00.406266 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-c6f0815f-8895-489a-849d-6f77ae39941e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '750e4f54a0694e22b84ff912e49fe6be'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:48:00.415951 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-c6f0815f-8895-489a-849d-6f77ae39941e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '750e4f54a0694e22b84ff912e49fe6be'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:48:00.422551 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1142/2285] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:48:00 2022] DELETE /identity/v3/users/750e4f54a0694e22b84ff912e49fe6be => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:48:00.427485 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14425c-495d-4e00-99db-e44a41da4bf4 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:48:00.428028 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14425c-495d-4e00-99db-e44a41da4bf4 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:48:00.428028 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14425c-495d-4e00-99db-e44a41da4bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:48:00.451392 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-5e14425c-495d-4e00-99db-e44a41da4bf4 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:48:00.452632 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-5e14425c-495d-4e00-99db-e44a41da4bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:48:00.520652 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1144/2286] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:48:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:48:00.530678 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f0815f-8895-489a-849d-6f77ae39941e admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:48:00.532151 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-c6f0815f-8895-489a-849d-6f77ae39941e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:48:00.595253 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f0815f-8895-489a-849d-6f77ae39941e admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:48:00.599013 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a34be3-2541-4916-9793-41f3b59fe327 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:48:00.599666 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a34be3-2541-4916-9793-41f3b59fe327 service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:48:00.599949 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a34be3-2541-4916-9793-41f3b59fe327 service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:48:00.600246 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a34be3-2541-4916-9793-41f3b59fe327 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:48:00.611503 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a34be3-2541-4916-9793-41f3b59fe327 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:48:00.612946 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a34be3-2541-4916-9793-41f3b59fe327 service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:48:00.624198 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1143/2287] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:48:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:48:00.955839 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e14425c-495d-4e00-99db-e44a41da4bf4 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:48:00.958537 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-5e14425c-495d-4e00-99db-e44a41da4bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:48:00.975713 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e14425c-495d-4e00-99db-e44a41da4bf4 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:48:00.986672 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020ae6dc-a9f9-424a-a10f-18b5ac1a9f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:48:00.987406 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ae6dc-a9f9-424a-a10f-18b5ac1a9f1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:48:00.987754 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ae6dc-a9f9-424a-a10f-18b5ac1a9f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:48:00.988095 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ae6dc-a9f9-424a-a10f-18b5ac1a9f1f admin admin] PATH_INFO: `/v3/projects/4e009165b3a9479fb0be7809ea3dd9b3` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:48:00.989246 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020ae6dc-a9f9-424a-a10f-18b5ac1a9f1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e009165b3a9479fb0be7809ea3dd9b3)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:48:00.991254 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020ae6dc-a9f9-424a-a10f-18b5ac1a9f1f admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:48:01.046142 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-020ae6dc-a9f9-424a-a10f-18b5ac1a9f1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e009165b3a9479fb0be7809ea3dd9b3', 'request_id': 'req-020ae6dc-a9f9-424a-a10f-18b5ac1a9f1f'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:48:01.054841 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-020ae6dc-a9f9-424a-a10f-18b5ac1a9f1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e009165b3a9479fb0be7809ea3dd9b3', 'request_id': 'req-020ae6dc-a9f9-424a-a10f-18b5ac1a9f1f'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:48:01.064064 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-020ae6dc-a9f9-424a-a10f-18b5ac1a9f1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e009165b3a9479fb0be7809ea3dd9b3', 'request_id': 'req-020ae6dc-a9f9-424a-a10f-18b5ac1a9f1f'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:48:01.077069 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-020ae6dc-a9f9-424a-a10f-18b5ac1a9f1f admin admin] The token cache is being invalidate because project 4e009165b3a9479fb0be7809ea3dd9b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:48:01.077438 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-020ae6dc-a9f9-424a-a10f-18b5ac1a9f1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:48:01.078574 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-020ae6dc-a9f9-424a-a10f-18b5ac1a9f1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:48:01.080732 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1145/2288] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:48:00 2022] DELETE /identity/v3/projects/4e009165b3a9479fb0be7809ea3dd9b3 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:48:01.112493 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2d4eb-0d99-45d5-b8e8-b8643ced178f None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:48:01.112781 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2d4eb-0d99-45d5-b8e8-b8643ced178f None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:48:01.113060 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2d4eb-0d99-45d5-b8e8-b8643ced178f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:48:01.135303 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-44b2d4eb-0d99-45d5-b8e8-b8643ced178f None None] MFA Rules not processed for user `e49a4666712746d098ace9e1cb0bf07c`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:48:01.136498 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-44b2d4eb-0d99-45d5-b8e8-b8643ced178f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:48:01.157175 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:48:01.203783 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1144/2289] 10.222.0.47 () {58 vars in 1009 bytes} [Mon Aug 29 22:48:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:48:01.216350 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020ae6dc-a9f9-424a-a10f-18b5ac1a9f1f admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:48:01.217939 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-020ae6dc-a9f9-424a-a10f-18b5ac1a9f1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:48:01.324349 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020ae6dc-a9f9-424a-a10f-18b5ac1a9f1f admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:48:01.329321 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b56160-5269-4217-aac2-bf4099ced56a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '388d8dea2edf4fb888d42ca878c1434d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:48:01.329948 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b56160-5269-4217-aac2-bf4099ced56a service swift] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:48:01.330225 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b56160-5269-4217-aac2-bf4099ced56a service swift] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:48:01.330489 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b56160-5269-4217-aac2-bf4099ced56a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:48:01.340985 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b56160-5269-4217-aac2-bf4099ced56a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:48:01.342685 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b56160-5269-4217-aac2-bf4099ced56a service swift] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:48:01.353399 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1146/2290] 10.222.0.47 () {60 vars in 1384 bytes} [Mon Aug 29 22:48:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 22:48:11.196969 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=15 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:48:11.348086 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:48:15.277969 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827dc4c2-b033-4a23-b23f-654fd89cdd39 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:48:15.277969 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827dc4c2-b033-4a23-b23f-654fd89cdd39 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:48:15.277969 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827dc4c2-b033-4a23-b23f-654fd89cdd39 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:48:15.277969 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1145/2291] 10.222.0.47 () {54 vars in 921 bytes} [Mon Aug 29 22:48:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:48:15.283330 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983bd509-3d9c-4fad-ad90-843c24ff9e4d None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:48:15.283800 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983bd509-3d9c-4fad-ad90-843c24ff9e4d None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:48:15.283905 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983bd509-3d9c-4fad-ad90-843c24ff9e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:48:15.306700 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-983bd509-3d9c-4fad-ad90-843c24ff9e4d None None] MFA Rules not processed for user `35441c061e514b1b9341e7694ec2c0bc`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:48:15.307955 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-983bd509-3d9c-4fad-ad90-843c24ff9e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:48:15.378499 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1147/2292] 10.222.0.47 () {58 vars in 1018 bytes} [Mon Aug 29 22:48:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:48:15.390663 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827dc4c2-b033-4a23-b23f-654fd89cdd39 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:48:15.392426 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-827dc4c2-b033-4a23-b23f-654fd89cdd39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:48:15.451634 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827dc4c2-b033-4a23-b23f-654fd89cdd39 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:48:15.455237 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a6578-401e-44b0-b3b1-a286d0ae158f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5c4e692fd714354b96bd3ef4fcecdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:48:15.455833 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a6578-401e-44b0-b3b1-a286d0ae158f service glance] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:48:15.456112 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a6578-401e-44b0-b3b1-a286d0ae158f service glance] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:48:15.456381 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a6578-401e-44b0-b3b1-a286d0ae158f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:48:15.466548 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30a6578-401e-44b0-b3b1-a286d0ae158f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:48:15.467973 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30a6578-401e-44b0-b3b1-a286d0ae158f service glance] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:48:15.478975 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1146/2293] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:48:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:48:15.551882 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3cb495-b8ef-4239-8cc2-da5e2411218d None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:48:15.552152 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3cb495-b8ef-4239-8cc2-da5e2411218d None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:48:15.552418 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3cb495-b8ef-4239-8cc2-da5e2411218d None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:48:15.553998 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1148/2294] 10.222.0.47 () {54 vars in 921 bytes} [Mon Aug 29 22:48:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 22:48:15.559119 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1ec09-7c62-40b0-8623-49fad32cf42f None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:48:15.559520 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1ec09-7c62-40b0-8623-49fad32cf42f None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:48:15.559855 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1ec09-7c62-40b0-8623-49fad32cf42f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:48:15.579857 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-6cd1ec09-7c62-40b0-8623-49fad32cf42f None None] MFA Rules not processed for user `27abbf7b40e54fc091ebfe10aa6da90d`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:48:15.581066 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-6cd1ec09-7c62-40b0-8623-49fad32cf42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:48:15.635065 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1147/2295] 10.222.0.47 () {58 vars in 1018 bytes} [Mon Aug 29 22:48:15 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:48:15.646841 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3cb495-b8ef-4239-8cc2-da5e2411218d None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:48:15.649033 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-0c3cb495-b8ef-4239-8cc2-da5e2411218d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:48:15.662516 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3cb495-b8ef-4239-8cc2-da5e2411218d None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:48:15.667358 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec48fb2d-9df1-43f2-b405-c8ec637d3b86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:48:15.668134 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec48fb2d-9df1-43f2-b405-c8ec637d3b86 service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:48:15.668429 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec48fb2d-9df1-43f2-b405-c8ec637d3b86 service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:48:15.668768 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec48fb2d-9df1-43f2-b405-c8ec637d3b86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:48:15.676376 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec48fb2d-9df1-43f2-b405-c8ec637d3b86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:48:15.677895 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec48fb2d-9df1-43f2-b405-c8ec637d3b86 service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:48:15.686246 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1149/2296] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:48:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:48:15.772509 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e75f9e-045a-45f6-ac07-790ab162fd64 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:48:15.772847 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e75f9e-045a-45f6-ac07-790ab162fd64 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:48:15.773136 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e75f9e-045a-45f6-ac07-790ab162fd64 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:48:15.774624 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1148/2297] 10.222.0.47 () {54 vars in 921 bytes} [Mon Aug 29 22:48:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:48:15.779731 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13c668-6cde-494e-99b0-189f757fe500 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:48:15.780015 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13c668-6cde-494e-99b0-189f757fe500 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:48:15.780287 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13c668-6cde-494e-99b0-189f757fe500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:48:15.800547 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-2c13c668-6cde-494e-99b0-189f757fe500 None None] MFA Rules not processed for user `35441c061e514b1b9341e7694ec2c0bc`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:48:15.801792 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-2c13c668-6cde-494e-99b0-189f757fe500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:48:15.812924 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1150/2298] 10.222.0.47 () {58 vars in 1018 bytes} [Mon Aug 29 22:48:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:48:15.823451 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e75f9e-045a-45f6-ac07-790ab162fd64 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:48:15.825148 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-61e75f9e-045a-45f6-ac07-790ab162fd64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:48:15.838605 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e75f9e-045a-45f6-ac07-790ab162fd64 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:48:15.842197 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d94e61-7249-49c4-ad73-025c2269789e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:48:15.842787 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d94e61-7249-49c4-ad73-025c2269789e service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:48:15.843063 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d94e61-7249-49c4-ad73-025c2269789e service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:48:15.843334 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d94e61-7249-49c4-ad73-025c2269789e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:48:15.854143 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d94e61-7249-49c4-ad73-025c2269789e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:48:15.855556 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d94e61-7249-49c4-ad73-025c2269789e service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:48:15.866364 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1149/2299] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:48:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:48:18.619920 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c5dc7-57b4-4ae2-b3e8-abc96e32f68e None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:48:18.620378 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c5dc7-57b4-4ae2-b3e8-abc96e32f68e None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:48:18.620481 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c5dc7-57b4-4ae2-b3e8-abc96e32f68e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:48:18.639758 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-328c5dc7-57b4-4ae2-b3e8-abc96e32f68e None None] MFA Rules not processed for user `e49a4666712746d098ace9e1cb0bf07c`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:48:18.640973 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-328c5dc7-57b4-4ae2-b3e8-abc96e32f68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:48:18.648621 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1151/2300] 10.222.0.47 () {58 vars in 1009 bytes} [Mon Aug 29 22:48:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:48:18.661763 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d94e61-7249-49c4-ad73-025c2269789e service neutron] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:48:18.674771 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d94e61-7249-49c4-ad73-025c2269789e service neutron] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:48:18.680542 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df607263-9feb-4721-994e-f070adde6858 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '388d8dea2edf4fb888d42ca878c1434d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:48:18.681081 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df607263-9feb-4721-994e-f070adde6858 service swift] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:48:18.681394 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df607263-9feb-4721-994e-f070adde6858 service swift] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:48:18.681883 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df607263-9feb-4721-994e-f070adde6858 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:48:18.690044 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df607263-9feb-4721-994e-f070adde6858 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:48:18.691603 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df607263-9feb-4721-994e-f070adde6858 service swift] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:48:18.700284 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1150/2301] 10.222.0.47 () {60 vars in 1384 bytes} [Mon Aug 29 22:48:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 22:48:28.634847 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=43 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:48:28.697043 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=61 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:48:34.160624 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c5dc7-57b4-4ae2-b3e8-abc96e32f68e None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:48:34.162726 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-328c5dc7-57b4-4ae2-b3e8-abc96e32f68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:48:34.232577 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c5dc7-57b4-4ae2-b3e8-abc96e32f68e None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:48:34.237745 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe3d464-4445-4a43-b717-6154f25748a2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296cbef772104e078971ba93aa2e022c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:48:34.238354 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3d464-4445-4a43-b717-6154f25748a2 service placement] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:48:34.238636 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3d464-4445-4a43-b717-6154f25748a2 service placement] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:48:34.238910 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3d464-4445-4a43-b717-6154f25748a2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:48:34.240859 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-afe3d464-4445-4a43-b717-6154f25748a2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:48:34.252305 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe3d464-4445-4a43-b717-6154f25748a2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:48:34.253934 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe3d464-4445-4a43-b717-6154f25748a2 service placement] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:48:34.264131 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1152/2302] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:48:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:48:37.714291 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe48f32-22ce-44bc-9ee4-af56407973a8 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:48:37.714746 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe48f32-22ce-44bc-9ee4-af56407973a8 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:48:37.714844 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe48f32-22ce-44bc-9ee4-af56407973a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:48:37.734978 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-dfe48f32-22ce-44bc-9ee4-af56407973a8 None None] MFA Rules not processed for user `e49a4666712746d098ace9e1cb0bf07c`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:48:37.736262 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-dfe48f32-22ce-44bc-9ee4-af56407973a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:48:37.744366 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1151/2303] 10.222.0.47 () {58 vars in 967 bytes} [Mon Aug 29 22:48:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:48:37.768399 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe3d464-4445-4a43-b717-6154f25748a2 service placement] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:48:37.780228 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe3d464-4445-4a43-b717-6154f25748a2 service placement] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:48:37.785434 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbb1019-96af-4c33-a502-8cee2acbf968 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '388d8dea2edf4fb888d42ca878c1434d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:48:37.786028 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb1019-96af-4c33-a502-8cee2acbf968 service swift] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:48:37.786309 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb1019-96af-4c33-a502-8cee2acbf968 service swift] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:48:37.787224 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb1019-96af-4c33-a502-8cee2acbf968 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:48:37.795483 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbb1019-96af-4c33-a502-8cee2acbf968 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:48:37.797235 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbb1019-96af-4c33-a502-8cee2acbf968 service swift] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:48:37.806196 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1153/2304] 10.222.0.47 () {60 vars in 1384 bytes} [Mon Aug 29 22:48:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 22:48:47.729736 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=3 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:48:47.802209 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=38 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:08.882216 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a235dd9-ff7b-4d7a-8701-a39abd669e82 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:08.882720 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a235dd9-ff7b-4d7a-8701-a39abd669e82 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:08.882836 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a235dd9-ff7b-4d7a-8701-a39abd669e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:08.901963 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-2a235dd9-ff7b-4d7a-8701-a39abd669e82 None None] MFA Rules not processed for user `50f7df9dc9f2455d9426b1737770140f`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:49:08.903162 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-2a235dd9-ff7b-4d7a-8701-a39abd669e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:08.960274 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1152/2305] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:49:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:49:12.088943 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec392f-796d-4506-aed8-f9df54299782 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:12.089509 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec392f-796d-4506-aed8-f9df54299782 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:12.089509 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec392f-796d-4506-aed8-f9df54299782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:12.108650 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-66ec392f-796d-4506-aed8-f9df54299782 None None] MFA Rules not processed for user `c9d2b7dc4c6f4061a2606e514d2a4c88`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:49:12.109872 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-66ec392f-796d-4506-aed8-f9df54299782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:12.165005 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1154/2306] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:49:12 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:49:18.952749 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=25 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:22.157650 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=25 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:36.342843 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c784c8-3dd8-487b-830c-94bde056b7e8 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:49:36.343343 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c784c8-3dd8-487b-830c-94bde056b7e8 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:49:36.343496 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c784c8-3dd8-487b-830c-94bde056b7e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:49:36.363982 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-16c784c8-3dd8-487b-830c-94bde056b7e8 None None] MFA Rules not processed for user `e2710a23114c4962a06886572be82b12`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:49:36.365209 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-16c784c8-3dd8-487b-830c-94bde056b7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:49:36.422562 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1153/2307] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:49:36 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:49:46.414687 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=25 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:29.307707 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec392f-796d-4506-aed8-f9df54299782 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:29.309478 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-66ec392f-796d-4506-aed8-f9df54299782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:29.370792 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec392f-796d-4506-aed8-f9df54299782 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:29.374821 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e3489-f018-4454-b1ae-3af734a75f8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:29.375420 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e3489-f018-4454-b1ae-3af734a75f8b service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:29.375708 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e3489-f018-4454-b1ae-3af734a75f8b service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:29.375994 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e3489-f018-4454-b1ae-3af734a75f8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:29.378032 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-943e3489-f018-4454-b1ae-3af734a75f8b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:29.393992 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943e3489-f018-4454-b1ae-3af734a75f8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:29.395497 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943e3489-f018-4454-b1ae-3af734a75f8b service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:29.409549 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1155/2308] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:50:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:50:33.408710 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c784c8-3dd8-487b-830c-94bde056b7e8 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:33.418665 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c784c8-3dd8-487b-830c-94bde056b7e8 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:33.422267 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a466437-1e1e-40e0-b54b-c583695e489a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:33.422869 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a466437-1e1e-40e0-b54b-c583695e489a service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:33.423148 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a466437-1e1e-40e0-b54b-c583695e489a service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:33.423422 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a466437-1e1e-40e0-b54b-c583695e489a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:33.425176 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-8a466437-1e1e-40e0-b54b-c583695e489a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:33.438663 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a466437-1e1e-40e0-b54b-c583695e489a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:33.440075 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a466437-1e1e-40e0-b54b-c583695e489a service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:33.451717 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1154/2309] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:50:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:50:34.943760 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e3489-f018-4454-b1ae-3af734a75f8b service cinder] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:34.945146 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-943e3489-f018-4454-b1ae-3af734a75f8b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:34.959607 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e3489-f018-4454-b1ae-3af734a75f8b service cinder] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:34.965978 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c855430-08a8-467f-8fe6-b594dcd3c408 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35441c061e514b1b9341e7694ec2c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:34.966584 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c855430-08a8-467f-8fe6-b594dcd3c408 service nova] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:34.966865 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c855430-08a8-467f-8fe6-b594dcd3c408 service nova] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:34.967138 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c855430-08a8-467f-8fe6-b594dcd3c408 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:34.968881 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-4c855430-08a8-467f-8fe6-b594dcd3c408 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:34.979415 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c855430-08a8-467f-8fe6-b594dcd3c408 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:34.981005 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c855430-08a8-467f-8fe6-b594dcd3c408 service nova] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:34.990091 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1156/2310] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:50:34 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:50:41.198958 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab15ba-3f80-40a6-aa9a-8f54adaf3e66 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:41.199480 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab15ba-3f80-40a6-aa9a-8f54adaf3e66 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:41.199735 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab15ba-3f80-40a6-aa9a-8f54adaf3e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:41.221732 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-0bab15ba-3f80-40a6-aa9a-8f54adaf3e66 None None] MFA Rules not processed for user `50f7df9dc9f2455d9426b1737770140f`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:41.223067 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-0bab15ba-3f80-40a6-aa9a-8f54adaf3e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:41.231688 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1155/2311] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:50:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:41.847467 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c855430-08a8-467f-8fe6-b594dcd3c408 service nova] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:41.849014 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-4c855430-08a8-467f-8fe6-b594dcd3c408 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:41.863574 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c855430-08a8-467f-8fe6-b594dcd3c408 service nova] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:41.870005 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db34da24-bae5-45a2-96a7-fe0455d5f4e1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296cbef772104e078971ba93aa2e022c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:41.870624 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34da24-bae5-45a2-96a7-fe0455d5f4e1 service placement] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:41.870908 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34da24-bae5-45a2-96a7-fe0455d5f4e1 service placement] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:41.871183 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34da24-bae5-45a2-96a7-fe0455d5f4e1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:41.872974 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-db34da24-bae5-45a2-96a7-fe0455d5f4e1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:41.886307 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db34da24-bae5-45a2-96a7-fe0455d5f4e1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:41.888023 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db34da24-bae5-45a2-96a7-fe0455d5f4e1 service placement] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:41.898711 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1157/2312] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:50:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:50:43.182516 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bab15ba-3f80-40a6-aa9a-8f54adaf3e66 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:43.185663 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-0bab15ba-3f80-40a6-aa9a-8f54adaf3e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:43.208795 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bab15ba-3f80-40a6-aa9a-8f54adaf3e66 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:43.217147 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56fa9c5-59fc-4943-8635-fa76751d4b10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35441c061e514b1b9341e7694ec2c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:43.218070 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56fa9c5-59fc-4943-8635-fa76751d4b10 service nova] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:43.218374 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56fa9c5-59fc-4943-8635-fa76751d4b10 service nova] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:43.218621 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56fa9c5-59fc-4943-8635-fa76751d4b10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:43.220567 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-e56fa9c5-59fc-4943-8635-fa76751d4b10 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:43.234118 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56fa9c5-59fc-4943-8635-fa76751d4b10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:43.236209 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56fa9c5-59fc-4943-8635-fa76751d4b10 service nova] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:43.251216 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1156/2313] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:50:43 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:50:44.660674 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db34da24-bae5-45a2-96a7-fe0455d5f4e1 service placement] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:44.670811 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db34da24-bae5-45a2-96a7-fe0455d5f4e1 service placement] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:44.674482 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b2dee8-727f-4359-987b-850e316c9a44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:44.675085 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b2dee8-727f-4359-987b-850e316c9a44 service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:44.675363 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b2dee8-727f-4359-987b-850e316c9a44 service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:44.675632 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b2dee8-727f-4359-987b-850e316c9a44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:44.677405 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-d3b2dee8-727f-4359-987b-850e316c9a44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:44.750264 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b2dee8-727f-4359-987b-850e316c9a44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:44.751710 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b2dee8-727f-4359-987b-850e316c9a44 service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:44.762365 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1158/2314] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:50:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:50:48.445770 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a0c81-2647-4c88-bf88-3949ce14899c None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:48.446736 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a0c81-2647-4c88-bf88-3949ce14899c None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:48.447571 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a0c81-2647-4c88-bf88-3949ce14899c None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:48.449285 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1157/2315] 10.222.0.47 () {54 vars in 921 bytes} [Mon Aug 29 22:50:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 22:50:48.476473 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4b21f-fe6e-4e45-870d-ca3576ecaed0 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:48.477135 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4b21f-fe6e-4e45-870d-ca3576ecaed0 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:48.477135 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4b21f-fe6e-4e45-870d-ca3576ecaed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:48.504243 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-b7f4b21f-fe6e-4e45-870d-ca3576ecaed0 None None] MFA Rules not processed for user `296cbef772104e078971ba93aa2e022c`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:48.505598 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-b7f4b21f-fe6e-4e45-870d-ca3576ecaed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:48.511180 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a0c81-2647-4c88-bf88-3949ce14899c None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:48.516289 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-6d6a0c81-2647-4c88-bf88-3949ce14899c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:48.528743 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1159/2316] 10.222.0.47 () {58 vars in 1018 bytes} [Mon Aug 29 22:50:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:48.531778 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a0c81-2647-4c88-bf88-3949ce14899c None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:48.536306 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0d1df0-0f59-4360-baca-9eaf5d608598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:48.537036 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d1df0-0f59-4360-baca-9eaf5d608598 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:48.537671 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d1df0-0f59-4360-baca-9eaf5d608598 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:48.537671 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d1df0-0f59-4360-baca-9eaf5d608598 admin admin] PATH_INFO: `/v3/users/c9d2b7dc4c6f4061a2606e514d2a4c88` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:48.540542 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0d1df0-0f59-4360-baca-9eaf5d608598 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9d2b7dc4c6f4061a2606e514d2a4c88)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:48.542823 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0d1df0-0f59-4360-baca-9eaf5d608598 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:48.546235 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f4b21f-fe6e-4e45-870d-ca3576ecaed0 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:48.558216 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f4b21f-fe6e-4e45-870d-ca3576ecaed0 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:48.563556 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c7040-87f4-4b15-a78a-d5eb9063c0e2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296cbef772104e078971ba93aa2e022c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:48.564159 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c7040-87f4-4b15-a78a-d5eb9063c0e2 service placement] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:48.564445 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c7040-87f4-4b15-a78a-d5eb9063c0e2 service placement] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:48.564719 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c7040-87f4-4b15-a78a-d5eb9063c0e2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:48.574548 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6c7040-87f4-4b15-a78a-d5eb9063c0e2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:48.576117 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6c7040-87f4-4b15-a78a-d5eb9063c0e2 service placement] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:48.587263 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1160/2317] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:50:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:50:48.595405 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-7c0d1df0-0f59-4360-baca-9eaf5d608598 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9d2b7dc4c6f4061a2606e514d2a4c88'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:48.604028 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-7c0d1df0-0f59-4360-baca-9eaf5d608598 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9d2b7dc4c6f4061a2606e514d2a4c88'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:48.604763 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-7c0d1df0-0f59-4360-baca-9eaf5d608598 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9d2b7dc4c6f4061a2606e514d2a4c88'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:48.618462 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-7c0d1df0-0f59-4360-baca-9eaf5d608598 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9d2b7dc4c6f4061a2606e514d2a4c88'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:48.626063 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-7c0d1df0-0f59-4360-baca-9eaf5d608598 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9d2b7dc4c6f4061a2606e514d2a4c88'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:48.632053 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1158/2318] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:50:48 2022] DELETE /identity/v3/users/c9d2b7dc4c6f4061a2606e514d2a4c88 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:48.811591 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c7040-87f4-4b15-a78a-d5eb9063c0e2 service placement] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:48.823860 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c7040-87f4-4b15-a78a-d5eb9063c0e2 service placement] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:48.874533 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:48.885615 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df934a96-5ffa-4b0a-af1a-8fec830e646b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:48.886261 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df934a96-5ffa-4b0a-af1a-8fec830e646b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:48.886703 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df934a96-5ffa-4b0a-af1a-8fec830e646b admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:48.886979 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df934a96-5ffa-4b0a-af1a-8fec830e646b admin admin] PATH_INFO: `/v3/projects/589d651060244dd5a74a1e98513ac74f` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:48.888109 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df934a96-5ffa-4b0a-af1a-8fec830e646b admin admin] RBAC: Authorizing `identity:delete_project(project_id=589d651060244dd5a74a1e98513ac74f)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:48.890050 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df934a96-5ffa-4b0a-af1a-8fec830e646b admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:48.936732 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-df934a96-5ffa-4b0a-af1a-8fec830e646b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '589d651060244dd5a74a1e98513ac74f', 'request_id': 'req-df934a96-5ffa-4b0a-af1a-8fec830e646b'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:48.942809 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-df934a96-5ffa-4b0a-af1a-8fec830e646b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '589d651060244dd5a74a1e98513ac74f', 'request_id': 'req-df934a96-5ffa-4b0a-af1a-8fec830e646b'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:48.949534 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-df934a96-5ffa-4b0a-af1a-8fec830e646b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '589d651060244dd5a74a1e98513ac74f', 'request_id': 'req-df934a96-5ffa-4b0a-af1a-8fec830e646b'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:48.962156 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-df934a96-5ffa-4b0a-af1a-8fec830e646b admin admin] The token cache is being invalidate because project 589d651060244dd5a74a1e98513ac74f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:50:48.962449 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-df934a96-5ffa-4b0a-af1a-8fec830e646b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:48.963089 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-df934a96-5ffa-4b0a-af1a-8fec830e646b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:48.964592 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1161/2319] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:50:48 2022] DELETE /identity/v3/projects/589d651060244dd5a74a1e98513ac74f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:48.969688 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0f1a3-dbf3-4b5b-9a91-e922adb83040 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:48.969973 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0f1a3-dbf3-4b5b-9a91-e922adb83040 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:48.970245 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0f1a3-dbf3-4b5b-9a91-e922adb83040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:48.993109 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-48e0f1a3-dbf3-4b5b-9a91-e922adb83040 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:48.994336 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-48e0f1a3-dbf3-4b5b-9a91-e922adb83040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:49.058562 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1159/2320] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:50:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:49.066333 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24745c4c-acf2-41b3-89ed-0367f37b0091 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:49.066623 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24745c4c-acf2-41b3-89ed-0367f37b0091 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:49.066897 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24745c4c-acf2-41b3-89ed-0367f37b0091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:49.087126 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-24745c4c-acf2-41b3-89ed-0367f37b0091 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:49.088350 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-24745c4c-acf2-41b3-89ed-0367f37b0091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:49.096321 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1162/2321] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:50:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:49.100509 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e0f1a3-dbf3-4b5b-9a91-e922adb83040 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:49.110867 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e0f1a3-dbf3-4b5b-9a91-e922adb83040 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:49.115552 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab98f5e-8219-4ff7-a0e7-0f90081b3c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:49.116149 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab98f5e-8219-4ff7-a0e7-0f90081b3c39 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:49.116426 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab98f5e-8219-4ff7-a0e7-0f90081b3c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:49.117268 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab98f5e-8219-4ff7-a0e7-0f90081b3c39 admin admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:49.118052 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab98f5e-8219-4ff7-a0e7-0f90081b3c39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:50:49.118352 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab98f5e-8219-4ff7-a0e7-0f90081b3c39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:49.119959 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab98f5e-8219-4ff7-a0e7-0f90081b3c39 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:49.133243 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1160/2322] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Aug 29 22:50:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:50:49.137416 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24745c4c-acf2-41b3-89ed-0367f37b0091 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:49.148689 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24745c4c-acf2-41b3-89ed-0367f37b0091 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:49.153742 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002a329b-dd9f-4201-a7b0-0792615105e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:49.154456 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a329b-dd9f-4201-a7b0-0792615105e9 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:49.154744 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a329b-dd9f-4201-a7b0-0792615105e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:49.155262 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a329b-dd9f-4201-a7b0-0792615105e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:49.155924 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002a329b-dd9f-4201-a7b0-0792615105e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:49.157943 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002a329b-dd9f-4201-a7b0-0792615105e9 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:49.188940 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1163/2323] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:50:49 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:50:49.193089 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab98f5e-8219-4ff7-a0e7-0f90081b3c39 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:49.206669 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab98f5e-8219-4ff7-a0e7-0f90081b3c39 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:49.249091 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:49.290617 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6180fa-de91-4587-ae5c-238a4dbbc8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:49.290846 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6180fa-de91-4587-ae5c-238a4dbbc8cb admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:49.291004 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6180fa-de91-4587-ae5c-238a4dbbc8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:49.291278 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6180fa-de91-4587-ae5c-238a4dbbc8cb admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:49.291924 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6180fa-de91-4587-ae5c-238a4dbbc8cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:49.293922 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6180fa-de91-4587-ae5c-238a4dbbc8cb admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:49.331547 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1161/2324] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:50:49 2022] POST /identity/v3/users => generated 287 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:50:49.336965 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002a329b-dd9f-4201-a7b0-0792615105e9 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:49.350226 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002a329b-dd9f-4201-a7b0-0792615105e9 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:49.358159 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4bade-8777-404f-bf01-d23f9ce98374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:49.358844 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4bade-8777-404f-bf01-d23f9ce98374 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:49.359066 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4bade-8777-404f-bf01-d23f9ce98374 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:49.359340 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4bade-8777-404f-bf01-d23f9ce98374 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:49.360880 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d4bade-8777-404f-bf01-d23f9ce98374 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:49.363008 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d4bade-8777-404f-bf01-d23f9ce98374 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:49.378975 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1164/2325] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:50:49 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:50:49.384427 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6180fa-de91-4587-ae5c-238a4dbbc8cb admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:49.396091 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6180fa-de91-4587-ae5c-238a4dbbc8cb admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:49.403095 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0644eaa7-c5d5-4063-8757-cc9b03301df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:49.403719 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0644eaa7-c5d5-4063-8757-cc9b03301df0 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:49.403996 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0644eaa7-c5d5-4063-8757-cc9b03301df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:49.404265 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0644eaa7-c5d5-4063-8757-cc9b03301df0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:49.404907 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0644eaa7-c5d5-4063-8757-cc9b03301df0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:49.406799 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0644eaa7-c5d5-4063-8757-cc9b03301df0 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:49.419119 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1162/2326] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:50:49 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:50:49.423557 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4bade-8777-404f-bf01-d23f9ce98374 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:49.435430 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4bade-8777-404f-bf01-d23f9ce98374 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:49.440672 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac3a1a-b17a-45e9-9a52-3927766a5f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:49.441433 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac3a1a-b17a-45e9-9a52-3927766a5f4c admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:49.441666 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac3a1a-b17a-45e9-9a52-3927766a5f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:49.441946 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac3a1a-b17a-45e9-9a52-3927766a5f4c admin admin] PATH_INFO: `/v3/projects/7fc92fe593f8477c9880b3794534d2d2/users/0f9dae825df9438b8cb9f7315eb642d2/roles/0c67797d444d4c929b2ccab47c468848` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:49.464091 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdac3a1a-b17a-45e9-9a52-3927766a5f4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fc92fe593f8477c9880b3794534d2d2, user_id=0f9dae825df9438b8cb9f7315eb642d2, role_id=0c67797d444d4c929b2ccab47c468848)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:49.466945 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdac3a1a-b17a-45e9-9a52-3927766a5f4c admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:49.486192 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1165/2327] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:50:49 2022] PUT /identity/v3/projects/7fc92fe593f8477c9880b3794534d2d2/users/0f9dae825df9438b8cb9f7315eb642d2/roles/0c67797d444d4c929b2ccab47c468848 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:49.496823 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5ac33-723c-4788-8d24-d50977c707a9 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:49.497298 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5ac33-723c-4788-8d24-d50977c707a9 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:49.497430 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5ac33-723c-4788-8d24-d50977c707a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:49.535601 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-fcc5ac33-723c-4788-8d24-d50977c707a9 None None] MFA Rules not processed for user `0f9dae825df9438b8cb9f7315eb642d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:49.536854 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-fcc5ac33-723c-4788-8d24-d50977c707a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:49.603064 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1163/2328] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:50:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:49.614165 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac3a1a-b17a-45e9-9a52-3927766a5f4c admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:49.616304 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-bdac3a1a-b17a-45e9-9a52-3927766a5f4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:49.691033 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac3a1a-b17a-45e9-9a52-3927766a5f4c admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:49.696633 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a53ab2-0e85-4c70-b455-1a253a00bea1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35441c061e514b1b9341e7694ec2c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:49.697235 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a53ab2-0e85-4c70-b455-1a253a00bea1 service nova] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:49.697544 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a53ab2-0e85-4c70-b455-1a253a00bea1 service nova] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:49.697816 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a53ab2-0e85-4c70-b455-1a253a00bea1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:49.705544 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a53ab2-0e85-4c70-b455-1a253a00bea1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:49.707162 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a53ab2-0e85-4c70-b455-1a253a00bea1 service nova] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:49.716511 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1166/2329] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:50:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:50:49.918298 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc5ac33-723c-4788-8d24-d50977c707a9 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:49.985178 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc5ac33-723c-4788-8d24-d50977c707a9 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:49.989759 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e7a783-c825-43ea-b57d-8b1d499cdd74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:49.990392 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e7a783-c825-43ea-b57d-8b1d499cdd74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:49.990677 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e7a783-c825-43ea-b57d-8b1d499cdd74 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:49.990955 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e7a783-c825-43ea-b57d-8b1d499cdd74 admin admin] PATH_INFO: `/v3/users/0f9dae825df9438b8cb9f7315eb642d2` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:49.992094 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e7a783-c825-43ea-b57d-8b1d499cdd74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f9dae825df9438b8cb9f7315eb642d2)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:49.994271 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e7a783-c825-43ea-b57d-8b1d499cdd74 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:50.036294 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:50.047182 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-d4e7a783-c825-43ea-b57d-8b1d499cdd74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f9dae825df9438b8cb9f7315eb642d2'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:50.055194 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-d4e7a783-c825-43ea-b57d-8b1d499cdd74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f9dae825df9438b8cb9f7315eb642d2'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:50.056131 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-d4e7a783-c825-43ea-b57d-8b1d499cdd74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f9dae825df9438b8cb9f7315eb642d2'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:50.068308 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-d4e7a783-c825-43ea-b57d-8b1d499cdd74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f9dae825df9438b8cb9f7315eb642d2'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:50.079088 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-d4e7a783-c825-43ea-b57d-8b1d499cdd74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f9dae825df9438b8cb9f7315eb642d2'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:50.086894 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1164/2330] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:50:49 2022] DELETE /identity/v3/users/0f9dae825df9438b8cb9f7315eb642d2 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:50.091736 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b17ef7-b89a-4ab9-928a-6b2d4581f877 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:50.092031 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b17ef7-b89a-4ab9-928a-6b2d4581f877 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:50.092311 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b17ef7-b89a-4ab9-928a-6b2d4581f877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:50.099489 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:50.113851 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-d3b17ef7-b89a-4ab9-928a-6b2d4581f877 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:50.115076 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-d3b17ef7-b89a-4ab9-928a-6b2d4581f877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:50.175216 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1167/2331] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:50:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:50.185571 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e7a783-c825-43ea-b57d-8b1d499cdd74 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:50.186965 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-d4e7a783-c825-43ea-b57d-8b1d499cdd74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:50.243779 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e7a783-c825-43ea-b57d-8b1d499cdd74 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:50.247423 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42568d9-36a1-492f-be06-d3e0f0a59155 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:50.248022 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42568d9-36a1-492f-be06-d3e0f0a59155 service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:50.248298 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42568d9-36a1-492f-be06-d3e0f0a59155 service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:50.248570 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42568d9-36a1-492f-be06-d3e0f0a59155 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:50.258238 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42568d9-36a1-492f-be06-d3e0f0a59155 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:50.259681 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42568d9-36a1-492f-be06-d3e0f0a59155 service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:50.269448 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1165/2332] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:50:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:50:50.544355 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b17ef7-b89a-4ab9-928a-6b2d4581f877 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:50.546072 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-d3b17ef7-b89a-4ab9-928a-6b2d4581f877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:50.558580 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b17ef7-b89a-4ab9-928a-6b2d4581f877 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:50.563462 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e2510-58a5-48aa-8a4b-8cee9fccc8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:50.564079 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e2510-58a5-48aa-8a4b-8cee9fccc8b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:50.564357 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e2510-58a5-48aa-8a4b-8cee9fccc8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:50.564628 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e2510-58a5-48aa-8a4b-8cee9fccc8b5 admin admin] PATH_INFO: `/v3/projects/7fc92fe593f8477c9880b3794534d2d2` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:50.565936 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80e2510-58a5-48aa-8a4b-8cee9fccc8b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fc92fe593f8477c9880b3794534d2d2)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:50.567841 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80e2510-58a5-48aa-8a4b-8cee9fccc8b5 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:50.625198 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-c80e2510-58a5-48aa-8a4b-8cee9fccc8b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fc92fe593f8477c9880b3794534d2d2', 'request_id': 'req-c80e2510-58a5-48aa-8a4b-8cee9fccc8b5'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:50.631656 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-c80e2510-58a5-48aa-8a4b-8cee9fccc8b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fc92fe593f8477c9880b3794534d2d2', 'request_id': 'req-c80e2510-58a5-48aa-8a4b-8cee9fccc8b5'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:50.638507 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-c80e2510-58a5-48aa-8a4b-8cee9fccc8b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fc92fe593f8477c9880b3794534d2d2', 'request_id': 'req-c80e2510-58a5-48aa-8a4b-8cee9fccc8b5'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:50.651536 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-c80e2510-58a5-48aa-8a4b-8cee9fccc8b5 admin admin] The token cache is being invalidate because project 7fc92fe593f8477c9880b3794534d2d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:50:50.651830 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-c80e2510-58a5-48aa-8a4b-8cee9fccc8b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:50.652497 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-c80e2510-58a5-48aa-8a4b-8cee9fccc8b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:50:50.654074 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1168/2333] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:50:50 2022] DELETE /identity/v3/projects/7fc92fe593f8477c9880b3794534d2d2 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:50:50.659334 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec83b1f-b121-4844-a47f-911fa5969db6 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:50.659826 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec83b1f-b121-4844-a47f-911fa5969db6 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:50.659939 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec83b1f-b121-4844-a47f-911fa5969db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:50.680897 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-fec83b1f-b121-4844-a47f-911fa5969db6 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:50.682144 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-fec83b1f-b121-4844-a47f-911fa5969db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:50.741387 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1166/2334] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:50:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:50.751498 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dcc0f3-3bf3-4a16-ad2c-9e24a845a4f8 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:50.751782 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dcc0f3-3bf3-4a16-ad2c-9e24a845a4f8 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:50.752052 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dcc0f3-3bf3-4a16-ad2c-9e24a845a4f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:50.771533 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-f0dcc0f3-3bf3-4a16-ad2c-9e24a845a4f8 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:50.772765 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-f0dcc0f3-3bf3-4a16-ad2c-9e24a845a4f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:50.780956 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1169/2335] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:50:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:50.785224 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec83b1f-b121-4844-a47f-911fa5969db6 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:50.795767 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec83b1f-b121-4844-a47f-911fa5969db6 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:50.800398 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a664e5af-9e86-49fb-ae2a-1be8bc1245d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:50.801012 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a664e5af-9e86-49fb-ae2a-1be8bc1245d0 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:50.801294 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a664e5af-9e86-49fb-ae2a-1be8bc1245d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:50.801604 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a664e5af-9e86-49fb-ae2a-1be8bc1245d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:50.802254 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a664e5af-9e86-49fb-ae2a-1be8bc1245d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:50:50.802556 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a664e5af-9e86-49fb-ae2a-1be8bc1245d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:50.804817 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a664e5af-9e86-49fb-ae2a-1be8bc1245d0 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:50.816654 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1167/2336] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Aug 29 22:50:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:50:50.821319 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dcc0f3-3bf3-4a16-ad2c-9e24a845a4f8 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:50.830711 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dcc0f3-3bf3-4a16-ad2c-9e24a845a4f8 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:50.836105 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0eee06-2e5c-45e4-be1d-5c0332e70ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:50.836701 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0eee06-2e5c-45e4-be1d-5c0332e70ba4 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:50.836980 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0eee06-2e5c-45e4-be1d-5c0332e70ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:50.837252 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0eee06-2e5c-45e4-be1d-5c0332e70ba4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:50.837923 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0eee06-2e5c-45e4-be1d-5c0332e70ba4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:50.839836 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0eee06-2e5c-45e4-be1d-5c0332e70ba4 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:50.868474 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1170/2337] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:50:50 2022] POST /identity/v3/projects => generated 357 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:50:50.872539 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a664e5af-9e86-49fb-ae2a-1be8bc1245d0 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:50.883472 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a664e5af-9e86-49fb-ae2a-1be8bc1245d0 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:50.925581 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:50.942718 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16d2f12-2ad7-45ab-84ae-bb2cb7a7d8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:50.943318 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d2f12-2ad7-45ab-84ae-bb2cb7a7d8d0 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:50.943595 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d2f12-2ad7-45ab-84ae-bb2cb7a7d8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:50.943863 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d2f12-2ad7-45ab-84ae-bb2cb7a7d8d0 admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:50.944492 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16d2f12-2ad7-45ab-84ae-bb2cb7a7d8d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:50.947433 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16d2f12-2ad7-45ab-84ae-bb2cb7a7d8d0 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:50.969990 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1168/2338] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:50:50 2022] POST /identity/v3/users => generated 279 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:50:50.974186 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0eee06-2e5c-45e4-be1d-5c0332e70ba4 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:50.984669 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0eee06-2e5c-45e4-be1d-5c0332e70ba4 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:50.989318 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64564b6b-efc8-4bfa-a7f8-11b410cbab7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:50.989940 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64564b6b-efc8-4bfa-a7f8-11b410cbab7b admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:50.990224 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64564b6b-efc8-4bfa-a7f8-11b410cbab7b admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:50.990495 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64564b6b-efc8-4bfa-a7f8-11b410cbab7b admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:50.991163 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64564b6b-efc8-4bfa-a7f8-11b410cbab7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:50.993564 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64564b6b-efc8-4bfa-a7f8-11b410cbab7b admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:51.003942 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1171/2339] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:50:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:50:51.008678 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16d2f12-2ad7-45ab-84ae-bb2cb7a7d8d0 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:51.018755 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16d2f12-2ad7-45ab-84ae-bb2cb7a7d8d0 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:51.023870 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48ceb2c-b0b7-4a96-acdc-0f13d95a396d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:51.024159 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ceb2c-b0b7-4a96-acdc-0f13d95a396d admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:51.024441 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ceb2c-b0b7-4a96-acdc-0f13d95a396d admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:51.024705 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ceb2c-b0b7-4a96-acdc-0f13d95a396d admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:51.025371 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48ceb2c-b0b7-4a96-acdc-0f13d95a396d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:51.026972 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48ceb2c-b0b7-4a96-acdc-0f13d95a396d admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:51.038175 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1169/2340] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:50:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:50:51.042520 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64564b6b-efc8-4bfa-a7f8-11b410cbab7b admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:51.052543 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64564b6b-efc8-4bfa-a7f8-11b410cbab7b admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:51.059060 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dacfe2-ceee-4a63-911a-6d40570f3792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:51.059710 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dacfe2-ceee-4a63-911a-6d40570f3792 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:51.059991 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dacfe2-ceee-4a63-911a-6d40570f3792 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:51.060266 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dacfe2-ceee-4a63-911a-6d40570f3792 admin admin] PATH_INFO: `/v3/projects/32310ecd35fd4eac87c3d0f838594822/users/097e67c74aee4f96a04b51d95671c75f/roles/0c67797d444d4c929b2ccab47c468848` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:51.075652 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dacfe2-ceee-4a63-911a-6d40570f3792 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32310ecd35fd4eac87c3d0f838594822, user_id=097e67c74aee4f96a04b51d95671c75f, role_id=0c67797d444d4c929b2ccab47c468848)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:51.078356 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dacfe2-ceee-4a63-911a-6d40570f3792 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:51.092413 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1172/2341] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:50:51 2022] PUT /identity/v3/projects/32310ecd35fd4eac87c3d0f838594822/users/097e67c74aee4f96a04b51d95671c75f/roles/0c67797d444d4c929b2ccab47c468848 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:50:51.102806 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bdb028-d179-40ba-9217-894f0482e5bf None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:51.103093 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bdb028-d179-40ba-9217-894f0482e5bf None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:51.103364 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bdb028-d179-40ba-9217-894f0482e5bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:51.134682 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-f0bdb028-d179-40ba-9217-894f0482e5bf None None] MFA Rules not processed for user `097e67c74aee4f96a04b51d95671c75f`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:51.135849 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-f0bdb028-d179-40ba-9217-894f0482e5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:51.213180 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1170/2342] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:50:51 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:51.218201 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dacfe2-ceee-4a63-911a-6d40570f3792 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:51.245059 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:51.285092 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dacfe2-ceee-4a63-911a-6d40570f3792 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:51.290530 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbc0c26-6f4d-465c-b168-681cfb4e8adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:51.291132 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc0c26-6f4d-465c-b168-681cfb4e8adf admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:51.291415 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc0c26-6f4d-465c-b168-681cfb4e8adf admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:51.291685 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc0c26-6f4d-465c-b168-681cfb4e8adf admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:51.292316 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbc0c26-6f4d-465c-b168-681cfb4e8adf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:51.294280 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbc0c26-6f4d-465c-b168-681cfb4e8adf admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:51.322464 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1173/2343] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:50:51 2022] POST /identity/v3/projects => generated 355 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:50:51.327851 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bdb028-d179-40ba-9217-894f0482e5bf None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:51.338854 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bdb028-d179-40ba-9217-894f0482e5bf None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:51.396807 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8855daa-b7cc-4239-afb1-037f87724bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:51.397361 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8855daa-b7cc-4239-afb1-037f87724bc3 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:51.397659 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8855daa-b7cc-4239-afb1-037f87724bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:51.398052 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8855daa-b7cc-4239-afb1-037f87724bc3 admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:51.398696 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8855daa-b7cc-4239-afb1-037f87724bc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:51.400610 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8855daa-b7cc-4239-afb1-037f87724bc3 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:51.424936 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1171/2344] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:50:51 2022] POST /identity/v3/users => generated 284 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:50:51.426191 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbc0c26-6f4d-465c-b168-681cfb4e8adf admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:51.437516 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbc0c26-6f4d-465c-b168-681cfb4e8adf admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:51.442429 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec366ee-ca11-4d60-aed5-aa3a9976659f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:51.443031 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec366ee-ca11-4d60-aed5-aa3a9976659f admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:51.443309 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec366ee-ca11-4d60-aed5-aa3a9976659f admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:51.443578 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec366ee-ca11-4d60-aed5-aa3a9976659f admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:51.444211 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec366ee-ca11-4d60-aed5-aa3a9976659f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:51.446170 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec366ee-ca11-4d60-aed5-aa3a9976659f admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:51.456622 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1174/2345] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:50:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:50:51.460719 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8855daa-b7cc-4239-afb1-037f87724bc3 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:51.471362 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8855daa-b7cc-4239-afb1-037f87724bc3 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:51.476495 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fad1ad-caf4-42dd-9a90-86fbd34227ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:51.477844 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fad1ad-caf4-42dd-9a90-86fbd34227ea admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:51.478123 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fad1ad-caf4-42dd-9a90-86fbd34227ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:51.478405 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fad1ad-caf4-42dd-9a90-86fbd34227ea admin admin] PATH_INFO: `/v3/projects/1ab41eb564254e2cae175752657850f6/users/4135b93a4e82470892d8e105ea375121/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:51.493781 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fad1ad-caf4-42dd-9a90-86fbd34227ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ab41eb564254e2cae175752657850f6, user_id=4135b93a4e82470892d8e105ea375121, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:51.496472 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fad1ad-caf4-42dd-9a90-86fbd34227ea admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:51.508865 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1172/2346] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:50:51 2022] PUT /identity/v3/projects/1ab41eb564254e2cae175752657850f6/users/4135b93a4e82470892d8e105ea375121/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:51.512870 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec366ee-ca11-4d60-aed5-aa3a9976659f admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:51.523143 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec366ee-ca11-4d60-aed5-aa3a9976659f admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:51.579630 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a7bece-1ac6-4a39-9bfb-e730823cca06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:51.580311 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7bece-1ac6-4a39-9bfb-e730823cca06 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:51.580534 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7bece-1ac6-4a39-9bfb-e730823cca06 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:51.580807 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7bece-1ac6-4a39-9bfb-e730823cca06 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:51.581479 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a7bece-1ac6-4a39-9bfb-e730823cca06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:51.583074 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a7bece-1ac6-4a39-9bfb-e730823cca06 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:51.593253 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1175/2347] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:50:51 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:50:51.597497 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fad1ad-caf4-42dd-9a90-86fbd34227ea admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:51.608242 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fad1ad-caf4-42dd-9a90-86fbd34227ea admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:51.612843 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f45b95-210d-4647-93e2-3754825ff29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:51.613517 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f45b95-210d-4647-93e2-3754825ff29a admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:51.613795 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f45b95-210d-4647-93e2-3754825ff29a admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:51.614065 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f45b95-210d-4647-93e2-3754825ff29a admin admin] PATH_INFO: `/v3/projects/1ab41eb564254e2cae175752657850f6/users/4135b93a4e82470892d8e105ea375121/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:51.615945 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f45b95-210d-4647-93e2-3754825ff29a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ab41eb564254e2cae175752657850f6, user_id=4135b93a4e82470892d8e105ea375121, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:51.618802 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f45b95-210d-4647-93e2-3754825ff29a admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:51.628857 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1173/2348] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:50:51 2022] PUT /identity/v3/projects/1ab41eb564254e2cae175752657850f6/users/4135b93a4e82470892d8e105ea375121/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:50:51.639088 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd4b43b-b904-4359-a164-e151491cef83 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:51.639404 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd4b43b-b904-4359-a164-e151491cef83 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:51.639684 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd4b43b-b904-4359-a164-e151491cef83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:51.672183 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-ccd4b43b-b904-4359-a164-e151491cef83 None None] MFA Rules not processed for user `4135b93a4e82470892d8e105ea375121`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:51.673342 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-ccd4b43b-b904-4359-a164-e151491cef83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:51.746265 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1176/2349] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:50:51 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:50:51.758253 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f45b95-210d-4647-93e2-3754825ff29a admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:51.762859 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-d7f45b95-210d-4647-93e2-3754825ff29a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:51.769465 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:51.824090 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f45b95-210d-4647-93e2-3754825ff29a admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:51.827764 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f8850e-a5b9-4698-ba52-8c475ae06372 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:51.828361 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8850e-a5b9-4698-ba52-8c475ae06372 service cinder] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:51.828642 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8850e-a5b9-4698-ba52-8c475ae06372 service cinder] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:51.828910 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8850e-a5b9-4698-ba52-8c475ae06372 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:51.838914 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f8850e-a5b9-4698-ba52-8c475ae06372 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:51.840336 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f8850e-a5b9-4698-ba52-8c475ae06372 service cinder] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:51.850059 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1174/2350] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:50:51 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:50:51.925694 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd4b43b-b904-4359-a164-e151491cef83 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:51.935313 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd4b43b-b904-4359-a164-e151491cef83 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:51.938923 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d364b06d-3572-4062-a79b-af8175531e13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:51.939518 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364b06d-3572-4062-a79b-af8175531e13 service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:51.939801 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364b06d-3572-4062-a79b-af8175531e13 service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:51.940072 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364b06d-3572-4062-a79b-af8175531e13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:51.952829 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:51.999635 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d364b06d-3572-4062-a79b-af8175531e13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:52.001087 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d364b06d-3572-4062-a79b-af8175531e13 service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:52.011141 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1177/2351] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:50:51 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:50:53.739888 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f8850e-a5b9-4698-ba52-8c475ae06372 service cinder] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:53.741461 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-61f8850e-a5b9-4698-ba52-8c475ae06372 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:53.818498 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f8850e-a5b9-4698-ba52-8c475ae06372 service cinder] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:53.825187 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87fcfc9-4f48-497b-831f-2a72a84db4e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35441c061e514b1b9341e7694ec2c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:53.825765 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87fcfc9-4f48-497b-831f-2a72a84db4e5 service nova] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:53.826050 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87fcfc9-4f48-497b-831f-2a72a84db4e5 service nova] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:53.826332 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87fcfc9-4f48-497b-831f-2a72a84db4e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:53.828129 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-f87fcfc9-4f48-497b-831f-2a72a84db4e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:53.844111 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87fcfc9-4f48-497b-831f-2a72a84db4e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:53.846000 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87fcfc9-4f48-497b-831f-2a72a84db4e5 service nova] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:53.860372 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1175/2352] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:50:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:50:53.925750 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d364b06d-3572-4062-a79b-af8175531e13 service cinder] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:53.927354 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-d364b06d-3572-4062-a79b-af8175531e13 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:53.990559 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d364b06d-3572-4062-a79b-af8175531e13 service cinder] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:53.994443 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c041c-30d5-471a-b229-4198a573e9b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:53.995051 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c041c-30d5-471a-b229-4198a573e9b8 service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:53.995322 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c041c-30d5-471a-b229-4198a573e9b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:53.995591 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c041c-30d5-471a-b229-4198a573e9b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:53.997375 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-e64c041c-30d5-471a-b229-4198a573e9b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:54.008031 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64c041c-30d5-471a-b229-4198a573e9b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:54.009688 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64c041c-30d5-471a-b229-4198a573e9b8 service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:54.024455 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1178/2353] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:50:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:50:56.321602 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463835b-ff28-4ac0-94a7-6d294e874121 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:56.322123 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463835b-ff28-4ac0-94a7-6d294e874121 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:56.322322 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463835b-ff28-4ac0-94a7-6d294e874121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:56.345472 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-4463835b-ff28-4ac0-94a7-6d294e874121 None None] MFA Rules not processed for user `e49a4666712746d098ace9e1cb0bf07c`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:50:56.346738 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-4463835b-ff28-4ac0-94a7-6d294e874121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:56.403420 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1176/2354] 10.222.0.47 () {58 vars in 1009 bytes} [Mon Aug 29 22:50:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:50:56.451791 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c041c-30d5-471a-b229-4198a573e9b8 service neutron] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:50:56.453371 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-e64c041c-30d5-471a-b229-4198a573e9b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:50:56.536420 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c041c-30d5-471a-b229-4198a573e9b8 service neutron] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:50:56.541718 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f650068c-98de-449b-bfbd-e996591b01f0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '388d8dea2edf4fb888d42ca878c1434d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:50:56.542547 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f650068c-98de-449b-bfbd-e996591b01f0 service swift] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:50:56.542765 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f650068c-98de-449b-bfbd-e996591b01f0 service swift] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:50:56.543044 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f650068c-98de-449b-bfbd-e996591b01f0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:50:56.551955 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f650068c-98de-449b-bfbd-e996591b01f0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:50:56.553668 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f650068c-98de-449b-bfbd-e996591b01f0 service swift] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:50:56.565440 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1179/2355] 10.222.0.47 () {60 vars in 1384 bytes} [Mon Aug 29 22:50:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 22:51:06.396141 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=83 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:06.561381 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=78 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:07.555663 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4463835b-ff28-4ac0-94a7-6d294e874121 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:07.624299 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4463835b-ff28-4ac0-94a7-6d294e874121 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:07.628908 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabac803-aeb0-489a-8fea-668dec09b808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:07.629567 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabac803-aeb0-489a-8fea-668dec09b808 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:07.629963 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabac803-aeb0-489a-8fea-668dec09b808 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:07.630239 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabac803-aeb0-489a-8fea-668dec09b808 admin admin] PATH_INFO: `/v3/users/097e67c74aee4f96a04b51d95671c75f` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:07.631416 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabac803-aeb0-489a-8fea-668dec09b808 admin admin] RBAC: Authorizing `identity:delete_user(user_id=097e67c74aee4f96a04b51d95671c75f)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:07.634061 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabac803-aeb0-489a-8fea-668dec09b808 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:07.690488 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-aabac803-aeb0-489a-8fea-668dec09b808 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '097e67c74aee4f96a04b51d95671c75f'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:07.698665 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-aabac803-aeb0-489a-8fea-668dec09b808 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '097e67c74aee4f96a04b51d95671c75f'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:07.699354 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-aabac803-aeb0-489a-8fea-668dec09b808 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '097e67c74aee4f96a04b51d95671c75f'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:07.713033 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-aabac803-aeb0-489a-8fea-668dec09b808 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '097e67c74aee4f96a04b51d95671c75f'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:07.720938 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-aabac803-aeb0-489a-8fea-668dec09b808 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '097e67c74aee4f96a04b51d95671c75f'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:07.728308 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1177/2356] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:51:07 2022] DELETE /identity/v3/users/097e67c74aee4f96a04b51d95671c75f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:51:07.732877 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb814a-91fd-47b8-87a3-1012595801d1 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:07.733360 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb814a-91fd-47b8-87a3-1012595801d1 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:07.733595 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb814a-91fd-47b8-87a3-1012595801d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:07.754255 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-c4fb814a-91fd-47b8-87a3-1012595801d1 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:07.755481 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-c4fb814a-91fd-47b8-87a3-1012595801d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:07.818362 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1180/2357] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:51:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:51:07.828881 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabac803-aeb0-489a-8fea-668dec09b808 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:07.830486 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-aabac803-aeb0-489a-8fea-668dec09b808 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:07.907575 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabac803-aeb0-489a-8fea-668dec09b808 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:07.911650 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c117c90-6fbc-4531-a20d-f21b0ba96fbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:07.912274 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c117c90-6fbc-4531-a20d-f21b0ba96fbe service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:07.912553 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c117c90-6fbc-4531-a20d-f21b0ba96fbe service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:07.913819 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c117c90-6fbc-4531-a20d-f21b0ba96fbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:07.923940 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c117c90-6fbc-4531-a20d-f21b0ba96fbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:07.925442 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c117c90-6fbc-4531-a20d-f21b0ba96fbe service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:07.937084 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1178/2358] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:51:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:51:08.224651 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb814a-91fd-47b8-87a3-1012595801d1 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:08.227074 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-c4fb814a-91fd-47b8-87a3-1012595801d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:08.242634 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb814a-91fd-47b8-87a3-1012595801d1 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:08.248258 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e82878d-3d45-4c5d-bd93-d8bd2dce04ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:08.248914 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82878d-3d45-4c5d-bd93-d8bd2dce04ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:08.249254 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82878d-3d45-4c5d-bd93-d8bd2dce04ec admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:08.249455 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82878d-3d45-4c5d-bd93-d8bd2dce04ec admin admin] PATH_INFO: `/v3/projects/32310ecd35fd4eac87c3d0f838594822` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:08.250573 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e82878d-3d45-4c5d-bd93-d8bd2dce04ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=32310ecd35fd4eac87c3d0f838594822)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:08.252505 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e82878d-3d45-4c5d-bd93-d8bd2dce04ec admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:08.301454 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-2e82878d-3d45-4c5d-bd93-d8bd2dce04ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32310ecd35fd4eac87c3d0f838594822', 'request_id': 'req-2e82878d-3d45-4c5d-bd93-d8bd2dce04ec'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:08.307821 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-2e82878d-3d45-4c5d-bd93-d8bd2dce04ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32310ecd35fd4eac87c3d0f838594822', 'request_id': 'req-2e82878d-3d45-4c5d-bd93-d8bd2dce04ec'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:08.313727 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-2e82878d-3d45-4c5d-bd93-d8bd2dce04ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32310ecd35fd4eac87c3d0f838594822', 'request_id': 'req-2e82878d-3d45-4c5d-bd93-d8bd2dce04ec'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:08.326911 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-2e82878d-3d45-4c5d-bd93-d8bd2dce04ec admin admin] The token cache is being invalidate because project 32310ecd35fd4eac87c3d0f838594822 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:51:08.327196 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-2e82878d-3d45-4c5d-bd93-d8bd2dce04ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:08.327832 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-2e82878d-3d45-4c5d-bd93-d8bd2dce04ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:08.329300 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1181/2359] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:51:08 2022] DELETE /identity/v3/projects/32310ecd35fd4eac87c3d0f838594822 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:51:08.333253 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c117c90-6fbc-4531-a20d-f21b0ba96fbe service neutron] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:08.343721 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c117c90-6fbc-4531-a20d-f21b0ba96fbe service neutron] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:08.362194 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:08.402316 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e7d21-41d5-42a0-bf72-646e053d72f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:08.402946 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e7d21-41d5-42a0-bf72-646e053d72f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:08.403224 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e7d21-41d5-42a0-bf72-646e053d72f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:08.403499 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e7d21-41d5-42a0-bf72-646e053d72f0 admin admin] PATH_INFO: `/v3/users/4135b93a4e82470892d8e105ea375121` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:08.404647 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5e7d21-41d5-42a0-bf72-646e053d72f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4135b93a4e82470892d8e105ea375121)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:08.406907 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5e7d21-41d5-42a0-bf72-646e053d72f0 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:08.452564 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-5b5e7d21-41d5-42a0-bf72-646e053d72f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4135b93a4e82470892d8e105ea375121'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:08.459487 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-5b5e7d21-41d5-42a0-bf72-646e053d72f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4135b93a4e82470892d8e105ea375121'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:08.460745 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-5b5e7d21-41d5-42a0-bf72-646e053d72f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4135b93a4e82470892d8e105ea375121'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:08.472627 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-5b5e7d21-41d5-42a0-bf72-646e053d72f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4135b93a4e82470892d8e105ea375121'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:08.480818 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-5b5e7d21-41d5-42a0-bf72-646e053d72f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4135b93a4e82470892d8e105ea375121'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:08.486819 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1179/2360] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:51:08 2022] DELETE /identity/v3/users/4135b93a4e82470892d8e105ea375121 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:51:08.769808 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e82878d-3d45-4c5d-bd93-d8bd2dce04ec admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:08.771292 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-2e82878d-3d45-4c5d-bd93-d8bd2dce04ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:08.785266 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e82878d-3d45-4c5d-bd93-d8bd2dce04ec admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:08.845860 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b20625-6c4d-4fb7-93f4-0f74d46bf2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:08.846415 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b20625-6c4d-4fb7-93f4-0f74d46bf2ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:08.846695 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b20625-6c4d-4fb7-93f4-0f74d46bf2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:08.846972 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b20625-6c4d-4fb7-93f4-0f74d46bf2ac admin admin] PATH_INFO: `/v3/projects/1ab41eb564254e2cae175752657850f6` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:08.848092 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b20625-6c4d-4fb7-93f4-0f74d46bf2ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ab41eb564254e2cae175752657850f6)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:08.850061 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b20625-6c4d-4fb7-93f4-0f74d46bf2ac admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:08.880553 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:08.899199 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-a3b20625-6c4d-4fb7-93f4-0f74d46bf2ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ab41eb564254e2cae175752657850f6', 'request_id': 'req-a3b20625-6c4d-4fb7-93f4-0f74d46bf2ac'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:08.905613 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-a3b20625-6c4d-4fb7-93f4-0f74d46bf2ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ab41eb564254e2cae175752657850f6', 'request_id': 'req-a3b20625-6c4d-4fb7-93f4-0f74d46bf2ac'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:08.911150 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-a3b20625-6c4d-4fb7-93f4-0f74d46bf2ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ab41eb564254e2cae175752657850f6', 'request_id': 'req-a3b20625-6c4d-4fb7-93f4-0f74d46bf2ac'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:08.923828 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-a3b20625-6c4d-4fb7-93f4-0f74d46bf2ac admin admin] The token cache is being invalidate because project 1ab41eb564254e2cae175752657850f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:51:08.924111 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-a3b20625-6c4d-4fb7-93f4-0f74d46bf2ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:08.924712 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-a3b20625-6c4d-4fb7-93f4-0f74d46bf2ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:08.926241 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1182/2361] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:51:08 2022] DELETE /identity/v3/projects/1ab41eb564254e2cae175752657850f6 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:51:08.933812 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f2bac-7fb2-49d2-9e1d-5820a9d1ab3e None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:08.934313 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f2bac-7fb2-49d2-9e1d-5820a9d1ab3e None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:08.934412 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f2bac-7fb2-49d2-9e1d-5820a9d1ab3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:08.955351 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-f61f2bac-7fb2-49d2-9e1d-5820a9d1ab3e None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:08.956571 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-f61f2bac-7fb2-49d2-9e1d-5820a9d1ab3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:09.017950 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1180/2362] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:51:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:51:09.026136 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1330ec-95db-4d43-8185-9c416ae9441a None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:09.026136 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1330ec-95db-4d43-8185-9c416ae9441a None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:09.026432 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1330ec-95db-4d43-8185-9c416ae9441a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:09.047092 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-ad1330ec-95db-4d43-8185-9c416ae9441a None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:09.048315 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-ad1330ec-95db-4d43-8185-9c416ae9441a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:09.057360 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1183/2363] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:51:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:51:09.061825 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61f2bac-7fb2-49d2-9e1d-5820a9d1ab3e None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:09.072438 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61f2bac-7fb2-49d2-9e1d-5820a9d1ab3e None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:09.077060 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8420351b-4b8c-4425-95fb-d77bf8ccda51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:09.077714 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420351b-4b8c-4425-95fb-d77bf8ccda51 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:09.077998 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420351b-4b8c-4425-95fb-d77bf8ccda51 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:09.078271 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420351b-4b8c-4425-95fb-d77bf8ccda51 admin admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:09.078918 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8420351b-4b8c-4425-95fb-d77bf8ccda51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:51:09.079220 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8420351b-4b8c-4425-95fb-d77bf8ccda51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:09.080810 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8420351b-4b8c-4425-95fb-d77bf8ccda51 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:09.092259 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1181/2364] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Aug 29 22:51:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:51:09.096569 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1330ec-95db-4d43-8185-9c416ae9441a None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:09.106298 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1330ec-95db-4d43-8185-9c416ae9441a None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:09.111075 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa7d2bb-741b-4d10-94e0-7614646e80ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:09.111679 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa7d2bb-741b-4d10-94e0-7614646e80ee admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:09.111956 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa7d2bb-741b-4d10-94e0-7614646e80ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:09.112222 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa7d2bb-741b-4d10-94e0-7614646e80ee admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:09.112860 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa7d2bb-741b-4d10-94e0-7614646e80ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:09.114780 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa7d2bb-741b-4d10-94e0-7614646e80ee admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:09.145318 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1184/2365] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:51:09 2022] POST /identity/v3/projects => generated 367 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:51:09.149849 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8420351b-4b8c-4425-95fb-d77bf8ccda51 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:09.160721 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8420351b-4b8c-4425-95fb-d77bf8ccda51 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:09.189404 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:09.226556 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981fba6a-14cd-4e62-86ab-92d99190d077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:09.227177 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981fba6a-14cd-4e62-86ab-92d99190d077 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:09.227461 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981fba6a-14cd-4e62-86ab-92d99190d077 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:09.227735 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981fba6a-14cd-4e62-86ab-92d99190d077 admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:09.228375 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981fba6a-14cd-4e62-86ab-92d99190d077 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:09.230425 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981fba6a-14cd-4e62-86ab-92d99190d077 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:09.253395 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1182/2366] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:51:09 2022] POST /identity/v3/users => generated 284 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:51:09.257807 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa7d2bb-741b-4d10-94e0-7614646e80ee admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:09.268354 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa7d2bb-741b-4d10-94e0-7614646e80ee admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:09.273364 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0775877-c815-4b44-b600-db50a8f6e7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:09.274010 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0775877-c815-4b44-b600-db50a8f6e7fd admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:09.274290 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0775877-c815-4b44-b600-db50a8f6e7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:09.274611 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0775877-c815-4b44-b600-db50a8f6e7fd admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:09.275259 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0775877-c815-4b44-b600-db50a8f6e7fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:09.276933 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0775877-c815-4b44-b600-db50a8f6e7fd admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:09.287782 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1185/2367] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:51:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:51:09.292450 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981fba6a-14cd-4e62-86ab-92d99190d077 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:09.305363 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981fba6a-14cd-4e62-86ab-92d99190d077 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:09.309448 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237ab44b-6511-4778-b90b-d7f947331c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:09.310069 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237ab44b-6511-4778-b90b-d7f947331c2c admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:09.310352 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237ab44b-6511-4778-b90b-d7f947331c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:09.310629 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237ab44b-6511-4778-b90b-d7f947331c2c admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:09.311469 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237ab44b-6511-4778-b90b-d7f947331c2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:09.312952 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237ab44b-6511-4778-b90b-d7f947331c2c admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:09.324439 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1183/2368] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:51:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:51:09.328565 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0775877-c815-4b44-b600-db50a8f6e7fd admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:09.339230 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0775877-c815-4b44-b600-db50a8f6e7fd admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:09.343826 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dc2fe5-2c49-4449-ab32-c14bb6bf17d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:09.344478 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc2fe5-2c49-4449-ab32-c14bb6bf17d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:09.344755 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc2fe5-2c49-4449-ab32-c14bb6bf17d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:09.345028 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc2fe5-2c49-4449-ab32-c14bb6bf17d6 admin admin] PATH_INFO: `/v3/projects/48aa3cea52444ba8af828a329bdc0a43/users/4b12e2b28921409e8919bccaf24d54c4/roles/0c67797d444d4c929b2ccab47c468848` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:09.361470 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dc2fe5-2c49-4449-ab32-c14bb6bf17d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48aa3cea52444ba8af828a329bdc0a43, user_id=4b12e2b28921409e8919bccaf24d54c4, role_id=0c67797d444d4c929b2ccab47c468848)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:09.364100 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dc2fe5-2c49-4449-ab32-c14bb6bf17d6 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:09.378867 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1186/2369] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:51:09 2022] PUT /identity/v3/projects/48aa3cea52444ba8af828a329bdc0a43/users/4b12e2b28921409e8919bccaf24d54c4/roles/0c67797d444d4c929b2ccab47c468848 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:51:09.389411 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca9e30-949e-4b86-900b-524eb1dbd846 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:09.389707 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca9e30-949e-4b86-900b-524eb1dbd846 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:09.390015 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca9e30-949e-4b86-900b-524eb1dbd846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:09.411386 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dc2fe5-2c49-4449-ab32-c14bb6bf17d6 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:09.414067 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-76dc2fe5-2c49-4449-ab32-c14bb6bf17d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:09.424664 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-30ca9e30-949e-4b86-900b-524eb1dbd846 None None] MFA Rules not processed for user `4b12e2b28921409e8919bccaf24d54c4`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:09.426481 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-30ca9e30-949e-4b86-900b-524eb1dbd846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:09.500536 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dc2fe5-2c49-4449-ab32-c14bb6bf17d6 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:09.504075 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1184/2370] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:51:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:51:09.506461 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8dbf11-cf16-43ab-8863-e595854c3f52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35441c061e514b1b9341e7694ec2c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:09.507238 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8dbf11-cf16-43ab-8863-e595854c3f52 service nova] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:09.507517 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8dbf11-cf16-43ab-8863-e595854c3f52 service nova] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:09.507824 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8dbf11-cf16-43ab-8863-e595854c3f52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:09.508739 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca9e30-949e-4b86-900b-524eb1dbd846 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:09.509641 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-6f8dbf11-cf16-43ab-8863-e595854c3f52 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:09.522224 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8dbf11-cf16-43ab-8863-e595854c3f52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:09.523885 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8dbf11-cf16-43ab-8863-e595854c3f52 service nova] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:09.534975 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1187/2371] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:51:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:51:09.579591 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca9e30-949e-4b86-900b-524eb1dbd846 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:09.584263 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dd48ec-bfd5-4b58-b6a1-18547ffa4b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:09.585451 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd48ec-bfd5-4b58-b6a1-18547ffa4b49 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:09.585793 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd48ec-bfd5-4b58-b6a1-18547ffa4b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:09.586077 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd48ec-bfd5-4b58-b6a1-18547ffa4b49 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:09.586708 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dd48ec-bfd5-4b58-b6a1-18547ffa4b49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:09.588632 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dd48ec-bfd5-4b58-b6a1-18547ffa4b49 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:09.617791 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1185/2372] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:51:09 2022] POST /identity/v3/projects => generated 369 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:51:09.621841 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8dbf11-cf16-43ab-8863-e595854c3f52 service nova] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:09.634326 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8dbf11-cf16-43ab-8863-e595854c3f52 service nova] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:09.669847 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:09.696154 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab79774-966e-45ec-a8f1-4443b7a30dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:09.696761 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab79774-966e-45ec-a8f1-4443b7a30dfd admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:09.697042 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab79774-966e-45ec-a8f1-4443b7a30dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:09.697317 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab79774-966e-45ec-a8f1-4443b7a30dfd admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:09.697967 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab79774-966e-45ec-a8f1-4443b7a30dfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:09.699902 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab79774-966e-45ec-a8f1-4443b7a30dfd admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:09.721768 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1188/2373] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:51:09 2022] POST /identity/v3/users => generated 291 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:51:09.726460 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dd48ec-bfd5-4b58-b6a1-18547ffa4b49 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:09.736847 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dd48ec-bfd5-4b58-b6a1-18547ffa4b49 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:09.741961 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68ad958-6e37-4ba7-a1ed-7a82c7ff9bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:09.742570 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ad958-6e37-4ba7-a1ed-7a82c7ff9bde admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:09.742861 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ad958-6e37-4ba7-a1ed-7a82c7ff9bde admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:09.743138 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ad958-6e37-4ba7-a1ed-7a82c7ff9bde admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:09.743814 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68ad958-6e37-4ba7-a1ed-7a82c7ff9bde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:09.745491 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68ad958-6e37-4ba7-a1ed-7a82c7ff9bde admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:09.755554 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1186/2374] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:51:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:51:09.760007 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab79774-966e-45ec-a8f1-4443b7a30dfd admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:09.770041 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab79774-966e-45ec-a8f1-4443b7a30dfd admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:09.775548 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4d4f81-2161-4c10-ba49-b55b453c3a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:09.776192 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d4f81-2161-4c10-ba49-b55b453c3a6e admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:09.776474 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d4f81-2161-4c10-ba49-b55b453c3a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:09.776752 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d4f81-2161-4c10-ba49-b55b453c3a6e admin admin] PATH_INFO: `/v3/projects/4f708b6be3eb4eb484bfa2550c32bc4d/users/f1301886e72c40778e4abecf8c4598f0/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:09.792549 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4d4f81-2161-4c10-ba49-b55b453c3a6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f708b6be3eb4eb484bfa2550c32bc4d, user_id=f1301886e72c40778e4abecf8c4598f0, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:09.795265 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4d4f81-2161-4c10-ba49-b55b453c3a6e admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:09.808403 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1189/2375] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:51:09 2022] PUT /identity/v3/projects/4f708b6be3eb4eb484bfa2550c32bc4d/users/f1301886e72c40778e4abecf8c4598f0/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:51:09.812346 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68ad958-6e37-4ba7-a1ed-7a82c7ff9bde admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:09.823210 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68ad958-6e37-4ba7-a1ed-7a82c7ff9bde admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:09.832353 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:09.906809 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6471d4-afe0-4d04-b15e-9484c06b9909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:09.907435 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6471d4-afe0-4d04-b15e-9484c06b9909 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:09.907717 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6471d4-afe0-4d04-b15e-9484c06b9909 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:09.907987 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6471d4-afe0-4d04-b15e-9484c06b9909 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:09.908626 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6471d4-afe0-4d04-b15e-9484c06b9909 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:09.910304 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6471d4-afe0-4d04-b15e-9484c06b9909 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:09.923200 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1187/2376] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:51:09 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:51:09.927448 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4d4f81-2161-4c10-ba49-b55b453c3a6e admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:09.939302 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4d4f81-2161-4c10-ba49-b55b453c3a6e admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:09.943825 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d08cee-a22c-4b22-8ce5-0c9cb8b4aa91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:09.944519 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d08cee-a22c-4b22-8ce5-0c9cb8b4aa91 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:09.944786 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d08cee-a22c-4b22-8ce5-0c9cb8b4aa91 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:09.945067 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d08cee-a22c-4b22-8ce5-0c9cb8b4aa91 admin admin] PATH_INFO: `/v3/projects/4f708b6be3eb4eb484bfa2550c32bc4d/users/f1301886e72c40778e4abecf8c4598f0/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:09.947013 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d08cee-a22c-4b22-8ce5-0c9cb8b4aa91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f708b6be3eb4eb484bfa2550c32bc4d, user_id=f1301886e72c40778e4abecf8c4598f0, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:09.949701 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d08cee-a22c-4b22-8ce5-0c9cb8b4aa91 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:09.961986 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1190/2377] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:51:09 2022] PUT /identity/v3/projects/4f708b6be3eb4eb484bfa2550c32bc4d/users/f1301886e72c40778e4abecf8c4598f0/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:51:09.972793 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7f5a2-ebcd-4891-9db3-6258e84e96c4 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:09.973250 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7f5a2-ebcd-4891-9db3-6258e84e96c4 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:09.973369 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7f5a2-ebcd-4891-9db3-6258e84e96c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:10.002631 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-afb7f5a2-ebcd-4891-9db3-6258e84e96c4 None None] MFA Rules not processed for user `f1301886e72c40778e4abecf8c4598f0`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:10.004096 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-afb7f5a2-ebcd-4891-9db3-6258e84e96c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:10.076552 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1188/2378] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:51:09 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:51:10.088701 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d08cee-a22c-4b22-8ce5-0c9cb8b4aa91 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:10.090457 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-a6d08cee-a22c-4b22-8ce5-0c9cb8b4aa91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:10.152971 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d08cee-a22c-4b22-8ce5-0c9cb8b4aa91 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:10.158272 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1066b7c7-7aaf-49f2-93a0-7dec86f29b7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:10.158995 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066b7c7-7aaf-49f2-93a0-7dec86f29b7e service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:10.159349 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066b7c7-7aaf-49f2-93a0-7dec86f29b7e service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:10.159694 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066b7c7-7aaf-49f2-93a0-7dec86f29b7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:10.170343 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1066b7c7-7aaf-49f2-93a0-7dec86f29b7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:10.171826 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1066b7c7-7aaf-49f2-93a0-7dec86f29b7e service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:10.181774 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1191/2379] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:51:10 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:51:12.101143 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7f5a2-ebcd-4891-9db3-6258e84e96c4 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:12.186911 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7f5a2-ebcd-4891-9db3-6258e84e96c4 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:12.192244 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb116c-cae7-4bd6-a891-c71da2d0845a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:12.193545 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb116c-cae7-4bd6-a891-c71da2d0845a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:12.193889 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb116c-cae7-4bd6-a891-c71da2d0845a admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:12.194774 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb116c-cae7-4bd6-a891-c71da2d0845a admin admin] PATH_INFO: `/v3/users/4b12e2b28921409e8919bccaf24d54c4` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:12.197042 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcb116c-cae7-4bd6-a891-c71da2d0845a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b12e2b28921409e8919bccaf24d54c4)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:12.198351 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcb116c-cae7-4bd6-a891-c71da2d0845a admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:12.250227 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:12.266937 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-0fcb116c-cae7-4bd6-a891-c71da2d0845a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b12e2b28921409e8919bccaf24d54c4'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:12.276052 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-0fcb116c-cae7-4bd6-a891-c71da2d0845a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b12e2b28921409e8919bccaf24d54c4'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:12.276802 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-0fcb116c-cae7-4bd6-a891-c71da2d0845a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b12e2b28921409e8919bccaf24d54c4'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:12.293950 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-0fcb116c-cae7-4bd6-a891-c71da2d0845a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b12e2b28921409e8919bccaf24d54c4'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:12.307869 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-0fcb116c-cae7-4bd6-a891-c71da2d0845a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b12e2b28921409e8919bccaf24d54c4'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:12.311586 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1189/2380] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:51:12 2022] DELETE /identity/v3/users/4b12e2b28921409e8919bccaf24d54c4 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:51:12.316175 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997baab9-b35f-41db-9718-f77ca5fa3bd3 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:12.316625 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997baab9-b35f-41db-9718-f77ca5fa3bd3 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:12.316750 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997baab9-b35f-41db-9718-f77ca5fa3bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:12.338206 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-997baab9-b35f-41db-9718-f77ca5fa3bd3 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:12.339436 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-997baab9-b35f-41db-9718-f77ca5fa3bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:12.433448 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1192/2381] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:51:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:51:12.440697 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb116c-cae7-4bd6-a891-c71da2d0845a admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:12.442305 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-0fcb116c-cae7-4bd6-a891-c71da2d0845a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:12.525068 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb116c-cae7-4bd6-a891-c71da2d0845a admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:12.530927 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca8b65d-a4fb-4b27-ad7a-7aecbf620310 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:12.531681 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca8b65d-a4fb-4b27-ad7a-7aecbf620310 service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:12.532066 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca8b65d-a4fb-4b27-ad7a-7aecbf620310 service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:12.532554 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca8b65d-a4fb-4b27-ad7a-7aecbf620310 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:12.545422 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca8b65d-a4fb-4b27-ad7a-7aecbf620310 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:12.547165 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca8b65d-a4fb-4b27-ad7a-7aecbf620310 service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:12.559897 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1190/2382] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:51:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:51:12.983185 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997baab9-b35f-41db-9718-f77ca5fa3bd3 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:12.985026 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-997baab9-b35f-41db-9718-f77ca5fa3bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:13.012077 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997baab9-b35f-41db-9718-f77ca5fa3bd3 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:13.022258 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548b7798-518f-4c76-9bf4-138f56c862ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:13.023083 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b7798-518f-4c76-9bf4-138f56c862ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:13.026151 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b7798-518f-4c76-9bf4-138f56c862ac admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:13.026550 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b7798-518f-4c76-9bf4-138f56c862ac admin admin] PATH_INFO: `/v3/projects/48aa3cea52444ba8af828a329bdc0a43` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:13.030506 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548b7798-518f-4c76-9bf4-138f56c862ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=48aa3cea52444ba8af828a329bdc0a43)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:13.037137 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548b7798-518f-4c76-9bf4-138f56c862ac admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:13.082705 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:13.104822 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-548b7798-518f-4c76-9bf4-138f56c862ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48aa3cea52444ba8af828a329bdc0a43', 'request_id': 'req-548b7798-518f-4c76-9bf4-138f56c862ac'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:13.111847 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-548b7798-518f-4c76-9bf4-138f56c862ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48aa3cea52444ba8af828a329bdc0a43', 'request_id': 'req-548b7798-518f-4c76-9bf4-138f56c862ac'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:13.118879 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-548b7798-518f-4c76-9bf4-138f56c862ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48aa3cea52444ba8af828a329bdc0a43', 'request_id': 'req-548b7798-518f-4c76-9bf4-138f56c862ac'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:13.134793 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-548b7798-518f-4c76-9bf4-138f56c862ac admin admin] The token cache is being invalidate because project 48aa3cea52444ba8af828a329bdc0a43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:51:13.135447 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-548b7798-518f-4c76-9bf4-138f56c862ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:13.136099 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-548b7798-518f-4c76-9bf4-138f56c862ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:13.138777 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1193/2383] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:51:12 2022] DELETE /identity/v3/projects/48aa3cea52444ba8af828a329bdc0a43 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:51:13.142549 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca8b65d-a4fb-4b27-ad7a-7aecbf620310 service neutron] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:13.153500 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca8b65d-a4fb-4b27-ad7a-7aecbf620310 service neutron] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:13.230503 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345ced28-a5af-4045-b8b4-cd56d564bd1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:13.233737 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ced28-a5af-4045-b8b4-cd56d564bd1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:13.234252 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ced28-a5af-4045-b8b4-cd56d564bd1b admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:13.234688 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ced28-a5af-4045-b8b4-cd56d564bd1b admin admin] PATH_INFO: `/v3/users/f1301886e72c40778e4abecf8c4598f0` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:13.236270 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345ced28-a5af-4045-b8b4-cd56d564bd1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1301886e72c40778e4abecf8c4598f0)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:13.238252 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345ced28-a5af-4045-b8b4-cd56d564bd1b admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:13.331161 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-345ced28-a5af-4045-b8b4-cd56d564bd1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1301886e72c40778e4abecf8c4598f0'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:13.345703 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-345ced28-a5af-4045-b8b4-cd56d564bd1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1301886e72c40778e4abecf8c4598f0'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:13.347518 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-345ced28-a5af-4045-b8b4-cd56d564bd1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1301886e72c40778e4abecf8c4598f0'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:13.350215 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:13.369067 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-345ced28-a5af-4045-b8b4-cd56d564bd1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1301886e72c40778e4abecf8c4598f0'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:13.376914 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-345ced28-a5af-4045-b8b4-cd56d564bd1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1301886e72c40778e4abecf8c4598f0'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:13.384400 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1191/2384] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:51:13 2022] DELETE /identity/v3/users/f1301886e72c40778e4abecf8c4598f0 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:51:13.681991 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548b7798-518f-4c76-9bf4-138f56c862ac admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:13.683602 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-548b7798-518f-4c76-9bf4-138f56c862ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:13.699215 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548b7798-518f-4c76-9bf4-138f56c862ac admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:13.798960 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70b7302-a7d0-4351-bb96-7b93a30e0cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:13.799907 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b7302-a7d0-4351-bb96-7b93a30e0cde admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:13.800192 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b7302-a7d0-4351-bb96-7b93a30e0cde admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:13.800465 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b7302-a7d0-4351-bb96-7b93a30e0cde admin admin] PATH_INFO: `/v3/projects/4f708b6be3eb4eb484bfa2550c32bc4d` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:13.801733 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70b7302-a7d0-4351-bb96-7b93a30e0cde admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f708b6be3eb4eb484bfa2550c32bc4d)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:13.803884 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70b7302-a7d0-4351-bb96-7b93a30e0cde admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:13.873322 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-d70b7302-a7d0-4351-bb96-7b93a30e0cde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f708b6be3eb4eb484bfa2550c32bc4d', 'request_id': 'req-d70b7302-a7d0-4351-bb96-7b93a30e0cde'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:13.880384 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-d70b7302-a7d0-4351-bb96-7b93a30e0cde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f708b6be3eb4eb484bfa2550c32bc4d', 'request_id': 'req-d70b7302-a7d0-4351-bb96-7b93a30e0cde'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:13.887480 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-d70b7302-a7d0-4351-bb96-7b93a30e0cde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f708b6be3eb4eb484bfa2550c32bc4d', 'request_id': 'req-d70b7302-a7d0-4351-bb96-7b93a30e0cde'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:13.902583 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-d70b7302-a7d0-4351-bb96-7b93a30e0cde admin admin] The token cache is being invalidate because project 4f708b6be3eb4eb484bfa2550c32bc4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:51:13.902875 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-d70b7302-a7d0-4351-bb96-7b93a30e0cde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:13.903520 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-d70b7302-a7d0-4351-bb96-7b93a30e0cde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:13.905269 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1194/2385] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:51:13 2022] DELETE /identity/v3/projects/4f708b6be3eb4eb484bfa2550c32bc4d => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:51:13.910556 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f962b4dc-b8e6-474b-9566-64c64634d514 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:13.910851 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f962b4dc-b8e6-474b-9566-64c64634d514 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:13.911132 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f962b4dc-b8e6-474b-9566-64c64634d514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:13.934407 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-f962b4dc-b8e6-474b-9566-64c64634d514 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:13.935650 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-f962b4dc-b8e6-474b-9566-64c64634d514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:14.005128 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1192/2386] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:51:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:51:14.010843 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e2c7ca-b68c-4a8e-8856-85c3e8a484b9 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:14.011166 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e2c7ca-b68c-4a8e-8856-85c3e8a484b9 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:14.011490 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e2c7ca-b68c-4a8e-8856-85c3e8a484b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:14.032474 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-90e2c7ca-b68c-4a8e-8856-85c3e8a484b9 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:14.033764 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-90e2c7ca-b68c-4a8e-8856-85c3e8a484b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:14.042353 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1195/2387] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:51:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:51:14.046910 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f962b4dc-b8e6-474b-9566-64c64634d514 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:14.057256 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f962b4dc-b8e6-474b-9566-64c64634d514 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:14.061997 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff23c414-5f51-496d-95ca-13d82567ae6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:14.062677 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff23c414-5f51-496d-95ca-13d82567ae6e admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:14.063050 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff23c414-5f51-496d-95ca-13d82567ae6e admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:14.063420 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff23c414-5f51-496d-95ca-13d82567ae6e admin admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:14.064178 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff23c414-5f51-496d-95ca-13d82567ae6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:51:14.064548 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff23c414-5f51-496d-95ca-13d82567ae6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:14.066830 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff23c414-5f51-496d-95ca-13d82567ae6e admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:14.083686 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1193/2388] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Aug 29 22:51:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:51:14.090076 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e2c7ca-b68c-4a8e-8856-85c3e8a484b9 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:14.100019 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e2c7ca-b68c-4a8e-8856-85c3e8a484b9 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:14.105055 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c9fcf-cbeb-4295-80d1-4f168e307338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:14.105819 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c9fcf-cbeb-4295-80d1-4f168e307338 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:14.106260 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c9fcf-cbeb-4295-80d1-4f168e307338 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:14.106718 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c9fcf-cbeb-4295-80d1-4f168e307338 admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:14.107519 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1c9fcf-cbeb-4295-80d1-4f168e307338 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:14.109989 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1c9fcf-cbeb-4295-80d1-4f168e307338 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:14.147918 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1196/2389] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:51:14 2022] POST /identity/v3/projects => generated 391 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:51:14.152134 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff23c414-5f51-496d-95ca-13d82567ae6e admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:14.166216 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff23c414-5f51-496d-95ca-13d82567ae6e admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:14.244673 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f3ddd6-1e54-4ab8-a39d-717a3bfc4305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:14.245299 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3ddd6-1e54-4ab8-a39d-717a3bfc4305 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:14.245608 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3ddd6-1e54-4ab8-a39d-717a3bfc4305 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:14.246322 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3ddd6-1e54-4ab8-a39d-717a3bfc4305 admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:14.246856 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f3ddd6-1e54-4ab8-a39d-717a3bfc4305 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:14.249179 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f3ddd6-1e54-4ab8-a39d-717a3bfc4305 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:14.277069 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1194/2390] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:51:14 2022] POST /identity/v3/users => generated 296 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:51:14.278291 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c9fcf-cbeb-4295-80d1-4f168e307338 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:14.290239 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c9fcf-cbeb-4295-80d1-4f168e307338 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:14.295275 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e17fa2c-9c24-4a6b-82a5-8197cca5b128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:14.296164 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17fa2c-9c24-4a6b-82a5-8197cca5b128 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:14.296515 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17fa2c-9c24-4a6b-82a5-8197cca5b128 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:14.296860 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17fa2c-9c24-4a6b-82a5-8197cca5b128 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:14.297640 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e17fa2c-9c24-4a6b-82a5-8197cca5b128 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:14.299465 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e17fa2c-9c24-4a6b-82a5-8197cca5b128 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:14.317537 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1197/2391] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:51:14 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:51:14.318919 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f3ddd6-1e54-4ab8-a39d-717a3bfc4305 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:14.330090 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f3ddd6-1e54-4ab8-a39d-717a3bfc4305 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:14.334935 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54b7f10-3fc8-4222-98cb-eadbece4dbf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:14.335593 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b7f10-3fc8-4222-98cb-eadbece4dbf1 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:14.336113 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b7f10-3fc8-4222-98cb-eadbece4dbf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:14.336387 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b7f10-3fc8-4222-98cb-eadbece4dbf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:14.337036 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54b7f10-3fc8-4222-98cb-eadbece4dbf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:14.338708 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54b7f10-3fc8-4222-98cb-eadbece4dbf1 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:14.351700 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1195/2392] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:51:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:51:14.355809 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e17fa2c-9c24-4a6b-82a5-8197cca5b128 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:14.364417 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:14.370126 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e17fa2c-9c24-4a6b-82a5-8197cca5b128 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:14.377556 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a3a568-2c74-43a9-bbf6-595224f5abea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:14.378516 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a3a568-2c74-43a9-bbf6-595224f5abea admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:14.379295 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a3a568-2c74-43a9-bbf6-595224f5abea admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:14.379746 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a3a568-2c74-43a9-bbf6-595224f5abea admin admin] PATH_INFO: `/v3/projects/921b72b93d1b4704927483bb1a6ff806/users/f7f98a5c01e44311acf93f2179a08f7d/roles/0c67797d444d4c929b2ccab47c468848` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:14.400062 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a3a568-2c74-43a9-bbf6-595224f5abea admin admin] RBAC: Authorizing `identity:create_grant(project_id=921b72b93d1b4704927483bb1a6ff806, user_id=f7f98a5c01e44311acf93f2179a08f7d, role_id=0c67797d444d4c929b2ccab47c468848)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:14.403427 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a3a568-2c74-43a9-bbf6-595224f5abea admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:14.425798 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1198/2393] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:51:14 2022] PUT /identity/v3/projects/921b72b93d1b4704927483bb1a6ff806/users/f7f98a5c01e44311acf93f2179a08f7d/roles/0c67797d444d4c929b2ccab47c468848 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:51:14.434288 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0d5d6-cce0-443f-a1d9-70a314f819e0 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:14.434578 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0d5d6-cce0-443f-a1d9-70a314f819e0 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:14.434959 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0d5d6-cce0-443f-a1d9-70a314f819e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:14.471063 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-a8e0d5d6-cce0-443f-a1d9-70a314f819e0 None None] MFA Rules not processed for user `f7f98a5c01e44311acf93f2179a08f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:14.472768 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-a8e0d5d6-cce0-443f-a1d9-70a314f819e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:14.514407 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:14.564559 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1196/2394] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:51:14 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:51:14.569922 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a3a568-2c74-43a9-bbf6-595224f5abea admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:14.655574 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a3a568-2c74-43a9-bbf6-595224f5abea admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:14.656758 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f0f6e4-2b61-4228-ba1e-4877ba5faddd None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:14.657147 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f0f6e4-2b61-4228-ba1e-4877ba5faddd None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:14.657465 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f0f6e4-2b61-4228-ba1e-4877ba5faddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:14.661140 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f20197-a2b3-4260-a8e1-5bd6cb990a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:14.661834 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f20197-a2b3-4260-a8e1-5bd6cb990a54 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:14.662118 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f20197-a2b3-4260-a8e1-5bd6cb990a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:14.662393 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f20197-a2b3-4260-a8e1-5bd6cb990a54 admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:14.663126 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f20197-a2b3-4260-a8e1-5bd6cb990a54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:14.665116 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f20197-a2b3-4260-a8e1-5bd6cb990a54 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:14.680876 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-97f0f6e4-2b61-4228-ba1e-4877ba5faddd None None] MFA Rules not processed for user `e49a4666712746d098ace9e1cb0bf07c`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:14.682151 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-97f0f6e4-2b61-4228-ba1e-4877ba5faddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:14.699434 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1199/2395] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:51:14 2022] POST /identity/v3/projects => generated 391 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:51:14.700504 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f20197-a2b3-4260-a8e1-5bd6cb990a54 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:14.758287 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1197/2396] 10.222.0.47 () {58 vars in 1009 bytes} [Mon Aug 29 22:51:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:51:14.773660 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f0f6e4-2b61-4228-ba1e-4877ba5faddd None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:14.775736 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-97f0f6e4-2b61-4228-ba1e-4877ba5faddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:14.781791 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f20197-a2b3-4260-a8e1-5bd6cb990a54 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:14.786697 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f36a612-415b-4e17-8c21-12df4163e1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:14.787438 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f36a612-415b-4e17-8c21-12df4163e1a5 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:14.788367 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f36a612-415b-4e17-8c21-12df4163e1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:14.788916 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f36a612-415b-4e17-8c21-12df4163e1a5 admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:14.789661 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f36a612-415b-4e17-8c21-12df4163e1a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:14.791687 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f36a612-415b-4e17-8c21-12df4163e1a5 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:14.819922 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1200/2397] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:51:14 2022] POST /identity/v3/users => generated 302 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:51:14.823582 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f36a612-415b-4e17-8c21-12df4163e1a5 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:14.834016 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f36a612-415b-4e17-8c21-12df4163e1a5 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:14.840063 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4544865-09f1-4cb1-8bc2-46f20dd2c0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:14.840675 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4544865-09f1-4cb1-8bc2-46f20dd2c0e8 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:14.840959 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4544865-09f1-4cb1-8bc2-46f20dd2c0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:14.841237 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4544865-09f1-4cb1-8bc2-46f20dd2c0e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:14.841957 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4544865-09f1-4cb1-8bc2-46f20dd2c0e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:14.843598 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4544865-09f1-4cb1-8bc2-46f20dd2c0e8 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:14.856803 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1201/2398] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:51:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:51:14.860860 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4544865-09f1-4cb1-8bc2-46f20dd2c0e8 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:14.865865 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f0f6e4-2b61-4228-ba1e-4877ba5faddd None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:14.872243 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4544865-09f1-4cb1-8bc2-46f20dd2c0e8 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:14.880495 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc6570a-0ae7-4ea2-9932-ba95e1fabfd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:14.881561 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6570a-0ae7-4ea2-9932-ba95e1fabfd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:14.881910 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6570a-0ae7-4ea2-9932-ba95e1fabfd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:14.882186 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6570a-0ae7-4ea2-9932-ba95e1fabfd5 admin admin] PATH_INFO: `/v3/projects/90972cfa69704e9788e8eb3609da031d/users/7ea9c624cf924059956c89982eb614c1/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:14.899989 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc6570a-0ae7-4ea2-9932-ba95e1fabfd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90972cfa69704e9788e8eb3609da031d, user_id=7ea9c624cf924059956c89982eb614c1, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:14.903734 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc6570a-0ae7-4ea2-9932-ba95e1fabfd5 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:14.925592 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1202/2399] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:51:14 2022] PUT /identity/v3/projects/90972cfa69704e9788e8eb3609da031d/users/7ea9c624cf924059956c89982eb614c1/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:51:14.929835 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc6570a-0ae7-4ea2-9932-ba95e1fabfd5 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:14.950859 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ac14fe-ccce-452e-ab6e-a435e2014174 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '388d8dea2edf4fb888d42ca878c1434d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:14.951478 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac14fe-ccce-452e-ab6e-a435e2014174 service swift] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:14.951757 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac14fe-ccce-452e-ab6e-a435e2014174 service swift] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:14.952218 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac14fe-ccce-452e-ab6e-a435e2014174 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:14.959027 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:14.977600 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:15.014869 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc6570a-0ae7-4ea2-9932-ba95e1fabfd5 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:15.020186 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a028311-15a1-4fd0-a163-12e3839c14d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:15.020580 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a028311-15a1-4fd0-a163-12e3839c14d1 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:15.020856 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a028311-15a1-4fd0-a163-12e3839c14d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:15.021126 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a028311-15a1-4fd0-a163-12e3839c14d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:15.024244 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a028311-15a1-4fd0-a163-12e3839c14d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:15.026150 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a028311-15a1-4fd0-a163-12e3839c14d1 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:15.031734 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ac14fe-ccce-452e-ab6e-a435e2014174 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:15.033481 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ac14fe-ccce-452e-ab6e-a435e2014174 service swift] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:15.043196 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1203/2400] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:51:14 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:51:15.045070 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1198/2401] 10.222.0.47 () {60 vars in 1384 bytes} [Mon Aug 29 22:51:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 22:51:15.047340 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ac14fe-ccce-452e-ab6e-a435e2014174 service swift] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:15.059762 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ac14fe-ccce-452e-ab6e-a435e2014174 service swift] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:15.068338 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f61210-a4bd-44a3-b3ed-7c0a90435720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:15.069247 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f61210-a4bd-44a3-b3ed-7c0a90435720 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:15.069669 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f61210-a4bd-44a3-b3ed-7c0a90435720 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:15.070100 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f61210-a4bd-44a3-b3ed-7c0a90435720 admin admin] PATH_INFO: `/v3/projects/90972cfa69704e9788e8eb3609da031d/users/7ea9c624cf924059956c89982eb614c1/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:15.072169 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f61210-a4bd-44a3-b3ed-7c0a90435720 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90972cfa69704e9788e8eb3609da031d, user_id=7ea9c624cf924059956c89982eb614c1, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:15.074855 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f61210-a4bd-44a3-b3ed-7c0a90435720 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:15.098175 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1199/2402] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:51:15 2022] PUT /identity/v3/projects/90972cfa69704e9788e8eb3609da031d/users/7ea9c624cf924059956c89982eb614c1/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:51:15.101608 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2854eb7-0fde-414d-bfa2-122e64171b6c None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:15.102168 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2854eb7-0fde-414d-bfa2-122e64171b6c None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:15.102526 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2854eb7-0fde-414d-bfa2-122e64171b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:15.141835 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-c2854eb7-0fde-414d-bfa2-122e64171b6c None None] MFA Rules not processed for user `7ea9c624cf924059956c89982eb614c1`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:15.143521 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-c2854eb7-0fde-414d-bfa2-122e64171b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:15.277590 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8563fd-d444-40ba-8f91-b036780c2c9f None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:15.278140 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8563fd-d444-40ba-8f91-b036780c2c9f None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:15.278140 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8563fd-d444-40ba-8f91-b036780c2c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:15.323201 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-9b8563fd-d444-40ba-8f91-b036780c2c9f None None] MFA Rules not processed for user `7b42516e12d346eea1561b745bf724a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:15.324556 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-9b8563fd-d444-40ba-8f91-b036780c2c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:15.457189 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1200/2403] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:51:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:51:15.497449 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1204/2404] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:51:15 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:51:15.508844 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8563fd-d444-40ba-8f91-b036780c2c9f None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:15.510383 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-9b8563fd-d444-40ba-8f91-b036780c2c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:15.623631 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8563fd-d444-40ba-8f91-b036780c2c9f None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:15.633096 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87de7b8-807c-46b4-b823-c121d908481e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:15.633772 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87de7b8-807c-46b4-b823-c121d908481e service cinder] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:15.634054 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87de7b8-807c-46b4-b823-c121d908481e service cinder] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:15.634332 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87de7b8-807c-46b4-b823-c121d908481e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:15.656910 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87de7b8-807c-46b4-b823-c121d908481e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:15.661796 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87de7b8-807c-46b4-b823-c121d908481e service cinder] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:15.702027 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1201/2405] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:51:15 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:51:15.755177 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2854eb7-0fde-414d-bfa2-122e64171b6c None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:15.757427 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-c2854eb7-0fde-414d-bfa2-122e64171b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:15.782633 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2854eb7-0fde-414d-bfa2-122e64171b6c None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:15.799541 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7fc24a-3974-41dc-bab6-f762d9d2207c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:15.800093 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7fc24a-3974-41dc-bab6-f762d9d2207c service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:15.800373 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7fc24a-3974-41dc-bab6-f762d9d2207c service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:15.800646 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7fc24a-3974-41dc-bab6-f762d9d2207c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:15.900932 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7fc24a-3974-41dc-bab6-f762d9d2207c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:15.902448 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7fc24a-3974-41dc-bab6-f762d9d2207c service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:15.908750 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87de7b8-807c-46b4-b823-c121d908481e service cinder] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:15.910587 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-a87de7b8-807c-46b4-b823-c121d908481e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:15.913696 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1205/2406] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:51:15 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:51:15.999549 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87de7b8-807c-46b4-b823-c121d908481e service cinder] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:16.006743 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d645924-7945-4342-9cbc-5c26e234e390 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:16.007929 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d645924-7945-4342-9cbc-5c26e234e390 service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:16.008407 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d645924-7945-4342-9cbc-5c26e234e390 service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:16.008783 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d645924-7945-4342-9cbc-5c26e234e390 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:16.011287 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-8d645924-7945-4342-9cbc-5c26e234e390 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:16.022204 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:16.026081 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d645924-7945-4342-9cbc-5c26e234e390 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:16.028217 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d645924-7945-4342-9cbc-5c26e234e390 service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:16.042676 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1202/2407] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:51:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:51:19.654470 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7fc24a-3974-41dc-bab6-f762d9d2207c service cinder] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:19.708722 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:19.732176 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7fc24a-3974-41dc-bab6-f762d9d2207c service cinder] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:19.736868 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf616412-34e9-4bb9-bd90-74860bc695d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:19.737589 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf616412-34e9-4bb9-bd90-74860bc695d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:19.737867 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf616412-34e9-4bb9-bd90-74860bc695d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:19.738146 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf616412-34e9-4bb9-bd90-74860bc695d3 admin admin] PATH_INFO: `/v3/users/f7f98a5c01e44311acf93f2179a08f7d` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:19.739303 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf616412-34e9-4bb9-bd90-74860bc695d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7f98a5c01e44311acf93f2179a08f7d)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:19.742161 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf616412-34e9-4bb9-bd90-74860bc695d3 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:19.800918 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-bf616412-34e9-4bb9-bd90-74860bc695d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7f98a5c01e44311acf93f2179a08f7d'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:19.812596 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-bf616412-34e9-4bb9-bd90-74860bc695d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7f98a5c01e44311acf93f2179a08f7d'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:19.813539 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-bf616412-34e9-4bb9-bd90-74860bc695d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7f98a5c01e44311acf93f2179a08f7d'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:19.823171 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-bf616412-34e9-4bb9-bd90-74860bc695d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7f98a5c01e44311acf93f2179a08f7d'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:19.823906 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-bf616412-34e9-4bb9-bd90-74860bc695d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7f98a5c01e44311acf93f2179a08f7d'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:19.853204 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1206/2408] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:51:19 2022] DELETE /identity/v3/users/f7f98a5c01e44311acf93f2179a08f7d => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:51:19.859237 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d19b2-7b94-45d5-ac29-3aec3682efd8 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:19.859685 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d19b2-7b94-45d5-ac29-3aec3682efd8 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:19.859977 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d19b2-7b94-45d5-ac29-3aec3682efd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:19.883528 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-d85d19b2-7b94-45d5-ac29-3aec3682efd8 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:19.884855 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-d85d19b2-7b94-45d5-ac29-3aec3682efd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:19.984703 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1203/2409] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:51:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:51:19.994568 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf616412-34e9-4bb9-bd90-74860bc695d3 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:19.996369 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-bf616412-34e9-4bb9-bd90-74860bc695d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:20.081647 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf616412-34e9-4bb9-bd90-74860bc695d3 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:20.088728 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295cad14-7868-44b9-8b7e-316c457f5187 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:20.089457 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295cad14-7868-44b9-8b7e-316c457f5187 service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:20.089719 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295cad14-7868-44b9-8b7e-316c457f5187 service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:20.089988 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295cad14-7868-44b9-8b7e-316c457f5187 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:20.104760 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295cad14-7868-44b9-8b7e-316c457f5187 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:20.106467 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295cad14-7868-44b9-8b7e-316c457f5187 service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:20.117623 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1207/2410] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:51:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:51:20.527588 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85d19b2-7b94-45d5-ac29-3aec3682efd8 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:20.529163 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-d85d19b2-7b94-45d5-ac29-3aec3682efd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:20.543050 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85d19b2-7b94-45d5-ac29-3aec3682efd8 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:20.548857 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8610b8-3a88-4faf-8ad9-fb803b6fb7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:20.549632 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8610b8-3a88-4faf-8ad9-fb803b6fb7cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:20.549914 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8610b8-3a88-4faf-8ad9-fb803b6fb7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:20.550188 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8610b8-3a88-4faf-8ad9-fb803b6fb7cc admin admin] PATH_INFO: `/v3/projects/921b72b93d1b4704927483bb1a6ff806` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:20.551381 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8610b8-3a88-4faf-8ad9-fb803b6fb7cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=921b72b93d1b4704927483bb1a6ff806)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:20.557963 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8610b8-3a88-4faf-8ad9-fb803b6fb7cc admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:20.652490 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-7c8610b8-3a88-4faf-8ad9-fb803b6fb7cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '921b72b93d1b4704927483bb1a6ff806', 'request_id': 'req-7c8610b8-3a88-4faf-8ad9-fb803b6fb7cc'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:20.660852 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-7c8610b8-3a88-4faf-8ad9-fb803b6fb7cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '921b72b93d1b4704927483bb1a6ff806', 'request_id': 'req-7c8610b8-3a88-4faf-8ad9-fb803b6fb7cc'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:20.668561 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-7c8610b8-3a88-4faf-8ad9-fb803b6fb7cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '921b72b93d1b4704927483bb1a6ff806', 'request_id': 'req-7c8610b8-3a88-4faf-8ad9-fb803b6fb7cc'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:20.683486 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-7c8610b8-3a88-4faf-8ad9-fb803b6fb7cc admin admin] The token cache is being invalidate because project 921b72b93d1b4704927483bb1a6ff806 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:51:20.683955 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-7c8610b8-3a88-4faf-8ad9-fb803b6fb7cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:20.684723 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-7c8610b8-3a88-4faf-8ad9-fb803b6fb7cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:20.689536 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1204/2411] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:51:20 2022] DELETE /identity/v3/projects/921b72b93d1b4704927483bb1a6ff806 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:51:20.690522 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295cad14-7868-44b9-8b7e-316c457f5187 service neutron] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:20.707158 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295cad14-7868-44b9-8b7e-316c457f5187 service neutron] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:20.786759 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385ad969-d801-425c-bf7e-aa222d3e4aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:20.787901 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ad969-d801-425c-bf7e-aa222d3e4aa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:20.788136 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ad969-d801-425c-bf7e-aa222d3e4aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:20.788415 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ad969-d801-425c-bf7e-aa222d3e4aa5 admin admin] PATH_INFO: `/v3/users/7ea9c624cf924059956c89982eb614c1` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:20.789640 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385ad969-d801-425c-bf7e-aa222d3e4aa5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ea9c624cf924059956c89982eb614c1)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:20.791568 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385ad969-d801-425c-bf7e-aa222d3e4aa5 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:20.795038 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:20.863615 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-385ad969-d801-425c-bf7e-aa222d3e4aa5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ea9c624cf924059956c89982eb614c1'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:20.873771 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-385ad969-d801-425c-bf7e-aa222d3e4aa5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ea9c624cf924059956c89982eb614c1'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:20.874624 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-385ad969-d801-425c-bf7e-aa222d3e4aa5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ea9c624cf924059956c89982eb614c1'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:20.885632 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-385ad969-d801-425c-bf7e-aa222d3e4aa5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ea9c624cf924059956c89982eb614c1'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:20.886366 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-385ad969-d801-425c-bf7e-aa222d3e4aa5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ea9c624cf924059956c89982eb614c1'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:20.907886 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1208/2412] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:51:20 2022] DELETE /identity/v3/users/7ea9c624cf924059956c89982eb614c1 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:51:21.273113 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8610b8-3a88-4faf-8ad9-fb803b6fb7cc admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:21.274749 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-7c8610b8-3a88-4faf-8ad9-fb803b6fb7cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:21.304884 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8610b8-3a88-4faf-8ad9-fb803b6fb7cc admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:21.397950 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c2f8d3-b121-485f-bff2-b69a7f68ef8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:21.398610 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c2f8d3-b121-485f-bff2-b69a7f68ef8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:21.398967 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c2f8d3-b121-485f-bff2-b69a7f68ef8b admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:21.399334 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c2f8d3-b121-485f-bff2-b69a7f68ef8b admin admin] PATH_INFO: `/v3/projects/90972cfa69704e9788e8eb3609da031d` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:21.400548 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c2f8d3-b121-485f-bff2-b69a7f68ef8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=90972cfa69704e9788e8eb3609da031d)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:21.402574 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c2f8d3-b121-485f-bff2-b69a7f68ef8b admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:21.427584 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:21.469053 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-e2c2f8d3-b121-485f-bff2-b69a7f68ef8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90972cfa69704e9788e8eb3609da031d', 'request_id': 'req-e2c2f8d3-b121-485f-bff2-b69a7f68ef8b'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:21.483680 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-e2c2f8d3-b121-485f-bff2-b69a7f68ef8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90972cfa69704e9788e8eb3609da031d', 'request_id': 'req-e2c2f8d3-b121-485f-bff2-b69a7f68ef8b'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:21.493257 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-e2c2f8d3-b121-485f-bff2-b69a7f68ef8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90972cfa69704e9788e8eb3609da031d', 'request_id': 'req-e2c2f8d3-b121-485f-bff2-b69a7f68ef8b'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:21.516480 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-e2c2f8d3-b121-485f-bff2-b69a7f68ef8b admin admin] The token cache is being invalidate because project 90972cfa69704e9788e8eb3609da031d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:51:21.516781 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-e2c2f8d3-b121-485f-bff2-b69a7f68ef8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:21.519509 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-e2c2f8d3-b121-485f-bff2-b69a7f68ef8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:21.522729 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1205/2413] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:51:21 2022] DELETE /identity/v3/projects/90972cfa69704e9788e8eb3609da031d => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:51:21.527885 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abbdbfa-bf4a-4aed-9f89-1a3a7a1c656a None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:21.528184 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abbdbfa-bf4a-4aed-9f89-1a3a7a1c656a None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:21.528463 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abbdbfa-bf4a-4aed-9f89-1a3a7a1c656a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:21.563947 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-7abbdbfa-bf4a-4aed-9f89-1a3a7a1c656a None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:21.565711 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-7abbdbfa-bf4a-4aed-9f89-1a3a7a1c656a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:21.670198 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1209/2414] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:51:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:51:21.671477 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c54dfd-f142-4225-ae58-391eb23a593e None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:21.671792 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c54dfd-f142-4225-ae58-391eb23a593e None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:21.672075 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c54dfd-f142-4225-ae58-391eb23a593e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:21.706493 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-37c54dfd-f142-4225-ae58-391eb23a593e None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:21.711164 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-37c54dfd-f142-4225-ae58-391eb23a593e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:21.735712 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1206/2415] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:51:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:51:21.746106 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abbdbfa-bf4a-4aed-9f89-1a3a7a1c656a None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:21.756461 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abbdbfa-bf4a-4aed-9f89-1a3a7a1c656a None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:21.761738 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6040cf7e-ed7a-4373-9bd1-be6bf8489b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:21.762351 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040cf7e-ed7a-4373-9bd1-be6bf8489b5c admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:21.762632 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040cf7e-ed7a-4373-9bd1-be6bf8489b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:21.763042 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040cf7e-ed7a-4373-9bd1-be6bf8489b5c admin admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:21.763592 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6040cf7e-ed7a-4373-9bd1-be6bf8489b5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:51:21.763913 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6040cf7e-ed7a-4373-9bd1-be6bf8489b5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:21.765583 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6040cf7e-ed7a-4373-9bd1-be6bf8489b5c admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:21.782144 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1210/2416] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Aug 29 22:51:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:51:21.786446 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c54dfd-f142-4225-ae58-391eb23a593e None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:21.796813 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c54dfd-f142-4225-ae58-391eb23a593e None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:21.801751 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e72081-aed4-4739-abb1-fdb02efe8468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:21.802368 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e72081-aed4-4739-abb1-fdb02efe8468 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:21.802643 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e72081-aed4-4739-abb1-fdb02efe8468 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:21.802942 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e72081-aed4-4739-abb1-fdb02efe8468 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:21.804106 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e72081-aed4-4739-abb1-fdb02efe8468 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:21.806179 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e72081-aed4-4739-abb1-fdb02efe8468 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:21.841827 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1207/2417] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:51:21 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:51:21.845976 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6040cf7e-ed7a-4373-9bd1-be6bf8489b5c admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:21.861103 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6040cf7e-ed7a-4373-9bd1-be6bf8489b5c admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:21.937232 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b529a78-c013-45ec-911d-2a732442e23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:21.937945 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b529a78-c013-45ec-911d-2a732442e23f admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:21.938361 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b529a78-c013-45ec-911d-2a732442e23f admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:21.938751 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b529a78-c013-45ec-911d-2a732442e23f admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:21.939487 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b529a78-c013-45ec-911d-2a732442e23f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:21.942051 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b529a78-c013-45ec-911d-2a732442e23f admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:21.961927 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:21.971534 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1211/2418] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:51:21 2022] POST /identity/v3/users => generated 287 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:51:21.976652 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e72081-aed4-4739-abb1-fdb02efe8468 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:21.988132 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e72081-aed4-4739-abb1-fdb02efe8468 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:21.993917 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bc729b-cf6f-4b85-984c-2669de717455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:21.994537 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc729b-cf6f-4b85-984c-2669de717455 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:21.994819 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc729b-cf6f-4b85-984c-2669de717455 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:21.995095 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc729b-cf6f-4b85-984c-2669de717455 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:21.995744 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bc729b-cf6f-4b85-984c-2669de717455 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:21.997387 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bc729b-cf6f-4b85-984c-2669de717455 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:22.008673 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1208/2419] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:51:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:51:22.015183 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b529a78-c013-45ec-911d-2a732442e23f admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:22.026175 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b529a78-c013-45ec-911d-2a732442e23f admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:22.031457 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a014f8-df76-4f8b-ae09-d43d231e1755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:22.032065 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a014f8-df76-4f8b-ae09-d43d231e1755 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:22.032460 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a014f8-df76-4f8b-ae09-d43d231e1755 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:22.032742 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a014f8-df76-4f8b-ae09-d43d231e1755 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:22.033633 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a014f8-df76-4f8b-ae09-d43d231e1755 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:22.035581 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a014f8-df76-4f8b-ae09-d43d231e1755 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:22.047681 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1212/2420] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:51:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:51:22.051917 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bc729b-cf6f-4b85-984c-2669de717455 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:22.064533 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bc729b-cf6f-4b85-984c-2669de717455 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:22.069385 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3423c6-e736-48e0-ab34-30ee4ce96b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:22.070151 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3423c6-e736-48e0-ab34-30ee4ce96b3b admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:22.070474 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3423c6-e736-48e0-ab34-30ee4ce96b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:22.070717 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3423c6-e736-48e0-ab34-30ee4ce96b3b admin admin] PATH_INFO: `/v3/projects/804ac7e87ad6406cadf659a62c934bd6/users/da00c825f24b402287ab727d34436c3c/roles/0c67797d444d4c929b2ccab47c468848` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:22.087762 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3423c6-e736-48e0-ab34-30ee4ce96b3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=804ac7e87ad6406cadf659a62c934bd6, user_id=da00c825f24b402287ab727d34436c3c, role_id=0c67797d444d4c929b2ccab47c468848)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:22.090495 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3423c6-e736-48e0-ab34-30ee4ce96b3b admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:22.111365 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1209/2421] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:51:22 2022] PUT /identity/v3/projects/804ac7e87ad6406cadf659a62c934bd6/users/da00c825f24b402287ab727d34436c3c/roles/0c67797d444d4c929b2ccab47c468848 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:51:22.118396 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3af7a-0c48-4020-a7af-5f01717481e1 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:22.118716 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3af7a-0c48-4020-a7af-5f01717481e1 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:22.118946 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3af7a-0c48-4020-a7af-5f01717481e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:22.152613 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-bcd3af7a-0c48-4020-a7af-5f01717481e1 None None] MFA Rules not processed for user `da00c825f24b402287ab727d34436c3c`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:22.154337 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-bcd3af7a-0c48-4020-a7af-5f01717481e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:22.258798 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1213/2422] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:51:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:51:22.271225 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3423c6-e736-48e0-ab34-30ee4ce96b3b admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:22.281141 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-9a3423c6-e736-48e0-ab34-30ee4ce96b3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:22.350948 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3423c6-e736-48e0-ab34-30ee4ce96b3b admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:22.354834 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25785c70-44c1-4635-a9e9-7aa0c8f62ebb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:22.355457 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25785c70-44c1-4635-a9e9-7aa0c8f62ebb service cinder] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:22.355741 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25785c70-44c1-4635-a9e9-7aa0c8f62ebb service cinder] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:22.356016 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25785c70-44c1-4635-a9e9-7aa0c8f62ebb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:22.365343 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25785c70-44c1-4635-a9e9-7aa0c8f62ebb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:22.366955 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25785c70-44c1-4635-a9e9-7aa0c8f62ebb service cinder] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:22.378475 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1210/2423] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:51:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:51:25.464533 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd3af7a-0c48-4020-a7af-5f01717481e1 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:25.543848 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd3af7a-0c48-4020-a7af-5f01717481e1 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:25.552145 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a7153-7918-4b24-ab32-1a9fdd5b9707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:25.552972 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a7153-7918-4b24-ab32-1a9fdd5b9707 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:25.553573 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a7153-7918-4b24-ab32-1a9fdd5b9707 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:25.554478 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a7153-7918-4b24-ab32-1a9fdd5b9707 admin admin] PATH_INFO: `/v3/users/da00c825f24b402287ab727d34436c3c` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:25.557518 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6a7153-7918-4b24-ab32-1a9fdd5b9707 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da00c825f24b402287ab727d34436c3c)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:25.560218 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6a7153-7918-4b24-ab32-1a9fdd5b9707 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:25.630657 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-cb6a7153-7918-4b24-ab32-1a9fdd5b9707 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da00c825f24b402287ab727d34436c3c'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:25.640710 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-cb6a7153-7918-4b24-ab32-1a9fdd5b9707 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da00c825f24b402287ab727d34436c3c'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:25.641854 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-cb6a7153-7918-4b24-ab32-1a9fdd5b9707 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da00c825f24b402287ab727d34436c3c'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:25.652566 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-cb6a7153-7918-4b24-ab32-1a9fdd5b9707 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da00c825f24b402287ab727d34436c3c'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:25.653349 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-cb6a7153-7918-4b24-ab32-1a9fdd5b9707 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da00c825f24b402287ab727d34436c3c'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:25.671669 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:25.681833 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1214/2424] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:51:25 2022] DELETE /identity/v3/users/da00c825f24b402287ab727d34436c3c => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:51:25.686629 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889efde-0a96-4bc9-ae28-b3a3ca28999f None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:25.687494 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889efde-0a96-4bc9-ae28-b3a3ca28999f None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:25.687777 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889efde-0a96-4bc9-ae28-b3a3ca28999f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:25.711767 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-b889efde-0a96-4bc9-ae28-b3a3ca28999f None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:25.713091 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-b889efde-0a96-4bc9-ae28-b3a3ca28999f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:25.777747 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:25.797944 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1211/2425] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:51:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:51:25.812792 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a7153-7918-4b24-ab32-1a9fdd5b9707 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:25.814539 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-cb6a7153-7918-4b24-ab32-1a9fdd5b9707 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:25.896644 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a7153-7918-4b24-ab32-1a9fdd5b9707 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:25.901844 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca0d146-4254-45e1-b9f8-8fa1f874845a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:25.902636 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0d146-4254-45e1-b9f8-8fa1f874845a service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:25.903153 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0d146-4254-45e1-b9f8-8fa1f874845a service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:25.903522 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0d146-4254-45e1-b9f8-8fa1f874845a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:25.916324 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca0d146-4254-45e1-b9f8-8fa1f874845a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:25.918167 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca0d146-4254-45e1-b9f8-8fa1f874845a service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:25.931511 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1215/2426] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:51:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:51:26.207344 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b889efde-0a96-4bc9-ae28-b3a3ca28999f None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:26.208930 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-b889efde-0a96-4bc9-ae28-b3a3ca28999f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:26.225216 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b889efde-0a96-4bc9-ae28-b3a3ca28999f None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:26.230955 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ffe5c9-7d28-44fd-91f7-85fe23aaf8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:26.231655 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ffe5c9-7d28-44fd-91f7-85fe23aaf8d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:26.231879 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ffe5c9-7d28-44fd-91f7-85fe23aaf8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:26.232154 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ffe5c9-7d28-44fd-91f7-85fe23aaf8d9 admin admin] PATH_INFO: `/v3/projects/804ac7e87ad6406cadf659a62c934bd6` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:26.233897 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ffe5c9-7d28-44fd-91f7-85fe23aaf8d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=804ac7e87ad6406cadf659a62c934bd6)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:26.236107 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ffe5c9-7d28-44fd-91f7-85fe23aaf8d9 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:26.293356 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-c2ffe5c9-7d28-44fd-91f7-85fe23aaf8d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '804ac7e87ad6406cadf659a62c934bd6', 'request_id': 'req-c2ffe5c9-7d28-44fd-91f7-85fe23aaf8d9'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:26.301318 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-c2ffe5c9-7d28-44fd-91f7-85fe23aaf8d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '804ac7e87ad6406cadf659a62c934bd6', 'request_id': 'req-c2ffe5c9-7d28-44fd-91f7-85fe23aaf8d9'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:26.317183 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-c2ffe5c9-7d28-44fd-91f7-85fe23aaf8d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '804ac7e87ad6406cadf659a62c934bd6', 'request_id': 'req-c2ffe5c9-7d28-44fd-91f7-85fe23aaf8d9'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:26.335301 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-c2ffe5c9-7d28-44fd-91f7-85fe23aaf8d9 admin admin] The token cache is being invalidate because project 804ac7e87ad6406cadf659a62c934bd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:51:26.335745 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-c2ffe5c9-7d28-44fd-91f7-85fe23aaf8d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:26.336590 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-c2ffe5c9-7d28-44fd-91f7-85fe23aaf8d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:26.338730 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1212/2427] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:51:26 2022] DELETE /identity/v3/projects/804ac7e87ad6406cadf659a62c934bd6 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:51:26.343669 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d6613-f2b0-4593-a018-d3235ad039a6 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:26.344154 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d6613-f2b0-4593-a018-d3235ad039a6 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:26.344431 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d6613-f2b0-4593-a018-d3235ad039a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:26.365879 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-0e1d6613-f2b0-4593-a018-d3235ad039a6 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:26.368180 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-0e1d6613-f2b0-4593-a018-d3235ad039a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:26.470762 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1216/2428] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:51:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:51:26.479619 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71976c-3b30-46fd-a6c1-fecfde7e9a70 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:26.479913 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71976c-3b30-46fd-a6c1-fecfde7e9a70 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:26.480188 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71976c-3b30-46fd-a6c1-fecfde7e9a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:26.510169 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-ba71976c-3b30-46fd-a6c1-fecfde7e9a70 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:26.511533 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-ba71976c-3b30-46fd-a6c1-fecfde7e9a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:26.520696 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1213/2429] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:51:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:51:26.525610 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1d6613-f2b0-4593-a018-d3235ad039a6 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:26.535841 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1d6613-f2b0-4593-a018-d3235ad039a6 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:26.541008 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236115e2-29b9-42bf-8ecc-3ca6966cfaaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:26.541665 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236115e2-29b9-42bf-8ecc-3ca6966cfaaf admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:26.542060 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236115e2-29b9-42bf-8ecc-3ca6966cfaaf admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:26.542334 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236115e2-29b9-42bf-8ecc-3ca6966cfaaf admin admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:26.542979 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236115e2-29b9-42bf-8ecc-3ca6966cfaaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:51:26.543279 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236115e2-29b9-42bf-8ecc-3ca6966cfaaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:26.544872 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236115e2-29b9-42bf-8ecc-3ca6966cfaaf admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:26.557417 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1217/2430] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Aug 29 22:51:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:51:26.561769 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba71976c-3b30-46fd-a6c1-fecfde7e9a70 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:26.571554 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba71976c-3b30-46fd-a6c1-fecfde7e9a70 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:26.576267 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78325a8f-f422-491a-b62c-6778f8bd5c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:26.576936 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78325a8f-f422-491a-b62c-6778f8bd5c92 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:26.577155 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78325a8f-f422-491a-b62c-6778f8bd5c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:26.577462 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78325a8f-f422-491a-b62c-6778f8bd5c92 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:26.578111 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78325a8f-f422-491a-b62c-6778f8bd5c92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:26.580023 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78325a8f-f422-491a-b62c-6778f8bd5c92 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:26.612901 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1214/2431] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:51:26 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:51:26.614029 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236115e2-29b9-42bf-8ecc-3ca6966cfaaf admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:26.624898 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236115e2-29b9-42bf-8ecc-3ca6966cfaaf admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:26.693774 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec07c7d-dedd-48d4-81ab-19c1f1634ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:26.694557 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec07c7d-dedd-48d4-81ab-19c1f1634ebc admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:26.694843 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec07c7d-dedd-48d4-81ab-19c1f1634ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:26.695117 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec07c7d-dedd-48d4-81ab-19c1f1634ebc admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:26.695776 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec07c7d-dedd-48d4-81ab-19c1f1634ebc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:26.698005 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec07c7d-dedd-48d4-81ab-19c1f1634ebc admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:26.724700 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1218/2432] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:51:26 2022] POST /identity/v3/users => generated 293 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:51:26.726443 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78325a8f-f422-491a-b62c-6778f8bd5c92 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:26.739215 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78325a8f-f422-491a-b62c-6778f8bd5c92 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:26.745223 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3acadec-e733-4d66-857e-edc35abac46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:26.745880 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3acadec-e733-4d66-857e-edc35abac46b admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:26.746157 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3acadec-e733-4d66-857e-edc35abac46b admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:26.746429 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3acadec-e733-4d66-857e-edc35abac46b admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:26.747214 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3acadec-e733-4d66-857e-edc35abac46b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:26.748820 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3acadec-e733-4d66-857e-edc35abac46b admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:26.761510 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1215/2433] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:51:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:51:26.765657 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec07c7d-dedd-48d4-81ab-19c1f1634ebc admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:26.779778 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec07c7d-dedd-48d4-81ab-19c1f1634ebc admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:26.787977 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0986725-346e-4f17-b936-da28a8ca9050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:26.788889 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0986725-346e-4f17-b936-da28a8ca9050 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:26.789300 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0986725-346e-4f17-b936-da28a8ca9050 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:26.789724 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0986725-346e-4f17-b936-da28a8ca9050 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:26.790693 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0986725-346e-4f17-b936-da28a8ca9050 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:26.793271 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0986725-346e-4f17-b936-da28a8ca9050 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:26.815642 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1219/2434] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:51:26 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:51:26.816851 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3acadec-e733-4d66-857e-edc35abac46b admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:26.841489 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3acadec-e733-4d66-857e-edc35abac46b admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:26.846059 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14bc94-187f-4b9d-b236-652b93d6767e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:26.846717 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14bc94-187f-4b9d-b236-652b93d6767e admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:26.846994 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14bc94-187f-4b9d-b236-652b93d6767e admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:26.847266 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14bc94-187f-4b9d-b236-652b93d6767e admin admin] PATH_INFO: `/v3/projects/d89e51ce99094327bef627e22c3b62a4/users/965547d7038c4dad854169ef3f870cf3/roles/0c67797d444d4c929b2ccab47c468848` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:26.862434 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f14bc94-187f-4b9d-b236-652b93d6767e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d89e51ce99094327bef627e22c3b62a4, user_id=965547d7038c4dad854169ef3f870cf3, role_id=0c67797d444d4c929b2ccab47c468848)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:26.865072 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f14bc94-187f-4b9d-b236-652b93d6767e admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:26.881478 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1216/2435] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:51:26 2022] PUT /identity/v3/projects/d89e51ce99094327bef627e22c3b62a4/users/965547d7038c4dad854169ef3f870cf3/roles/0c67797d444d4c929b2ccab47c468848 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:51:26.892482 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40051de2-8602-448a-bd3e-91d44fce7674 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:26.892768 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40051de2-8602-448a-bd3e-91d44fce7674 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:26.893041 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40051de2-8602-448a-bd3e-91d44fce7674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:26.901383 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:26.925561 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-40051de2-8602-448a-bd3e-91d44fce7674 None None] MFA Rules not processed for user `965547d7038c4dad854169ef3f870cf3`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:26.927534 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-40051de2-8602-448a-bd3e-91d44fce7674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:26.995906 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1220/2436] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:51:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:51:27.007927 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14bc94-187f-4b9d-b236-652b93d6767e admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:27.009664 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-9f14bc94-187f-4b9d-b236-652b93d6767e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:27.067208 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14bc94-187f-4b9d-b236-652b93d6767e admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:27.071783 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8518abfe-9441-4d5e-ad43-301a46fc297b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:27.072417 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518abfe-9441-4d5e-ad43-301a46fc297b service cinder] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:27.072695 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518abfe-9441-4d5e-ad43-301a46fc297b service cinder] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:27.072965 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518abfe-9441-4d5e-ad43-301a46fc297b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:27.081558 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8518abfe-9441-4d5e-ad43-301a46fc297b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:27.082975 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8518abfe-9441-4d5e-ad43-301a46fc297b service cinder] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:27.092139 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1217/2437] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:51:27 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:51:29.541997 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d42040-90e1-4940-8a86-ab3cd746a34d None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:29.542503 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d42040-90e1-4940-8a86-ab3cd746a34d None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:29.542503 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d42040-90e1-4940-8a86-ab3cd746a34d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:29.562359 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-50d42040-90e1-4940-8a86-ab3cd746a34d None None] MFA Rules not processed for user `e49a4666712746d098ace9e1cb0bf07c`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:29.563575 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-50d42040-90e1-4940-8a86-ab3cd746a34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:29.625636 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1221/2438] 10.222.0.47 () {58 vars in 967 bytes} [Mon Aug 29 22:51:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:51:29.640572 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8518abfe-9441-4d5e-ad43-301a46fc297b service cinder] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:29.642801 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-8518abfe-9441-4d5e-ad43-301a46fc297b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:29.648680 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d42040-90e1-4940-8a86-ab3cd746a34d None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:29.659546 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:29.717680 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d42040-90e1-4940-8a86-ab3cd746a34d None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:29.721638 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8518abfe-9441-4d5e-ad43-301a46fc297b service cinder] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:29.723025 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a611d7-fc4b-4bba-8d89-40f66bfc092a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:29.723660 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a611d7-fc4b-4bba-8d89-40f66bfc092a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:29.723937 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a611d7-fc4b-4bba-8d89-40f66bfc092a admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:29.724214 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a611d7-fc4b-4bba-8d89-40f66bfc092a admin admin] PATH_INFO: `/v3/users/965547d7038c4dad854169ef3f870cf3` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:29.725434 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a611d7-fc4b-4bba-8d89-40f66bfc092a admin admin] RBAC: Authorizing `identity:delete_user(user_id=965547d7038c4dad854169ef3f870cf3)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:29.727666 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceda362-5f4e-48c5-9669-ae2c97eee6a2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '388d8dea2edf4fb888d42ca878c1434d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:29.727925 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a611d7-fc4b-4bba-8d89-40f66bfc092a admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:29.728372 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceda362-5f4e-48c5-9669-ae2c97eee6a2 service swift] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:29.728655 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceda362-5f4e-48c5-9669-ae2c97eee6a2 service swift] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:29.728948 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceda362-5f4e-48c5-9669-ae2c97eee6a2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:29.737552 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceda362-5f4e-48c5-9669-ae2c97eee6a2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:29.739133 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceda362-5f4e-48c5-9669-ae2c97eee6a2 service swift] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:29.748513 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1218/2439] 10.222.0.47 () {60 vars in 1384 bytes} [Mon Aug 29 22:51:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 22:51:29.780638 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:29.786430 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-05a611d7-fc4b-4bba-8d89-40f66bfc092a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '965547d7038c4dad854169ef3f870cf3'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:29.795464 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-05a611d7-fc4b-4bba-8d89-40f66bfc092a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '965547d7038c4dad854169ef3f870cf3'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:29.795783 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-05a611d7-fc4b-4bba-8d89-40f66bfc092a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '965547d7038c4dad854169ef3f870cf3'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:29.803833 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-05a611d7-fc4b-4bba-8d89-40f66bfc092a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '965547d7038c4dad854169ef3f870cf3'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:29.805467 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-05a611d7-fc4b-4bba-8d89-40f66bfc092a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '965547d7038c4dad854169ef3f870cf3'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:29.827640 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1222/2440] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:51:29 2022] DELETE /identity/v3/users/965547d7038c4dad854169ef3f870cf3 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:51:29.833779 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f173053-8ec7-4f42-88b0-0a6597b07274 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:29.834064 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f173053-8ec7-4f42-88b0-0a6597b07274 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:29.834340 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f173053-8ec7-4f42-88b0-0a6597b07274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:29.862777 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-8f173053-8ec7-4f42-88b0-0a6597b07274 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:29.864038 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-8f173053-8ec7-4f42-88b0-0a6597b07274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:29.958981 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1219/2441] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:51:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:51:29.969941 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a611d7-fc4b-4bba-8d89-40f66bfc092a admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:29.972743 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-05a611d7-fc4b-4bba-8d89-40f66bfc092a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:30.049870 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a611d7-fc4b-4bba-8d89-40f66bfc092a admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:30.054478 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2e7808-2bbc-4265-b3a2-a82dae4de94e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:30.055133 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e7808-2bbc-4265-b3a2-a82dae4de94e service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:30.055537 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e7808-2bbc-4265-b3a2-a82dae4de94e service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:30.055819 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e7808-2bbc-4265-b3a2-a82dae4de94e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:30.067149 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2e7808-2bbc-4265-b3a2-a82dae4de94e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:30.069152 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2e7808-2bbc-4265-b3a2-a82dae4de94e service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:30.077278 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f173053-8ec7-4f42-88b0-0a6597b07274 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:30.079071 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-8f173053-8ec7-4f42-88b0-0a6597b07274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:30.088972 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1223/2442] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:51:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:51:30.192474 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f173053-8ec7-4f42-88b0-0a6597b07274 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:30.201173 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05770feb-f628-4143-9a33-05ab681d364f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35441c061e514b1b9341e7694ec2c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:30.201947 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05770feb-f628-4143-9a33-05ab681d364f service nova] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:30.202359 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05770feb-f628-4143-9a33-05ab681d364f service nova] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:30.202696 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05770feb-f628-4143-9a33-05ab681d364f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:30.204595 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-05770feb-f628-4143-9a33-05ab681d364f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:30.255818 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:30.292326 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05770feb-f628-4143-9a33-05ab681d364f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:30.294098 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05770feb-f628-4143-9a33-05ab681d364f service nova] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:30.312414 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1220/2443] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:51:30 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:51:30.448815 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2e7808-2bbc-4265-b3a2-a82dae4de94e service neutron] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:30.450510 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-1a2e7808-2bbc-4265-b3a2-a82dae4de94e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:30.469262 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2e7808-2bbc-4265-b3a2-a82dae4de94e service neutron] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:30.478133 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8f52ed-aba1-4f20-b6fc-97a936c07969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:30.479058 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8f52ed-aba1-4f20-b6fc-97a936c07969 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:30.479427 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8f52ed-aba1-4f20-b6fc-97a936c07969 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:30.479768 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8f52ed-aba1-4f20-b6fc-97a936c07969 admin admin] PATH_INFO: `/v3/projects/d89e51ce99094327bef627e22c3b62a4` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:30.481445 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8f52ed-aba1-4f20-b6fc-97a936c07969 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d89e51ce99094327bef627e22c3b62a4)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:30.483893 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8f52ed-aba1-4f20-b6fc-97a936c07969 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:30.535145 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-2a8f52ed-aba1-4f20-b6fc-97a936c07969 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd89e51ce99094327bef627e22c3b62a4', 'request_id': 'req-2a8f52ed-aba1-4f20-b6fc-97a936c07969'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:30.543217 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-2a8f52ed-aba1-4f20-b6fc-97a936c07969 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd89e51ce99094327bef627e22c3b62a4', 'request_id': 'req-2a8f52ed-aba1-4f20-b6fc-97a936c07969'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:30.549903 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-2a8f52ed-aba1-4f20-b6fc-97a936c07969 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd89e51ce99094327bef627e22c3b62a4', 'request_id': 'req-2a8f52ed-aba1-4f20-b6fc-97a936c07969'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:30.564592 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-2a8f52ed-aba1-4f20-b6fc-97a936c07969 admin admin] The token cache is being invalidate because project d89e51ce99094327bef627e22c3b62a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:51:30.565086 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-2a8f52ed-aba1-4f20-b6fc-97a936c07969 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:30.565775 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-2a8f52ed-aba1-4f20-b6fc-97a936c07969 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:30.567226 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1224/2444] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:51:30 2022] DELETE /identity/v3/projects/d89e51ce99094327bef627e22c3b62a4 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:51:35.272702 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05770feb-f628-4143-9a33-05ab681d364f service nova] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:35.274463 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-05770feb-f628-4143-9a33-05ab681d364f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:35.291741 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05770feb-f628-4143-9a33-05ab681d364f service nova] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:35.381163 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8578839-eeea-47f6-958c-d2b2a562323e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35441c061e514b1b9341e7694ec2c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:35.382870 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8578839-eeea-47f6-958c-d2b2a562323e service nova] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:35.383135 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8578839-eeea-47f6-958c-d2b2a562323e service nova] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:35.383598 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8578839-eeea-47f6-958c-d2b2a562323e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:35.386440 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-a8578839-eeea-47f6-958c-d2b2a562323e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:35.402712 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8578839-eeea-47f6-958c-d2b2a562323e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:35.404359 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8578839-eeea-47f6-958c-d2b2a562323e service nova] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:35.416885 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1221/2445] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:51:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:51:40.561481 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=67,keystone:DELETE=11,keystone:INSERT=2 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:44.018607 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8f52ed-aba1-4f20-b6fc-97a936c07969 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:44.020119 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-2a8f52ed-aba1-4f20-b6fc-97a936c07969 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:44.078029 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8f52ed-aba1-4f20-b6fc-97a936c07969 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:44.081605 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68876b66-707d-4b0c-a354-bc5b6a81607c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:44.082205 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68876b66-707d-4b0c-a354-bc5b6a81607c service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:44.082480 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68876b66-707d-4b0c-a354-bc5b6a81607c service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:44.082747 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68876b66-707d-4b0c-a354-bc5b6a81607c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:44.084446 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-68876b66-707d-4b0c-a354-bc5b6a81607c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:44.146934 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68876b66-707d-4b0c-a354-bc5b6a81607c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:44.148331 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68876b66-707d-4b0c-a354-bc5b6a81607c service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:44.159513 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1225/2446] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:51:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:51:45.411979 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=44 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:47.342318 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8578839-eeea-47f6-958c-d2b2a562323e service nova] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:47.344765 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-a8578839-eeea-47f6-958c-d2b2a562323e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:47.364791 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8578839-eeea-47f6-958c-d2b2a562323e service nova] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:47.370647 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b802a4e-7521-418c-87c4-b301c499c890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:47.371428 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b802a4e-7521-418c-87c4-b301c499c890 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:47.371804 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b802a4e-7521-418c-87c4-b301c499c890 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:47.372149 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b802a4e-7521-418c-87c4-b301c499c890 admin admin] PATH_INFO: `/v3/users/50f7df9dc9f2455d9426b1737770140f` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:47.373383 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b802a4e-7521-418c-87c4-b301c499c890 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50f7df9dc9f2455d9426b1737770140f)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:47.375444 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b802a4e-7521-418c-87c4-b301c499c890 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:47.435487 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-9b802a4e-7521-418c-87c4-b301c499c890 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50f7df9dc9f2455d9426b1737770140f'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:47.442606 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-9b802a4e-7521-418c-87c4-b301c499c890 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50f7df9dc9f2455d9426b1737770140f'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:47.443287 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-9b802a4e-7521-418c-87c4-b301c499c890 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50f7df9dc9f2455d9426b1737770140f'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:47.456708 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-9b802a4e-7521-418c-87c4-b301c499c890 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50f7df9dc9f2455d9426b1737770140f'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:47.465504 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-9b802a4e-7521-418c-87c4-b301c499c890 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50f7df9dc9f2455d9426b1737770140f'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:47.471840 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1222/2447] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:51:47 2022] DELETE /identity/v3/users/50f7df9dc9f2455d9426b1737770140f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:51:47.645547 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68876b66-707d-4b0c-a354-bc5b6a81607c service neutron] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:47.656146 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68876b66-707d-4b0c-a354-bc5b6a81607c service neutron] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:47.715900 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c69b8f-3360-4211-aca2-87aace822589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:47.716530 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c69b8f-3360-4211-aca2-87aace822589 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:47.716812 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c69b8f-3360-4211-aca2-87aace822589 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:47.717090 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c69b8f-3360-4211-aca2-87aace822589 admin admin] PATH_INFO: `/v3/projects/936e89b946f64d9fa2955e1eea57169b` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:47.718374 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c69b8f-3360-4211-aca2-87aace822589 admin admin] RBAC: Authorizing `identity:delete_project(project_id=936e89b946f64d9fa2955e1eea57169b)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:47.720285 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c69b8f-3360-4211-aca2-87aace822589 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:47.767052 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-20c69b8f-3360-4211-aca2-87aace822589 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '936e89b946f64d9fa2955e1eea57169b', 'request_id': 'req-20c69b8f-3360-4211-aca2-87aace822589'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:47.768993 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:47.773476 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-20c69b8f-3360-4211-aca2-87aace822589 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '936e89b946f64d9fa2955e1eea57169b', 'request_id': 'req-20c69b8f-3360-4211-aca2-87aace822589'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:47.780793 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-20c69b8f-3360-4211-aca2-87aace822589 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '936e89b946f64d9fa2955e1eea57169b', 'request_id': 'req-20c69b8f-3360-4211-aca2-87aace822589'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:47.793623 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-20c69b8f-3360-4211-aca2-87aace822589 admin admin] The token cache is being invalidate because project 936e89b946f64d9fa2955e1eea57169b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:51:47.793913 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-20c69b8f-3360-4211-aca2-87aace822589 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:47.794562 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-20c69b8f-3360-4211-aca2-87aace822589 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:47.796062 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1226/2448] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:51:47 2022] DELETE /identity/v3/projects/936e89b946f64d9fa2955e1eea57169b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:51:47.801010 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc4698-143a-44d5-bbde-018aa0ff1a6a None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:47.801304 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc4698-143a-44d5-bbde-018aa0ff1a6a None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:47.801640 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc4698-143a-44d5-bbde-018aa0ff1a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:47.822696 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-6bfc4698-143a-44d5-bbde-018aa0ff1a6a None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:47.823852 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-6bfc4698-143a-44d5-bbde-018aa0ff1a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:47.883512 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1223/2449] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:51:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:51:47.892886 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0267f9-29d3-461e-9448-f473ddd24da7 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:47.893178 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0267f9-29d3-461e-9448-f473ddd24da7 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:47.893488 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0267f9-29d3-461e-9448-f473ddd24da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:47.916080 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-8f0267f9-29d3-461e-9448-f473ddd24da7 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:47.917313 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-8f0267f9-29d3-461e-9448-f473ddd24da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:47.926186 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1227/2450] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:51:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:51:47.930305 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc4698-143a-44d5-bbde-018aa0ff1a6a None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:47.940939 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc4698-143a-44d5-bbde-018aa0ff1a6a None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:47.945695 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01e6968-32d4-476c-b3fd-b56af0fb3a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:47.946465 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e6968-32d4-476c-b3fd-b56af0fb3a03 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:47.947248 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e6968-32d4-476c-b3fd-b56af0fb3a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:47.947248 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e6968-32d4-476c-b3fd-b56af0fb3a03 admin admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:47.947706 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01e6968-32d4-476c-b3fd-b56af0fb3a03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:51:47.948024 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01e6968-32d4-476c-b3fd-b56af0fb3a03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:47.949674 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01e6968-32d4-476c-b3fd-b56af0fb3a03 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:47.962627 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1224/2451] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Aug 29 22:51:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:51:47.966974 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0267f9-29d3-461e-9448-f473ddd24da7 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:47.976471 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0267f9-29d3-461e-9448-f473ddd24da7 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:47.982037 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4300e692-549e-46ff-9c9f-f25b76231a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:47.982643 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300e692-549e-46ff-9c9f-f25b76231a94 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:47.982957 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300e692-549e-46ff-9c9f-f25b76231a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:47.983222 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300e692-549e-46ff-9c9f-f25b76231a94 admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:47.983868 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4300e692-549e-46ff-9c9f-f25b76231a94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:47.985833 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4300e692-549e-46ff-9c9f-f25b76231a94 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:48.013610 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1228/2452] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:51:47 2022] POST /identity/v3/projects => generated 405 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:51:48.017744 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01e6968-32d4-476c-b3fd-b56af0fb3a03 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:48.029203 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01e6968-32d4-476c-b3fd-b56af0fb3a03 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:48.087613 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a063cbc9-2f76-4f95-987d-8c9905d84d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:48.088141 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063cbc9-2f76-4f95-987d-8c9905d84d92 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:48.088414 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063cbc9-2f76-4f95-987d-8c9905d84d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:48.088686 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063cbc9-2f76-4f95-987d-8c9905d84d92 admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:48.089343 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a063cbc9-2f76-4f95-987d-8c9905d84d92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:48.091293 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a063cbc9-2f76-4f95-987d-8c9905d84d92 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:48.099317 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:48.114542 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1225/2453] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:51:48 2022] POST /identity/v3/users => generated 303 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:51:48.119036 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4300e692-549e-46ff-9c9f-f25b76231a94 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:48.129538 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4300e692-549e-46ff-9c9f-f25b76231a94 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:48.135121 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a106b4-cc5d-46fa-b3e3-9e0ebaad24e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:48.135721 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a106b4-cc5d-46fa-b3e3-9e0ebaad24e3 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:48.136002 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a106b4-cc5d-46fa-b3e3-9e0ebaad24e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:48.136275 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a106b4-cc5d-46fa-b3e3-9e0ebaad24e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:48.136917 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a106b4-cc5d-46fa-b3e3-9e0ebaad24e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:48.138549 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a106b4-cc5d-46fa-b3e3-9e0ebaad24e3 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:48.149254 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1229/2454] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:51:48.154160 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a063cbc9-2f76-4f95-987d-8c9905d84d92 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:48.164444 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a063cbc9-2f76-4f95-987d-8c9905d84d92 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:48.169223 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f7ee4-1890-4ce7-aaac-92e97841037a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:48.169891 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f7ee4-1890-4ce7-aaac-92e97841037a admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:48.170169 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f7ee4-1890-4ce7-aaac-92e97841037a admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:48.170444 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f7ee4-1890-4ce7-aaac-92e97841037a admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:48.171071 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15f7ee4-1890-4ce7-aaac-92e97841037a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:48.172638 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15f7ee4-1890-4ce7-aaac-92e97841037a admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:48.183256 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1226/2455] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:51:48.187466 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a106b4-cc5d-46fa-b3e3-9e0ebaad24e3 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:48.198078 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a106b4-cc5d-46fa-b3e3-9e0ebaad24e3 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:48.202754 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f703452-0b4c-43c9-8e15-cc6ddfe71763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:48.203393 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f703452-0b4c-43c9-8e15-cc6ddfe71763 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:48.203672 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f703452-0b4c-43c9-8e15-cc6ddfe71763 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:48.203942 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f703452-0b4c-43c9-8e15-cc6ddfe71763 admin admin] PATH_INFO: `/v3/projects/0df5fcf4ff574554b08840d2fb737e6e/users/2e35d3beebc1436b90002d23e97ca8b1/roles/0c67797d444d4c929b2ccab47c468848` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:48.219298 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f703452-0b4c-43c9-8e15-cc6ddfe71763 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0df5fcf4ff574554b08840d2fb737e6e, user_id=2e35d3beebc1436b90002d23e97ca8b1, role_id=0c67797d444d4c929b2ccab47c468848)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:48.221974 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f703452-0b4c-43c9-8e15-cc6ddfe71763 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:48.236253 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1230/2456] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:51:48 2022] PUT /identity/v3/projects/0df5fcf4ff574554b08840d2fb737e6e/users/2e35d3beebc1436b90002d23e97ca8b1/roles/0c67797d444d4c929b2ccab47c468848 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:51:48.241220 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508d9dc-953f-4e66-9466-2a910933c5f1 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:48.241554 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508d9dc-953f-4e66-9466-2a910933c5f1 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:48.241828 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508d9dc-953f-4e66-9466-2a910933c5f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:48.261115 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-8508d9dc-953f-4e66-9466-2a910933c5f1 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:48.262381 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-8508d9dc-953f-4e66-9466-2a910933c5f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:48.324825 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1227/2457] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:51:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:51:48.334585 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f703452-0b4c-43c9-8e15-cc6ddfe71763 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:48.336298 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-3f703452-0b4c-43c9-8e15-cc6ddfe71763 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:48.394094 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f703452-0b4c-43c9-8e15-cc6ddfe71763 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:48.397668 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac81b2f7-a369-470a-b8e2-5e54c88225d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:48.398261 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac81b2f7-a369-470a-b8e2-5e54c88225d6 service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:48.398532 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac81b2f7-a369-470a-b8e2-5e54c88225d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:48.398795 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac81b2f7-a369-470a-b8e2-5e54c88225d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:48.408571 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac81b2f7-a369-470a-b8e2-5e54c88225d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:48.410023 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac81b2f7-a369-470a-b8e2-5e54c88225d6 service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:48.419379 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1231/2458] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:51:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:51:49.059496 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d9b4f-1282-4f3a-a096-a27234468eb8 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:49.060071 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d9b4f-1282-4f3a-a096-a27234468eb8 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:49.060564 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d9b4f-1282-4f3a-a096-a27234468eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:49.095457 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-607d9b4f-1282-4f3a-a096-a27234468eb8 None None] MFA Rules not processed for user `2e35d3beebc1436b90002d23e97ca8b1`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:49.097067 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-607d9b4f-1282-4f3a-a096-a27234468eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:49.170583 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1228/2459] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:51:49 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:51:49.175526 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac81b2f7-a369-470a-b8e2-5e54c88225d6 service neutron] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:49.186798 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac81b2f7-a369-470a-b8e2-5e54c88225d6 service neutron] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:49.193398 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5899dbc-096c-483c-a0be-15b0836e4a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:49.194284 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5899dbc-096c-483c-a0be-15b0836e4a05 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:49.194767 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5899dbc-096c-483c-a0be-15b0836e4a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:49.195246 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5899dbc-096c-483c-a0be-15b0836e4a05 admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:49.196241 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5899dbc-096c-483c-a0be-15b0836e4a05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:49.198877 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5899dbc-096c-483c-a0be-15b0836e4a05 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:49.237068 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1232/2460] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:51:49 2022] POST /identity/v3/projects => generated 405 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:51:49.241682 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d9b4f-1282-4f3a-a096-a27234468eb8 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:49.258349 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d9b4f-1282-4f3a-a096-a27234468eb8 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:49.322043 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b503a3da-0d91-4275-90dd-dc6958c140c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:49.322859 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b503a3da-0d91-4275-90dd-dc6958c140c3 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:49.323140 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b503a3da-0d91-4275-90dd-dc6958c140c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:49.323412 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b503a3da-0d91-4275-90dd-dc6958c140c3 admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:49.324078 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b503a3da-0d91-4275-90dd-dc6958c140c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:49.326078 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b503a3da-0d91-4275-90dd-dc6958c140c3 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:49.343829 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:49.353658 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1229/2461] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:51:49 2022] POST /identity/v3/users => generated 309 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:51:49.355157 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5899dbc-096c-483c-a0be-15b0836e4a05 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:49.370423 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5899dbc-096c-483c-a0be-15b0836e4a05 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:49.376691 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d537f-7aba-4fe7-8868-91626c361630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:49.377628 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d537f-7aba-4fe7-8868-91626c361630 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:49.377628 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d537f-7aba-4fe7-8868-91626c361630 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:49.377875 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d537f-7aba-4fe7-8868-91626c361630 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:49.378526 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5d537f-7aba-4fe7-8868-91626c361630 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:49.380546 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5d537f-7aba-4fe7-8868-91626c361630 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:49.392548 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1233/2462] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:51:49 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:51:49.397012 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b503a3da-0d91-4275-90dd-dc6958c140c3 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:49.408039 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b503a3da-0d91-4275-90dd-dc6958c140c3 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:49.412865 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9560952-68da-4918-a259-87dc43054cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:49.417549 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9560952-68da-4918-a259-87dc43054cbb admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:49.417846 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9560952-68da-4918-a259-87dc43054cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:49.418586 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9560952-68da-4918-a259-87dc43054cbb admin admin] PATH_INFO: `/v3/projects/6519c75fd23f4a42b8aa42171fca0b7e/users/38943608e14a42e6ba91d8304fa10225/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:49.438467 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9560952-68da-4918-a259-87dc43054cbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=6519c75fd23f4a42b8aa42171fca0b7e, user_id=38943608e14a42e6ba91d8304fa10225, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:49.442035 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9560952-68da-4918-a259-87dc43054cbb admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:49.456294 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1230/2463] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:51:49 2022] PUT /identity/v3/projects/6519c75fd23f4a42b8aa42171fca0b7e/users/38943608e14a42e6ba91d8304fa10225/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:51:49.460325 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d537f-7aba-4fe7-8868-91626c361630 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:49.470566 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d537f-7aba-4fe7-8868-91626c361630 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:49.514806 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:49.528943 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2bc35b-b2f9-49f5-a550-7dfcfd0e66cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:49.529578 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2bc35b-b2f9-49f5-a550-7dfcfd0e66cb admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:49.530108 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2bc35b-b2f9-49f5-a550-7dfcfd0e66cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:49.530382 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2bc35b-b2f9-49f5-a550-7dfcfd0e66cb admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:49.531043 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2bc35b-b2f9-49f5-a550-7dfcfd0e66cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:49.532630 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2bc35b-b2f9-49f5-a550-7dfcfd0e66cb admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:49.542326 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1234/2464] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:51:49 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:51:49.547554 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9560952-68da-4918-a259-87dc43054cbb admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:49.560231 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9560952-68da-4918-a259-87dc43054cbb admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:49.566128 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee042b60-cd7a-4fe2-b345-64884c0e6169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:49.566926 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee042b60-cd7a-4fe2-b345-64884c0e6169 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:49.567308 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee042b60-cd7a-4fe2-b345-64884c0e6169 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:49.567852 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee042b60-cd7a-4fe2-b345-64884c0e6169 admin admin] PATH_INFO: `/v3/projects/6519c75fd23f4a42b8aa42171fca0b7e/users/38943608e14a42e6ba91d8304fa10225/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:49.570493 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee042b60-cd7a-4fe2-b345-64884c0e6169 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6519c75fd23f4a42b8aa42171fca0b7e, user_id=38943608e14a42e6ba91d8304fa10225, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:49.574219 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee042b60-cd7a-4fe2-b345-64884c0e6169 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:49.584692 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1231/2465] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:51:49 2022] PUT /identity/v3/projects/6519c75fd23f4a42b8aa42171fca0b7e/users/38943608e14a42e6ba91d8304fa10225/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:51:50.209514 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab6171a-f895-4250-a7fe-b79e5b3cb760 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:50.210010 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab6171a-f895-4250-a7fe-b79e5b3cb760 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:50.210105 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab6171a-f895-4250-a7fe-b79e5b3cb760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:50.238509 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-7ab6171a-f895-4250-a7fe-b79e5b3cb760 None None] MFA Rules not processed for user `38943608e14a42e6ba91d8304fa10225`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:50.239841 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-7ab6171a-f895-4250-a7fe-b79e5b3cb760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:50.314164 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1235/2466] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:51:50 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:51:50.774823 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee042b60-cd7a-4fe2-b345-64884c0e6169 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:50.777209 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-ee042b60-cd7a-4fe2-b345-64884c0e6169 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:50.872812 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee042b60-cd7a-4fe2-b345-64884c0e6169 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:50.878216 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa56081-ac96-4440-96d0-e21d5340e183 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296cbef772104e078971ba93aa2e022c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:50.878869 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa56081-ac96-4440-96d0-e21d5340e183 service placement] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:50.879156 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa56081-ac96-4440-96d0-e21d5340e183 service placement] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:50.879425 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa56081-ac96-4440-96d0-e21d5340e183 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:50.881149 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-3aa56081-ac96-4440-96d0-e21d5340e183 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:50.893714 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa56081-ac96-4440-96d0-e21d5340e183 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:50.895435 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa56081-ac96-4440-96d0-e21d5340e183 service placement] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:50.907260 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1232/2467] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:51:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:51:51.342072 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab6171a-f895-4250-a7fe-b79e5b3cb760 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:51.407452 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab6171a-f895-4250-a7fe-b79e5b3cb760 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:51.412268 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f08cdc7-7756-4b38-9485-a19584f9eeab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:51.412923 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f08cdc7-7756-4b38-9485-a19584f9eeab admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:51.413204 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f08cdc7-7756-4b38-9485-a19584f9eeab admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:51.413528 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f08cdc7-7756-4b38-9485-a19584f9eeab admin admin] PATH_INFO: `/v3/users/2e35d3beebc1436b90002d23e97ca8b1` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:51.414681 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f08cdc7-7756-4b38-9485-a19584f9eeab admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e35d3beebc1436b90002d23e97ca8b1)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:51.416662 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f08cdc7-7756-4b38-9485-a19584f9eeab admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:51.462468 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-1f08cdc7-7756-4b38-9485-a19584f9eeab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e35d3beebc1436b90002d23e97ca8b1'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:51.470162 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-1f08cdc7-7756-4b38-9485-a19584f9eeab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e35d3beebc1436b90002d23e97ca8b1'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:51.470783 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-1f08cdc7-7756-4b38-9485-a19584f9eeab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e35d3beebc1436b90002d23e97ca8b1'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:51.480119 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-1f08cdc7-7756-4b38-9485-a19584f9eeab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e35d3beebc1436b90002d23e97ca8b1'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:51.481048 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-1f08cdc7-7756-4b38-9485-a19584f9eeab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e35d3beebc1436b90002d23e97ca8b1'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:51.487950 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:51.502440 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1236/2468] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:51:51 2022] DELETE /identity/v3/users/2e35d3beebc1436b90002d23e97ca8b1 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:51:51.903613 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa56081-ac96-4440-96d0-e21d5340e183 service placement] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:51.914894 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa56081-ac96-4440-96d0-e21d5340e183 service placement] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:51.972658 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d8d7b-557c-4fc5-91a0-3aee712f4283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:51.973291 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d8d7b-557c-4fc5-91a0-3aee712f4283 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:51.973598 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d8d7b-557c-4fc5-91a0-3aee712f4283 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:51.973874 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d8d7b-557c-4fc5-91a0-3aee712f4283 admin admin] PATH_INFO: `/v3/projects/0df5fcf4ff574554b08840d2fb737e6e` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:51.974978 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0d8d7b-557c-4fc5-91a0-3aee712f4283 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0df5fcf4ff574554b08840d2fb737e6e)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:51.976868 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0d8d7b-557c-4fc5-91a0-3aee712f4283 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:52.022313 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-3d0d8d7b-557c-4fc5-91a0-3aee712f4283 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0df5fcf4ff574554b08840d2fb737e6e', 'request_id': 'req-3d0d8d7b-557c-4fc5-91a0-3aee712f4283'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:52.024313 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:52.030543 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-3d0d8d7b-557c-4fc5-91a0-3aee712f4283 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0df5fcf4ff574554b08840d2fb737e6e', 'request_id': 'req-3d0d8d7b-557c-4fc5-91a0-3aee712f4283'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:52.036868 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-3d0d8d7b-557c-4fc5-91a0-3aee712f4283 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0df5fcf4ff574554b08840d2fb737e6e', 'request_id': 'req-3d0d8d7b-557c-4fc5-91a0-3aee712f4283'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:52.049342 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-3d0d8d7b-557c-4fc5-91a0-3aee712f4283 admin admin] The token cache is being invalidate because project 0df5fcf4ff574554b08840d2fb737e6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:51:52.049648 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-3d0d8d7b-557c-4fc5-91a0-3aee712f4283 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:52.050263 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-3d0d8d7b-557c-4fc5-91a0-3aee712f4283 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:52.051787 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1233/2469] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:51:51 2022] DELETE /identity/v3/projects/0df5fcf4ff574554b08840d2fb737e6e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:51:52.055795 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f08cdc7-7756-4b38-9485-a19584f9eeab admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:52.058137 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-1f08cdc7-7756-4b38-9485-a19584f9eeab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:52.071189 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f08cdc7-7756-4b38-9485-a19584f9eeab admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:52.128414 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41892883-ad33-463a-9843-297494634926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:52.129070 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41892883-ad33-463a-9843-297494634926 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:52.129374 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41892883-ad33-463a-9843-297494634926 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:52.129651 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41892883-ad33-463a-9843-297494634926 admin admin] PATH_INFO: `/v3/users/38943608e14a42e6ba91d8304fa10225` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:52.130796 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41892883-ad33-463a-9843-297494634926 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38943608e14a42e6ba91d8304fa10225)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:52.132713 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41892883-ad33-463a-9843-297494634926 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:52.180498 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-41892883-ad33-463a-9843-297494634926 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38943608e14a42e6ba91d8304fa10225'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:52.188159 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-41892883-ad33-463a-9843-297494634926 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38943608e14a42e6ba91d8304fa10225'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:52.188832 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-41892883-ad33-463a-9843-297494634926 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38943608e14a42e6ba91d8304fa10225'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:52.196496 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-41892883-ad33-463a-9843-297494634926 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38943608e14a42e6ba91d8304fa10225'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:52.197101 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-41892883-ad33-463a-9843-297494634926 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38943608e14a42e6ba91d8304fa10225'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:52.215180 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1237/2470] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:51:52 2022] DELETE /identity/v3/users/38943608e14a42e6ba91d8304fa10225 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:51:52.392957 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d8d7b-557c-4fc5-91a0-3aee712f4283 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:52.394700 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-3d0d8d7b-557c-4fc5-91a0-3aee712f4283 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:52.409197 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d8d7b-557c-4fc5-91a0-3aee712f4283 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:52.468264 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c184d-eed2-426d-86e2-e98d45cebdea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:52.468903 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c184d-eed2-426d-86e2-e98d45cebdea admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:52.469182 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c184d-eed2-426d-86e2-e98d45cebdea admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:52.469490 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c184d-eed2-426d-86e2-e98d45cebdea admin admin] PATH_INFO: `/v3/projects/6519c75fd23f4a42b8aa42171fca0b7e` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:52.470602 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562c184d-eed2-426d-86e2-e98d45cebdea admin admin] RBAC: Authorizing `identity:delete_project(project_id=6519c75fd23f4a42b8aa42171fca0b7e)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:52.472559 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562c184d-eed2-426d-86e2-e98d45cebdea admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:52.518290 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-562c184d-eed2-426d-86e2-e98d45cebdea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6519c75fd23f4a42b8aa42171fca0b7e', 'request_id': 'req-562c184d-eed2-426d-86e2-e98d45cebdea'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:52.524306 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-562c184d-eed2-426d-86e2-e98d45cebdea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6519c75fd23f4a42b8aa42171fca0b7e', 'request_id': 'req-562c184d-eed2-426d-86e2-e98d45cebdea'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:52.530942 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-562c184d-eed2-426d-86e2-e98d45cebdea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6519c75fd23f4a42b8aa42171fca0b7e', 'request_id': 'req-562c184d-eed2-426d-86e2-e98d45cebdea'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:52.543696 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-562c184d-eed2-426d-86e2-e98d45cebdea admin admin] The token cache is being invalidate because project 6519c75fd23f4a42b8aa42171fca0b7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:51:52.543945 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-562c184d-eed2-426d-86e2-e98d45cebdea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:52.544568 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-562c184d-eed2-426d-86e2-e98d45cebdea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:51:52.546089 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1234/2471] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:51:52 2022] DELETE /identity/v3/projects/6519c75fd23f4a42b8aa42171fca0b7e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:51:52.550953 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170645e-94bf-4abe-86fe-e559e1cd9d05 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:52.551413 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170645e-94bf-4abe-86fe-e559e1cd9d05 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:52.551509 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170645e-94bf-4abe-86fe-e559e1cd9d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:52.572907 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-1170645e-94bf-4abe-86fe-e559e1cd9d05 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:52.574219 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-1170645e-94bf-4abe-86fe-e559e1cd9d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:52.633990 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1238/2472] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:51:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:51:52.643543 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80231f61-c65a-4f3c-abae-f17f1cbf0176 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:52.643832 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80231f61-c65a-4f3c-abae-f17f1cbf0176 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:52.644108 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80231f61-c65a-4f3c-abae-f17f1cbf0176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:52.664753 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-80231f61-c65a-4f3c-abae-f17f1cbf0176 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:52.666007 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-80231f61-c65a-4f3c-abae-f17f1cbf0176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:52.674158 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1235/2473] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:51:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:51:52.678412 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170645e-94bf-4abe-86fe-e559e1cd9d05 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:52.688318 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170645e-94bf-4abe-86fe-e559e1cd9d05 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:52.692921 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b792e6-8c00-4b8a-8f73-aadf4b4bdce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:52.693568 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b792e6-8c00-4b8a-8f73-aadf4b4bdce4 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:52.693829 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b792e6-8c00-4b8a-8f73-aadf4b4bdce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:52.694097 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b792e6-8c00-4b8a-8f73-aadf4b4bdce4 admin admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:52.694744 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b792e6-8c00-4b8a-8f73-aadf4b4bdce4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:51:52.695042 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b792e6-8c00-4b8a-8f73-aadf4b4bdce4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:52.696632 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b792e6-8c00-4b8a-8f73-aadf4b4bdce4 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:52.698665 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:52.710617 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1239/2474] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Aug 29 22:51:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:51:52.715558 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80231f61-c65a-4f3c-abae-f17f1cbf0176 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:52.725065 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80231f61-c65a-4f3c-abae-f17f1cbf0176 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:52.729787 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8017f3b0-334d-4586-8c76-f0e532babf54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:52.730382 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8017f3b0-334d-4586-8c76-f0e532babf54 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:52.730658 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8017f3b0-334d-4586-8c76-f0e532babf54 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:52.730925 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8017f3b0-334d-4586-8c76-f0e532babf54 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:52.731558 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8017f3b0-334d-4586-8c76-f0e532babf54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:52.733488 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8017f3b0-334d-4586-8c76-f0e532babf54 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:52.759447 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1236/2475] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:51:52 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:51:52.764438 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b792e6-8c00-4b8a-8f73-aadf4b4bdce4 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:52.774678 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b792e6-8c00-4b8a-8f73-aadf4b4bdce4 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:52.830964 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a7546-3fe9-491c-bcb3-02d10844cdc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:52.831570 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a7546-3fe9-491c-bcb3-02d10844cdc5 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:52.831850 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a7546-3fe9-491c-bcb3-02d10844cdc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:52.832129 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a7546-3fe9-491c-bcb3-02d10844cdc5 admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:52.832752 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94a7546-3fe9-491c-bcb3-02d10844cdc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:52.834740 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94a7546-3fe9-491c-bcb3-02d10844cdc5 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:52.855886 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1240/2476] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:51:52 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:51:52.859976 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8017f3b0-334d-4586-8c76-f0e532babf54 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:52.870496 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8017f3b0-334d-4586-8c76-f0e532babf54 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:52.875848 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36025f6-f4e7-45cc-8e52-5351119ad1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:52.876466 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36025f6-f4e7-45cc-8e52-5351119ad1a0 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:52.876751 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36025f6-f4e7-45cc-8e52-5351119ad1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:52.877024 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36025f6-f4e7-45cc-8e52-5351119ad1a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:52.877704 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36025f6-f4e7-45cc-8e52-5351119ad1a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:52.879303 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36025f6-f4e7-45cc-8e52-5351119ad1a0 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:52.890048 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1237/2477] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:51:52.894066 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a7546-3fe9-491c-bcb3-02d10844cdc5 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:52.904778 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a7546-3fe9-491c-bcb3-02d10844cdc5 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:52.909778 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c377260-b67f-459a-8f7d-003e21f0b9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:52.910374 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c377260-b67f-459a-8f7d-003e21f0b9dc admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:52.910679 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c377260-b67f-459a-8f7d-003e21f0b9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:52.910952 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c377260-b67f-459a-8f7d-003e21f0b9dc admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:52.911595 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c377260-b67f-459a-8f7d-003e21f0b9dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:52.913190 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c377260-b67f-459a-8f7d-003e21f0b9dc admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:52.923794 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1241/2478] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:51:52.927947 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36025f6-f4e7-45cc-8e52-5351119ad1a0 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:52.938249 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36025f6-f4e7-45cc-8e52-5351119ad1a0 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:52.942924 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc08387-ef7b-44ec-a0cd-330f64949bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:52.943576 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc08387-ef7b-44ec-a0cd-330f64949bcb admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:52.943859 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc08387-ef7b-44ec-a0cd-330f64949bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:52.944136 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc08387-ef7b-44ec-a0cd-330f64949bcb admin admin] PATH_INFO: `/v3/projects/69eeca8c9e98492da5f8fa0b86d5e9bd/users/9fdc601e44154deba0a7e7915c517c7f/roles/0c67797d444d4c929b2ccab47c468848` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:52.959618 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc08387-ef7b-44ec-a0cd-330f64949bcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=69eeca8c9e98492da5f8fa0b86d5e9bd, user_id=9fdc601e44154deba0a7e7915c517c7f, role_id=0c67797d444d4c929b2ccab47c468848)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:52.962365 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc08387-ef7b-44ec-a0cd-330f64949bcb admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:52.976181 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1238/2479] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:51:52 2022] PUT /identity/v3/projects/69eeca8c9e98492da5f8fa0b86d5e9bd/users/9fdc601e44154deba0a7e7915c517c7f/roles/0c67797d444d4c929b2ccab47c468848 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:51:52.986475 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe0ca42-cc97-4de6-b011-c498986ae20e None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:52.986766 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe0ca42-cc97-4de6-b011-c498986ae20e None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:52.987098 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe0ca42-cc97-4de6-b011-c498986ae20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:53.016203 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-cfe0ca42-cc97-4de6-b011-c498986ae20e None None] MFA Rules not processed for user `9fdc601e44154deba0a7e7915c517c7f`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:53.017466 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-cfe0ca42-cc97-4de6-b011-c498986ae20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:53.082697 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1242/2480] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:51:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:51:53.087228 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc08387-ef7b-44ec-a0cd-330f64949bcb admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:53.096239 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:53.152946 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc08387-ef7b-44ec-a0cd-330f64949bcb admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:53.158134 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9735d-388b-4b6b-8bf9-c2a7b600ce80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:53.158746 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9735d-388b-4b6b-8bf9-c2a7b600ce80 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:53.159033 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9735d-388b-4b6b-8bf9-c2a7b600ce80 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:53.159306 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9735d-388b-4b6b-8bf9-c2a7b600ce80 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:53.159953 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb9735d-388b-4b6b-8bf9-c2a7b600ce80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:53.161937 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb9735d-388b-4b6b-8bf9-c2a7b600ce80 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:53.189078 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1239/2481] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:51:53 2022] POST /identity/v3/projects => generated 371 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:51:53.193191 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe0ca42-cc97-4de6-b011-c498986ae20e None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:53.205748 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe0ca42-cc97-4de6-b011-c498986ae20e None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:53.262054 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb24bb6-a9ac-452e-8f9c-08d78d371632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:53.262659 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb24bb6-a9ac-452e-8f9c-08d78d371632 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:53.262940 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb24bb6-a9ac-452e-8f9c-08d78d371632 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:53.263212 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb24bb6-a9ac-452e-8f9c-08d78d371632 admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:53.263853 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb24bb6-a9ac-452e-8f9c-08d78d371632 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:53.265818 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb24bb6-a9ac-452e-8f9c-08d78d371632 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:53.274856 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:53.290299 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1243/2482] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:51:53 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:51:53.295234 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9735d-388b-4b6b-8bf9-c2a7b600ce80 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:53.305683 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9735d-388b-4b6b-8bf9-c2a7b600ce80 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:53.311586 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979073b1-8b2f-45b3-82e0-94b6bd808b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:53.312203 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979073b1-8b2f-45b3-82e0-94b6bd808b70 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:53.312488 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979073b1-8b2f-45b3-82e0-94b6bd808b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:53.312763 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979073b1-8b2f-45b3-82e0-94b6bd808b70 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:53.313432 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979073b1-8b2f-45b3-82e0-94b6bd808b70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:53.315093 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979073b1-8b2f-45b3-82e0-94b6bd808b70 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:53.331027 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1240/2483] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:51:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:51:53.336207 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb24bb6-a9ac-452e-8f9c-08d78d371632 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:53.347660 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb24bb6-a9ac-452e-8f9c-08d78d371632 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:53.352520 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec70cf42-3bb4-4008-a948-d9c6a1a9fb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:53.353172 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec70cf42-3bb4-4008-a948-d9c6a1a9fb2f admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:53.353466 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec70cf42-3bb4-4008-a948-d9c6a1a9fb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:53.353975 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec70cf42-3bb4-4008-a948-d9c6a1a9fb2f admin admin] PATH_INFO: `/v3/projects/1e8ac2eedf67437f885418be3c16a1a4/users/0ff68fd4238e4e8eb49408678aed15a4/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:53.369457 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec70cf42-3bb4-4008-a948-d9c6a1a9fb2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e8ac2eedf67437f885418be3c16a1a4, user_id=0ff68fd4238e4e8eb49408678aed15a4, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:53.372845 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec70cf42-3bb4-4008-a948-d9c6a1a9fb2f admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:53.385399 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1244/2484] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:51:53 2022] PUT /identity/v3/projects/1e8ac2eedf67437f885418be3c16a1a4/users/0ff68fd4238e4e8eb49408678aed15a4/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:51:53.389360 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979073b1-8b2f-45b3-82e0-94b6bd808b70 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:53.399260 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979073b1-8b2f-45b3-82e0-94b6bd808b70 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:53.455176 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa3c997-829e-420f-911f-66100f741b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:53.455852 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3c997-829e-420f-911f-66100f741b63 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:53.456141 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3c997-829e-420f-911f-66100f741b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:53.456448 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3c997-829e-420f-911f-66100f741b63 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:53.457180 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa3c997-829e-420f-911f-66100f741b63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:53.458814 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa3c997-829e-420f-911f-66100f741b63 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:53.468938 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1241/2485] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:51:53 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:51:53.473120 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec70cf42-3bb4-4008-a948-d9c6a1a9fb2f admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:53.484030 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec70cf42-3bb4-4008-a948-d9c6a1a9fb2f admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:53.488680 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029e19f1-5910-4eeb-a903-123143ec65a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:53.489342 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e19f1-5910-4eeb-a903-123143ec65a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:53.489637 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e19f1-5910-4eeb-a903-123143ec65a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:53.489912 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e19f1-5910-4eeb-a903-123143ec65a0 admin admin] PATH_INFO: `/v3/projects/1e8ac2eedf67437f885418be3c16a1a4/users/0ff68fd4238e4e8eb49408678aed15a4/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:53.491961 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029e19f1-5910-4eeb-a903-123143ec65a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e8ac2eedf67437f885418be3c16a1a4, user_id=0ff68fd4238e4e8eb49408678aed15a4, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:53.494648 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029e19f1-5910-4eeb-a903-123143ec65a0 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:53.505781 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1245/2486] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:51:53 2022] PUT /identity/v3/projects/1e8ac2eedf67437f885418be3c16a1a4/users/0ff68fd4238e4e8eb49408678aed15a4/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:51:53.515965 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ac1a5-02c1-4771-a76c-dc2b37cc89b2 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:53.516257 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ac1a5-02c1-4771-a76c-dc2b37cc89b2 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:53.516538 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ac1a5-02c1-4771-a76c-dc2b37cc89b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:53.545307 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-872ac1a5-02c1-4771-a76c-dc2b37cc89b2 None None] MFA Rules not processed for user `0ff68fd4238e4e8eb49408678aed15a4`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:51:53.546550 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-872ac1a5-02c1-4771-a76c-dc2b37cc89b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:53.614608 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1242/2487] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:51:53 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:51:53.626204 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029e19f1-5910-4eeb-a903-123143ec65a0 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:53.628050 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-029e19f1-5910-4eeb-a903-123143ec65a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:51:53.684824 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029e19f1-5910-4eeb-a903-123143ec65a0 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:53.688459 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf75c3e-3675-43c3-b6c7-819091d94ca9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:53.689049 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf75c3e-3675-43c3-b6c7-819091d94ca9 service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:53.689339 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf75c3e-3675-43c3-b6c7-819091d94ca9 service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:53.689616 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf75c3e-3675-43c3-b6c7-819091d94ca9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:53.699415 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf75c3e-3675-43c3-b6c7-819091d94ca9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:53.700939 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf75c3e-3675-43c3-b6c7-819091d94ca9 service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:53.710754 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1246/2488] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:51:53 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:51:53.789749 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872ac1a5-02c1-4771-a76c-dc2b37cc89b2 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:51:53.794491 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:53.800639 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872ac1a5-02c1-4771-a76c-dc2b37cc89b2 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:51:53.804519 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a3f84b-9b79-4edb-9608-7ebe2166e899 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:51:53.805096 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a3f84b-9b79-4edb-9608-7ebe2166e899 service cinder] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:51:53.805407 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a3f84b-9b79-4edb-9608-7ebe2166e899 service cinder] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:51:53.805684 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a3f84b-9b79-4edb-9608-7ebe2166e899 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:51:53.862452 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a3f84b-9b79-4edb-9608-7ebe2166e899 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:51:53.863884 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a3f84b-9b79-4edb-9608-7ebe2166e899 service cinder] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:51:53.874209 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1243/2489] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:51:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:52:03.706428 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:INSERT=4,keystone:SELECT=43 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:03.868694 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=27 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:11.313532 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf75c3e-3675-43c3-b6c7-819091d94ca9 service cinder] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:11.314950 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-cbf75c3e-3675-43c3-b6c7-819091d94ca9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:11.372727 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf75c3e-3675-43c3-b6c7-819091d94ca9 service cinder] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:11.376285 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b78b44e-ccb9-444a-8319-15b3d7d33868 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:11.376880 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78b44e-ccb9-444a-8319-15b3d7d33868 service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:11.377155 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78b44e-ccb9-444a-8319-15b3d7d33868 service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:11.377454 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78b44e-ccb9-444a-8319-15b3d7d33868 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:11.379164 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-8b78b44e-ccb9-444a-8319-15b3d7d33868 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:11.441996 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b78b44e-ccb9-444a-8319-15b3d7d33868 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:11.443434 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b78b44e-ccb9-444a-8319-15b3d7d33868 service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:11.446719 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a3f84b-9b79-4edb-9608-7ebe2166e899 service cinder] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:11.449188 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-60a3f84b-9b79-4edb-9608-7ebe2166e899 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:11.454282 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1247/2490] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:52:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:52:11.531767 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a3f84b-9b79-4edb-9608-7ebe2166e899 service cinder] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:11.537279 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13aa95-7fdd-49c7-9f7b-5c701902ba4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35441c061e514b1b9341e7694ec2c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:11.537913 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13aa95-7fdd-49c7-9f7b-5c701902ba4c service nova] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:11.538192 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13aa95-7fdd-49c7-9f7b-5c701902ba4c service nova] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:11.538466 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13aa95-7fdd-49c7-9f7b-5c701902ba4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:11.540218 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-5c13aa95-7fdd-49c7-9f7b-5c701902ba4c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:11.606301 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c13aa95-7fdd-49c7-9f7b-5c701902ba4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:11.607872 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c13aa95-7fdd-49c7-9f7b-5c701902ba4c service nova] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:11.617433 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1244/2491] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:52:11 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:52:14.956998 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b78b44e-ccb9-444a-8319-15b3d7d33868 service neutron] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:14.958658 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-8b78b44e-ccb9-444a-8319-15b3d7d33868 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:14.974263 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b78b44e-ccb9-444a-8319-15b3d7d33868 service neutron] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:14.979037 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93736400-81da-4cca-9012-7b9ca09dc413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:14.980243 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93736400-81da-4cca-9012-7b9ca09dc413 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:14.980661 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93736400-81da-4cca-9012-7b9ca09dc413 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:14.981417 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93736400-81da-4cca-9012-7b9ca09dc413 admin admin] PATH_INFO: `/v3/users/e2710a23114c4962a06886572be82b12` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:14.982669 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93736400-81da-4cca-9012-7b9ca09dc413 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2710a23114c4962a06886572be82b12)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:14.984788 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93736400-81da-4cca-9012-7b9ca09dc413 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:15.040296 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-93736400-81da-4cca-9012-7b9ca09dc413 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2710a23114c4962a06886572be82b12'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:15.048446 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-93736400-81da-4cca-9012-7b9ca09dc413 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2710a23114c4962a06886572be82b12'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:15.049007 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-93736400-81da-4cca-9012-7b9ca09dc413 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2710a23114c4962a06886572be82b12'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:15.058429 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-93736400-81da-4cca-9012-7b9ca09dc413 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2710a23114c4962a06886572be82b12'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:15.059467 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-93736400-81da-4cca-9012-7b9ca09dc413 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2710a23114c4962a06886572be82b12'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:15.081607 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1248/2492] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:52:14 2022] DELETE /identity/v3/users/e2710a23114c4962a06886572be82b12 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:52:15.274066 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13aa95-7fdd-49c7-9f7b-5c701902ba4c service nova] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:15.287734 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13aa95-7fdd-49c7-9f7b-5c701902ba4c service nova] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:15.351902 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04725665-bdd4-4bd7-9955-6864f7ffab21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:15.352541 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04725665-bdd4-4bd7-9955-6864f7ffab21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:15.352914 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04725665-bdd4-4bd7-9955-6864f7ffab21 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:15.353287 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04725665-bdd4-4bd7-9955-6864f7ffab21 admin admin] PATH_INFO: `/v3/projects/ee915667d25b467f972a68e68b08a8b6` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:15.355412 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04725665-bdd4-4bd7-9955-6864f7ffab21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee915667d25b467f972a68e68b08a8b6)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:15.358049 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04725665-bdd4-4bd7-9955-6864f7ffab21 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:15.401513 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:15.410695 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-04725665-bdd4-4bd7-9955-6864f7ffab21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee915667d25b467f972a68e68b08a8b6', 'request_id': 'req-04725665-bdd4-4bd7-9955-6864f7ffab21'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:15.418770 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-04725665-bdd4-4bd7-9955-6864f7ffab21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee915667d25b467f972a68e68b08a8b6', 'request_id': 'req-04725665-bdd4-4bd7-9955-6864f7ffab21'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:15.424643 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-04725665-bdd4-4bd7-9955-6864f7ffab21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee915667d25b467f972a68e68b08a8b6', 'request_id': 'req-04725665-bdd4-4bd7-9955-6864f7ffab21'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:15.438418 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-04725665-bdd4-4bd7-9955-6864f7ffab21 admin admin] The token cache is being invalidate because project ee915667d25b467f972a68e68b08a8b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:52:15.438713 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-04725665-bdd4-4bd7-9955-6864f7ffab21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:15.439359 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-04725665-bdd4-4bd7-9955-6864f7ffab21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:15.440875 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1245/2493] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:52:15 2022] DELETE /identity/v3/projects/ee915667d25b467f972a68e68b08a8b6 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:52:15.446135 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df7591-8429-420f-8351-9fef3f8156c8 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:15.446460 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df7591-8429-420f-8351-9fef3f8156c8 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:15.446739 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df7591-8429-420f-8351-9fef3f8156c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:15.468301 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-e4df7591-8429-420f-8351-9fef3f8156c8 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:15.469552 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-e4df7591-8429-420f-8351-9fef3f8156c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:15.486809 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:15.534832 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1249/2494] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:52:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:52:15.543210 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22221c4-ea52-476a-9fc7-5e5ad7f450b1 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:15.543521 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22221c4-ea52-476a-9fc7-5e5ad7f450b1 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:15.543812 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22221c4-ea52-476a-9fc7-5e5ad7f450b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:15.566130 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-a22221c4-ea52-476a-9fc7-5e5ad7f450b1 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:15.567353 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-a22221c4-ea52-476a-9fc7-5e5ad7f450b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:15.576464 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1246/2495] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:52:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:52:15.580865 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df7591-8429-420f-8351-9fef3f8156c8 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:15.592371 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df7591-8429-420f-8351-9fef3f8156c8 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:15.597478 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2310700e-3d3c-42af-9e7f-d2e2799f42b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:15.598094 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310700e-3d3c-42af-9e7f-d2e2799f42b7 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:15.598368 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310700e-3d3c-42af-9e7f-d2e2799f42b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:15.598640 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310700e-3d3c-42af-9e7f-d2e2799f42b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:15.599620 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2310700e-3d3c-42af-9e7f-d2e2799f42b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:52:15.599956 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2310700e-3d3c-42af-9e7f-d2e2799f42b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:15.601904 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2310700e-3d3c-42af-9e7f-d2e2799f42b7 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:15.614330 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1250/2496] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Aug 29 22:52:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:52:15.618755 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22221c4-ea52-476a-9fc7-5e5ad7f450b1 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:15.630285 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22221c4-ea52-476a-9fc7-5e5ad7f450b1 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:15.635215 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e8c534-a826-412a-a39e-bd4848cf24e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:15.636794 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e8c534-a826-412a-a39e-bd4848cf24e7 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:15.636794 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e8c534-a826-412a-a39e-bd4848cf24e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:15.637127 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e8c534-a826-412a-a39e-bd4848cf24e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:15.638218 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e8c534-a826-412a-a39e-bd4848cf24e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:15.639779 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e8c534-a826-412a-a39e-bd4848cf24e7 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:15.671876 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1247/2497] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:52:15 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:52:15.673073 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2310700e-3d3c-42af-9e7f-d2e2799f42b7 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:15.684030 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2310700e-3d3c-42af-9e7f-d2e2799f42b7 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:15.745886 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e27508-7f84-429c-a5fc-40953113ee6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:15.746513 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e27508-7f84-429c-a5fc-40953113ee6d admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:15.746784 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e27508-7f84-429c-a5fc-40953113ee6d admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:15.747048 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e27508-7f84-429c-a5fc-40953113ee6d admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:15.747670 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e27508-7f84-429c-a5fc-40953113ee6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:15.749737 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e27508-7f84-429c-a5fc-40953113ee6d admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:15.772718 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1251/2498] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:52:15 2022] POST /identity/v3/users => generated 286 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:52:15.777377 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e8c534-a826-412a-a39e-bd4848cf24e7 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:15.788426 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e8c534-a826-412a-a39e-bd4848cf24e7 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:15.793300 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d94f650-0854-4098-8734-81e921249c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:15.793933 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94f650-0854-4098-8734-81e921249c7b admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:15.794222 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94f650-0854-4098-8734-81e921249c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:15.794491 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94f650-0854-4098-8734-81e921249c7b admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:15.795250 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d94f650-0854-4098-8734-81e921249c7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:15.796842 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d94f650-0854-4098-8734-81e921249c7b admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:15.808140 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1248/2499] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:52:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:52:15.812470 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e27508-7f84-429c-a5fc-40953113ee6d admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:15.825537 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e27508-7f84-429c-a5fc-40953113ee6d admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:15.828904 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83979951-e25d-484f-84d6-551551a1a7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:15.829411 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83979951-e25d-484f-84d6-551551a1a7a0 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:15.829697 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83979951-e25d-484f-84d6-551551a1a7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:15.829978 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83979951-e25d-484f-84d6-551551a1a7a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:15.830624 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83979951-e25d-484f-84d6-551551a1a7a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:15.832342 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83979951-e25d-484f-84d6-551551a1a7a0 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:15.844490 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1252/2500] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:52:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:52:15.848824 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d94f650-0854-4098-8734-81e921249c7b admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:15.859739 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d94f650-0854-4098-8734-81e921249c7b admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:15.864402 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c22304d-4c62-4793-8ad8-cb7b091ecd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:15.865187 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c22304d-4c62-4793-8ad8-cb7b091ecd17 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:15.865504 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c22304d-4c62-4793-8ad8-cb7b091ecd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:15.865786 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c22304d-4c62-4793-8ad8-cb7b091ecd17 admin admin] PATH_INFO: `/v3/projects/5f82102882e14e16a0797073d765488a/users/1305341f1b2f4473a485f102dbc7d62c/roles/0c67797d444d4c929b2ccab47c468848` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:15.880869 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c22304d-4c62-4793-8ad8-cb7b091ecd17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f82102882e14e16a0797073d765488a, user_id=1305341f1b2f4473a485f102dbc7d62c, role_id=0c67797d444d4c929b2ccab47c468848)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:15.883618 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c22304d-4c62-4793-8ad8-cb7b091ecd17 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:15.898788 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1249/2501] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:52:15 2022] PUT /identity/v3/projects/5f82102882e14e16a0797073d765488a/users/1305341f1b2f4473a485f102dbc7d62c/roles/0c67797d444d4c929b2ccab47c468848 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:52:15.910472 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8021adc8-6cc5-4a1d-bbe2-4eb34f2cbdcb None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:15.910768 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8021adc8-6cc5-4a1d-bbe2-4eb34f2cbdcb None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:15.911020 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8021adc8-6cc5-4a1d-bbe2-4eb34f2cbdcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:15.941716 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-8021adc8-6cc5-4a1d-bbe2-4eb34f2cbdcb None None] MFA Rules not processed for user `1305341f1b2f4473a485f102dbc7d62c`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:15.942946 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-8021adc8-6cc5-4a1d-bbe2-4eb34f2cbdcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:16.020037 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1253/2502] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:52:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:52:16.025020 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c22304d-4c62-4793-8ad8-cb7b091ecd17 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:16.099210 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c22304d-4c62-4793-8ad8-cb7b091ecd17 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:16.104769 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca804eb-2140-445e-a556-4c6b7c178f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:16.105709 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca804eb-2140-445e-a556-4c6b7c178f9e admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:16.105990 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca804eb-2140-445e-a556-4c6b7c178f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:16.106260 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca804eb-2140-445e-a556-4c6b7c178f9e admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:16.106913 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca804eb-2140-445e-a556-4c6b7c178f9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:16.108824 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca804eb-2140-445e-a556-4c6b7c178f9e admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:16.142034 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1250/2503] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:52:16 2022] POST /identity/v3/projects => generated 371 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:52:16.146023 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8021adc8-6cc5-4a1d-bbe2-4eb34f2cbdcb None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:16.159343 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8021adc8-6cc5-4a1d-bbe2-4eb34f2cbdcb None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:16.172915 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:16.218310 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b2bf9-3de7-4a6f-9dde-c6ecdf912930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:16.218815 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b2bf9-3de7-4a6f-9dde-c6ecdf912930 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:16.219094 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b2bf9-3de7-4a6f-9dde-c6ecdf912930 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:16.219365 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b2bf9-3de7-4a6f-9dde-c6ecdf912930 admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:16.219989 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0b2bf9-3de7-4a6f-9dde-c6ecdf912930 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:16.221951 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0b2bf9-3de7-4a6f-9dde-c6ecdf912930 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:16.242970 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1254/2504] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:52:16 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:52:16.247277 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca804eb-2140-445e-a556-4c6b7c178f9e admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:16.257900 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca804eb-2140-445e-a556-4c6b7c178f9e admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:16.262663 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade3963c-92dd-4296-bd9c-96030283c405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:16.263273 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3963c-92dd-4296-bd9c-96030283c405 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:16.263556 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3963c-92dd-4296-bd9c-96030283c405 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:16.263831 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3963c-92dd-4296-bd9c-96030283c405 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:16.264540 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade3963c-92dd-4296-bd9c-96030283c405 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:16.266184 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade3963c-92dd-4296-bd9c-96030283c405 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:16.277668 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1251/2505] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:52:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:52:16.281917 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b2bf9-3de7-4a6f-9dde-c6ecdf912930 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:16.293456 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b2bf9-3de7-4a6f-9dde-c6ecdf912930 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:16.299364 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5bae79-1dae-4a9a-8b60-cb1db3769aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:16.300027 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5bae79-1dae-4a9a-8b60-cb1db3769aa7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:16.300310 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5bae79-1dae-4a9a-8b60-cb1db3769aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:16.300585 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5bae79-1dae-4a9a-8b60-cb1db3769aa7 admin admin] PATH_INFO: `/v3/projects/402fd678bcca43f8902dd4ca88530962/users/f003689d16f54b8da73c0a289ec6b7d4/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:16.326733 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5bae79-1dae-4a9a-8b60-cb1db3769aa7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=402fd678bcca43f8902dd4ca88530962, user_id=f003689d16f54b8da73c0a289ec6b7d4, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:16.329648 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5bae79-1dae-4a9a-8b60-cb1db3769aa7 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:16.344256 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1255/2506] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:52:16 2022] PUT /identity/v3/projects/402fd678bcca43f8902dd4ca88530962/users/f003689d16f54b8da73c0a289ec6b7d4/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:52:16.350765 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade3963c-92dd-4296-bd9c-96030283c405 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:16.359282 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade3963c-92dd-4296-bd9c-96030283c405 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:16.399951 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:16.426855 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2475cc18-0df5-4746-bcbd-61a0c573ebec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:16.428016 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2475cc18-0df5-4746-bcbd-61a0c573ebec admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:16.428500 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2475cc18-0df5-4746-bcbd-61a0c573ebec admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:16.428792 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2475cc18-0df5-4746-bcbd-61a0c573ebec admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:16.429527 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2475cc18-0df5-4746-bcbd-61a0c573ebec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:16.431137 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2475cc18-0df5-4746-bcbd-61a0c573ebec admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:16.441556 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1252/2507] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:52:16 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:52:16.446004 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5bae79-1dae-4a9a-8b60-cb1db3769aa7 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:16.457022 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5bae79-1dae-4a9a-8b60-cb1db3769aa7 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:16.461885 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1efc68-e45a-4660-8ae1-37a946261631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:16.464148 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1efc68-e45a-4660-8ae1-37a946261631 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:16.464446 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1efc68-e45a-4660-8ae1-37a946261631 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:16.464710 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1efc68-e45a-4660-8ae1-37a946261631 admin admin] PATH_INFO: `/v3/projects/402fd678bcca43f8902dd4ca88530962/users/f003689d16f54b8da73c0a289ec6b7d4/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:16.466713 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1efc68-e45a-4660-8ae1-37a946261631 admin admin] RBAC: Authorizing `identity:create_grant(project_id=402fd678bcca43f8902dd4ca88530962, user_id=f003689d16f54b8da73c0a289ec6b7d4, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:16.469406 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1efc68-e45a-4660-8ae1-37a946261631 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:16.480590 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1256/2508] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:52:16 2022] PUT /identity/v3/projects/402fd678bcca43f8902dd4ca88530962/users/f003689d16f54b8da73c0a289ec6b7d4/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:52:16.490858 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f605ca-15fb-4374-a2a7-7b2bd9bd5236 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:16.491143 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f605ca-15fb-4374-a2a7-7b2bd9bd5236 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:16.491445 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f605ca-15fb-4374-a2a7-7b2bd9bd5236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:16.523661 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-b1f605ca-15fb-4374-a2a7-7b2bd9bd5236 None None] MFA Rules not processed for user `f003689d16f54b8da73c0a289ec6b7d4`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:16.524909 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-b1f605ca-15fb-4374-a2a7-7b2bd9bd5236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:16.611336 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1253/2509] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:52:16 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:52:16.623719 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1efc68-e45a-4660-8ae1-37a946261631 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:16.625625 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-7d1efc68-e45a-4660-8ae1-37a946261631 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:16.685547 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1efc68-e45a-4660-8ae1-37a946261631 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:16.689224 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed5222-f0fb-45e3-b557-1b1c05bd289d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:16.689866 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed5222-f0fb-45e3-b557-1b1c05bd289d service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:16.690144 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed5222-f0fb-45e3-b557-1b1c05bd289d service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:16.690414 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed5222-f0fb-45e3-b557-1b1c05bd289d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:16.699549 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ed5222-f0fb-45e3-b557-1b1c05bd289d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:16.700979 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ed5222-f0fb-45e3-b557-1b1c05bd289d service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:16.710351 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1257/2510] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:52:16 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:52:17.100732 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f605ca-15fb-4374-a2a7-7b2bd9bd5236 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:17.169597 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f605ca-15fb-4374-a2a7-7b2bd9bd5236 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:17.174398 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b691da-be9e-41e5-a04d-6867ef5da060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:17.175088 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b691da-be9e-41e5-a04d-6867ef5da060 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:17.175378 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b691da-be9e-41e5-a04d-6867ef5da060 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:17.175654 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b691da-be9e-41e5-a04d-6867ef5da060 admin admin] PATH_INFO: `/v3/users/1305341f1b2f4473a485f102dbc7d62c` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:17.176848 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b691da-be9e-41e5-a04d-6867ef5da060 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1305341f1b2f4473a485f102dbc7d62c)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:17.178807 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b691da-be9e-41e5-a04d-6867ef5da060 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:17.230259 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-57b691da-be9e-41e5-a04d-6867ef5da060 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1305341f1b2f4473a485f102dbc7d62c'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:17.237348 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-57b691da-be9e-41e5-a04d-6867ef5da060 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1305341f1b2f4473a485f102dbc7d62c'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:17.238032 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-57b691da-be9e-41e5-a04d-6867ef5da060 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1305341f1b2f4473a485f102dbc7d62c'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:17.242478 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:17.254178 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-57b691da-be9e-41e5-a04d-6867ef5da060 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1305341f1b2f4473a485f102dbc7d62c'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:17.263324 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-57b691da-be9e-41e5-a04d-6867ef5da060 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1305341f1b2f4473a485f102dbc7d62c'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:17.270452 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1254/2511] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:52:17 2022] DELETE /identity/v3/users/1305341f1b2f4473a485f102dbc7d62c => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:52:17.275562 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b898a48-fb8d-482a-a0b3-e8168f129b93 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:17.276030 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b898a48-fb8d-482a-a0b3-e8168f129b93 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:17.276730 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b898a48-fb8d-482a-a0b3-e8168f129b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:17.301987 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-6b898a48-fb8d-482a-a0b3-e8168f129b93 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:17.303251 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-6b898a48-fb8d-482a-a0b3-e8168f129b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:17.368905 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1258/2512] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:52:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:52:17.379020 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b691da-be9e-41e5-a04d-6867ef5da060 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:17.380468 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-57b691da-be9e-41e5-a04d-6867ef5da060 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:17.444529 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b691da-be9e-41e5-a04d-6867ef5da060 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:17.450055 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b013b8b0-936c-4169-b40f-95f6c80c111b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:17.450718 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013b8b0-936c-4169-b40f-95f6c80c111b service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:17.451001 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013b8b0-936c-4169-b40f-95f6c80c111b service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:17.451298 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013b8b0-936c-4169-b40f-95f6c80c111b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:17.461428 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b013b8b0-936c-4169-b40f-95f6c80c111b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:17.462856 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b013b8b0-936c-4169-b40f-95f6c80c111b service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:17.485613 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1255/2513] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:52:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:52:17.769700 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b898a48-fb8d-482a-a0b3-e8168f129b93 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:17.771390 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-6b898a48-fb8d-482a-a0b3-e8168f129b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:17.792422 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b898a48-fb8d-482a-a0b3-e8168f129b93 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:17.798234 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78ad310-30cc-43a2-bf36-7be80edf85d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:17.798913 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ad310-30cc-43a2-bf36-7be80edf85d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:17.799371 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ad310-30cc-43a2-bf36-7be80edf85d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:17.799652 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ad310-30cc-43a2-bf36-7be80edf85d5 admin admin] PATH_INFO: `/v3/projects/5f82102882e14e16a0797073d765488a` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:17.800895 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78ad310-30cc-43a2-bf36-7be80edf85d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f82102882e14e16a0797073d765488a)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:17.802858 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78ad310-30cc-43a2-bf36-7be80edf85d5 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:17.812363 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:17.857390 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-d78ad310-30cc-43a2-bf36-7be80edf85d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f82102882e14e16a0797073d765488a', 'request_id': 'req-d78ad310-30cc-43a2-bf36-7be80edf85d5'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:17.863912 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-d78ad310-30cc-43a2-bf36-7be80edf85d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f82102882e14e16a0797073d765488a', 'request_id': 'req-d78ad310-30cc-43a2-bf36-7be80edf85d5'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:17.872084 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-d78ad310-30cc-43a2-bf36-7be80edf85d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f82102882e14e16a0797073d765488a', 'request_id': 'req-d78ad310-30cc-43a2-bf36-7be80edf85d5'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:17.884013 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-d78ad310-30cc-43a2-bf36-7be80edf85d5 admin admin] The token cache is being invalidate because project 5f82102882e14e16a0797073d765488a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:52:17.884299 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-d78ad310-30cc-43a2-bf36-7be80edf85d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:17.884925 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-d78ad310-30cc-43a2-bf36-7be80edf85d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:17.887768 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1259/2514] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:52:17 2022] DELETE /identity/v3/projects/5f82102882e14e16a0797073d765488a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:52:17.891910 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b013b8b0-936c-4169-b40f-95f6c80c111b service neutron] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:17.904912 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b013b8b0-936c-4169-b40f-95f6c80c111b service neutron] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:17.981542 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3450459d-4344-4669-aa2f-f30d48aeeadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:17.982242 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3450459d-4344-4669-aa2f-f30d48aeeadd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:17.982538 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3450459d-4344-4669-aa2f-f30d48aeeadd admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:17.982813 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3450459d-4344-4669-aa2f-f30d48aeeadd admin admin] PATH_INFO: `/v3/users/f003689d16f54b8da73c0a289ec6b7d4` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:17.984637 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3450459d-4344-4669-aa2f-f30d48aeeadd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f003689d16f54b8da73c0a289ec6b7d4)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:17.987233 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3450459d-4344-4669-aa2f-f30d48aeeadd admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:18.044461 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-3450459d-4344-4669-aa2f-f30d48aeeadd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f003689d16f54b8da73c0a289ec6b7d4'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:18.051852 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-3450459d-4344-4669-aa2f-f30d48aeeadd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f003689d16f54b8da73c0a289ec6b7d4'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:18.052626 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-3450459d-4344-4669-aa2f-f30d48aeeadd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f003689d16f54b8da73c0a289ec6b7d4'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:18.065770 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-3450459d-4344-4669-aa2f-f30d48aeeadd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f003689d16f54b8da73c0a289ec6b7d4'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:18.074872 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-3450459d-4344-4669-aa2f-f30d48aeeadd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f003689d16f54b8da73c0a289ec6b7d4'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:18.078941 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:18.084115 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1256/2515] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:52:17 2022] DELETE /identity/v3/users/f003689d16f54b8da73c0a289ec6b7d4 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:52:18.362039 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78ad310-30cc-43a2-bf36-7be80edf85d5 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:18.363553 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-d78ad310-30cc-43a2-bf36-7be80edf85d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:18.377543 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78ad310-30cc-43a2-bf36-7be80edf85d5 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:18.439440 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e754f8-c077-41e9-a089-a3635d2fcfbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:18.440097 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e754f8-c077-41e9-a089-a3635d2fcfbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:18.440353 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e754f8-c077-41e9-a089-a3635d2fcfbd admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:18.440628 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e754f8-c077-41e9-a089-a3635d2fcfbd admin admin] PATH_INFO: `/v3/projects/402fd678bcca43f8902dd4ca88530962` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:18.441778 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e754f8-c077-41e9-a089-a3635d2fcfbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=402fd678bcca43f8902dd4ca88530962)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:18.443690 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e754f8-c077-41e9-a089-a3635d2fcfbd admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:18.490169 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-08e754f8-c077-41e9-a089-a3635d2fcfbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '402fd678bcca43f8902dd4ca88530962', 'request_id': 'req-08e754f8-c077-41e9-a089-a3635d2fcfbd'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:18.496773 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-08e754f8-c077-41e9-a089-a3635d2fcfbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '402fd678bcca43f8902dd4ca88530962', 'request_id': 'req-08e754f8-c077-41e9-a089-a3635d2fcfbd'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:18.502688 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-08e754f8-c077-41e9-a089-a3635d2fcfbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '402fd678bcca43f8902dd4ca88530962', 'request_id': 'req-08e754f8-c077-41e9-a089-a3635d2fcfbd'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:18.516140 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-08e754f8-c077-41e9-a089-a3635d2fcfbd admin admin] The token cache is being invalidate because project 402fd678bcca43f8902dd4ca88530962 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:52:18.516430 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-08e754f8-c077-41e9-a089-a3635d2fcfbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:18.517063 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-08e754f8-c077-41e9-a089-a3635d2fcfbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:18.518558 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1260/2516] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:52:18 2022] DELETE /identity/v3/projects/402fd678bcca43f8902dd4ca88530962 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:52:18.523464 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a3104-f092-481e-bfa1-388e9cd111ec None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:18.523930 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a3104-f092-481e-bfa1-388e9cd111ec None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:18.524048 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a3104-f092-481e-bfa1-388e9cd111ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:18.544717 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-b70a3104-f092-481e-bfa1-388e9cd111ec None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:18.545991 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-b70a3104-f092-481e-bfa1-388e9cd111ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:18.610587 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1257/2517] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:52:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:52:18.620303 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07563e7-549a-4468-8616-bea8d45115ad None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:18.620725 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07563e7-549a-4468-8616-bea8d45115ad None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:18.620896 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07563e7-549a-4468-8616-bea8d45115ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:18.642588 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-d07563e7-549a-4468-8616-bea8d45115ad None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:18.643834 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-d07563e7-549a-4468-8616-bea8d45115ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:18.653052 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1261/2518] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:52:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:52:18.657837 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70a3104-f092-481e-bfa1-388e9cd111ec None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:18.669099 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70a3104-f092-481e-bfa1-388e9cd111ec None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:18.673808 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33b082a-ba8d-4b39-95a6-9af28bf53e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:18.674437 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b082a-ba8d-4b39-95a6-9af28bf53e0d admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:18.674715 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b082a-ba8d-4b39-95a6-9af28bf53e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:18.675073 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b082a-ba8d-4b39-95a6-9af28bf53e0d admin admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:18.675613 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33b082a-ba8d-4b39-95a6-9af28bf53e0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:52:18.675909 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33b082a-ba8d-4b39-95a6-9af28bf53e0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:18.677729 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33b082a-ba8d-4b39-95a6-9af28bf53e0d admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:18.695295 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1258/2519] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Aug 29 22:52:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:52:18.696504 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07563e7-549a-4468-8616-bea8d45115ad None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:18.707335 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07563e7-549a-4468-8616-bea8d45115ad None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:18.713409 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b79c1-48e2-40e0-bf5e-fbb91324bec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:18.715017 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b79c1-48e2-40e0-bf5e-fbb91324bec2 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:18.715368 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b79c1-48e2-40e0-bf5e-fbb91324bec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:18.715636 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b79c1-48e2-40e0-bf5e-fbb91324bec2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:18.716885 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4b79c1-48e2-40e0-bf5e-fbb91324bec2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:18.719023 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4b79c1-48e2-40e0-bf5e-fbb91324bec2 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:18.741886 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:18.752804 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1262/2520] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:52:18 2022] POST /identity/v3/projects => generated 377 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:52:18.755887 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33b082a-ba8d-4b39-95a6-9af28bf53e0d admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:18.766601 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33b082a-ba8d-4b39-95a6-9af28bf53e0d admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:18.824043 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac196d0b-2638-406f-a8ec-32991a74570a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:18.824660 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac196d0b-2638-406f-a8ec-32991a74570a admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:18.824941 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac196d0b-2638-406f-a8ec-32991a74570a admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:18.825215 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac196d0b-2638-406f-a8ec-32991a74570a admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:18.825944 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac196d0b-2638-406f-a8ec-32991a74570a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:18.827859 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac196d0b-2638-406f-a8ec-32991a74570a admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:18.848936 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1259/2521] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:52:18 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:52:18.853230 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b79c1-48e2-40e0-bf5e-fbb91324bec2 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:18.863718 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b79c1-48e2-40e0-bf5e-fbb91324bec2 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:18.868324 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79647284-37af-4557-ac76-7270aa249c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:18.868946 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79647284-37af-4557-ac76-7270aa249c6b admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:18.869221 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79647284-37af-4557-ac76-7270aa249c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:18.869524 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79647284-37af-4557-ac76-7270aa249c6b admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:18.870167 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79647284-37af-4557-ac76-7270aa249c6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:18.871763 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79647284-37af-4557-ac76-7270aa249c6b admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:18.881813 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1263/2522] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:52:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:52:18.886580 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac196d0b-2638-406f-a8ec-32991a74570a admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:18.896893 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac196d0b-2638-406f-a8ec-32991a74570a admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:18.902322 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b108a712-300d-45c2-b102-a9fd0a872ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:18.903081 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b108a712-300d-45c2-b102-a9fd0a872ee7 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:18.903368 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b108a712-300d-45c2-b102-a9fd0a872ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:18.903646 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b108a712-300d-45c2-b102-a9fd0a872ee7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:18.904287 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b108a712-300d-45c2-b102-a9fd0a872ee7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:18.906167 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b108a712-300d-45c2-b102-a9fd0a872ee7 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:18.916803 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1260/2523] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:52:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:52:18.921123 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79647284-37af-4557-ac76-7270aa249c6b admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:18.931079 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79647284-37af-4557-ac76-7270aa249c6b admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:18.935757 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeba6f28-c035-42cb-83b1-5436d3d346a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:18.936390 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba6f28-c035-42cb-83b1-5436d3d346a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:18.936667 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba6f28-c035-42cb-83b1-5436d3d346a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:18.936931 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba6f28-c035-42cb-83b1-5436d3d346a2 admin admin] PATH_INFO: `/v3/projects/89d72dd40abb4af7a5ce042bd34b88e3/users/2896158821694bdf81f77e4672a21f28/roles/0c67797d444d4c929b2ccab47c468848` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:18.951958 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeba6f28-c035-42cb-83b1-5436d3d346a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89d72dd40abb4af7a5ce042bd34b88e3, user_id=2896158821694bdf81f77e4672a21f28, role_id=0c67797d444d4c929b2ccab47c468848)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:18.954714 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeba6f28-c035-42cb-83b1-5436d3d346a2 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:18.968030 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1264/2524] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:52:18 2022] PUT /identity/v3/projects/89d72dd40abb4af7a5ce042bd34b88e3/users/2896158821694bdf81f77e4672a21f28/roles/0c67797d444d4c929b2ccab47c468848 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:52:18.978434 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604bd967-0194-4459-bc87-00557b78e484 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:18.978730 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604bd967-0194-4459-bc87-00557b78e484 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:18.979008 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604bd967-0194-4459-bc87-00557b78e484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:19.006302 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-604bd967-0194-4459-bc87-00557b78e484 None None] MFA Rules not processed for user `2896158821694bdf81f77e4672a21f28`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:19.007528 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-604bd967-0194-4459-bc87-00557b78e484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:19.064874 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:19.075746 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1261/2525] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:52:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:52:19.080199 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeba6f28-c035-42cb-83b1-5436d3d346a2 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:19.150460 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeba6f28-c035-42cb-83b1-5436d3d346a2 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:19.158507 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6633aa-b2ad-4dfa-9cff-f34f786bd0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:19.159101 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6633aa-b2ad-4dfa-9cff-f34f786bd0c0 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:19.159382 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6633aa-b2ad-4dfa-9cff-f34f786bd0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:19.159658 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6633aa-b2ad-4dfa-9cff-f34f786bd0c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:19.160296 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6633aa-b2ad-4dfa-9cff-f34f786bd0c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:19.162257 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6633aa-b2ad-4dfa-9cff-f34f786bd0c0 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:19.190013 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1265/2526] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:52:19 2022] POST /identity/v3/projects => generated 375 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:52:19.194186 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604bd967-0194-4459-bc87-00557b78e484 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:19.206938 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604bd967-0194-4459-bc87-00557b78e484 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:19.281655 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b80aefe-927e-47e3-9fc1-362ea146c6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:19.282283 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b80aefe-927e-47e3-9fc1-362ea146c6b5 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:19.282562 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b80aefe-927e-47e3-9fc1-362ea146c6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:19.282886 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b80aefe-927e-47e3-9fc1-362ea146c6b5 admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:19.283568 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b80aefe-927e-47e3-9fc1-362ea146c6b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:19.285620 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b80aefe-927e-47e3-9fc1-362ea146c6b5 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:19.321369 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1262/2527] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:52:19 2022] POST /identity/v3/users => generated 294 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:52:19.322818 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6633aa-b2ad-4dfa-9cff-f34f786bd0c0 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:19.334589 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6633aa-b2ad-4dfa-9cff-f34f786bd0c0 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:19.339394 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bff336-d8cf-4ab9-ae55-8935ab36c668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:19.339994 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bff336-d8cf-4ab9-ae55-8935ab36c668 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:19.340273 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bff336-d8cf-4ab9-ae55-8935ab36c668 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:19.340545 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bff336-d8cf-4ab9-ae55-8935ab36c668 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:19.341195 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bff336-d8cf-4ab9-ae55-8935ab36c668 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:19.342827 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bff336-d8cf-4ab9-ae55-8935ab36c668 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:19.354934 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1266/2528] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:52:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:52:19.359415 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b80aefe-927e-47e3-9fc1-362ea146c6b5 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:19.370604 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b80aefe-927e-47e3-9fc1-362ea146c6b5 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:19.375798 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc31258f-caae-4ac4-858d-987aa3b4551c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:19.376534 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31258f-caae-4ac4-858d-987aa3b4551c admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:19.376889 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31258f-caae-4ac4-858d-987aa3b4551c admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:19.377170 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31258f-caae-4ac4-858d-987aa3b4551c admin admin] PATH_INFO: `/v3/projects/18a981e73cc4489d868233af96ed692f/users/17655351689f4912ab0e142228d7c9e0/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:19.393992 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc31258f-caae-4ac4-858d-987aa3b4551c admin admin] RBAC: Authorizing `identity:create_grant(project_id=18a981e73cc4489d868233af96ed692f, user_id=17655351689f4912ab0e142228d7c9e0, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:19.396772 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc31258f-caae-4ac4-858d-987aa3b4551c admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:19.411158 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1263/2529] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:52:19 2022] PUT /identity/v3/projects/18a981e73cc4489d868233af96ed692f/users/17655351689f4912ab0e142228d7c9e0/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:52:19.415504 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bff336-d8cf-4ab9-ae55-8935ab36c668 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:19.426217 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bff336-d8cf-4ab9-ae55-8935ab36c668 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:19.484292 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a620076-7a09-45db-b62c-4a2063255a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:19.484901 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a620076-7a09-45db-b62c-4a2063255a34 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:19.485184 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a620076-7a09-45db-b62c-4a2063255a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:19.485498 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a620076-7a09-45db-b62c-4a2063255a34 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:19.486140 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a620076-7a09-45db-b62c-4a2063255a34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:19.487769 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a620076-7a09-45db-b62c-4a2063255a34 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:19.498184 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1267/2530] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:52:19 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:52:19.502454 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc31258f-caae-4ac4-858d-987aa3b4551c admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:19.513364 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc31258f-caae-4ac4-858d-987aa3b4551c admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:19.518019 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c307b006-7174-415b-bc5c-bd0ec502f6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:19.518664 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c307b006-7174-415b-bc5c-bd0ec502f6cb admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:19.518948 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c307b006-7174-415b-bc5c-bd0ec502f6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:19.519228 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c307b006-7174-415b-bc5c-bd0ec502f6cb admin admin] PATH_INFO: `/v3/projects/18a981e73cc4489d868233af96ed692f/users/17655351689f4912ab0e142228d7c9e0/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:19.521164 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c307b006-7174-415b-bc5c-bd0ec502f6cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=18a981e73cc4489d868233af96ed692f, user_id=17655351689f4912ab0e142228d7c9e0, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:19.523847 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c307b006-7174-415b-bc5c-bd0ec502f6cb admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:19.535937 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1264/2531] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:52:19 2022] PUT /identity/v3/projects/18a981e73cc4489d868233af96ed692f/users/17655351689f4912ab0e142228d7c9e0/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:52:19.546170 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0440a3-ca45-47a1-bfad-69f82d310871 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:19.546481 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0440a3-ca45-47a1-bfad-69f82d310871 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:19.546742 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0440a3-ca45-47a1-bfad-69f82d310871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:19.575718 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-2c0440a3-ca45-47a1-bfad-69f82d310871 None None] MFA Rules not processed for user `17655351689f4912ab0e142228d7c9e0`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:19.576936 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-2c0440a3-ca45-47a1-bfad-69f82d310871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:19.602042 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:19.660928 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1268/2532] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:52:19 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:52:19.672376 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c307b006-7174-415b-bc5c-bd0ec502f6cb admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:19.674258 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-c307b006-7174-415b-bc5c-bd0ec502f6cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:19.737525 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c307b006-7174-415b-bc5c-bd0ec502f6cb admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:19.741199 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0cf819-64b4-42ee-86fe-afd7cbd8b7a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:19.741848 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0cf819-64b4-42ee-86fe-afd7cbd8b7a6 service cinder] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:19.742129 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0cf819-64b4-42ee-86fe-afd7cbd8b7a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:19.742400 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0cf819-64b4-42ee-86fe-afd7cbd8b7a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:19.800342 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0cf819-64b4-42ee-86fe-afd7cbd8b7a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:19.801823 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0cf819-64b4-42ee-86fe-afd7cbd8b7a6 service cinder] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:19.810837 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1265/2533] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:52:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:52:22.415539 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0440a3-ca45-47a1-bfad-69f82d310871 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:22.426046 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0440a3-ca45-47a1-bfad-69f82d310871 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:22.430320 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcea7669-dff1-468c-ac96-ed3f00e7faf8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:22.431238 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea7669-dff1-468c-ac96-ed3f00e7faf8 service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:22.431526 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea7669-dff1-468c-ac96-ed3f00e7faf8 service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:22.431798 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea7669-dff1-468c-ac96-ed3f00e7faf8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:22.440934 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcea7669-dff1-468c-ac96-ed3f00e7faf8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:22.442433 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcea7669-dff1-468c-ac96-ed3f00e7faf8 service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:22.452653 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1269/2534] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:52:22 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:52:23.406511 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0cf819-64b4-42ee-86fe-afd7cbd8b7a6 service cinder] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:23.407904 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-dc0cf819-64b4-42ee-86fe-afd7cbd8b7a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:23.413213 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:23.475749 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0cf819-64b4-42ee-86fe-afd7cbd8b7a6 service cinder] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:23.480967 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73d9921-9070-4a0c-a00f-eea85b015a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:23.481555 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d9921-9070-4a0c-a00f-eea85b015a78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:23.481839 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d9921-9070-4a0c-a00f-eea85b015a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:23.482131 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d9921-9070-4a0c-a00f-eea85b015a78 admin admin] PATH_INFO: `/v3/users/9fdc601e44154deba0a7e7915c517c7f` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:23.483252 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73d9921-9070-4a0c-a00f-eea85b015a78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fdc601e44154deba0a7e7915c517c7f)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:23.485175 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73d9921-9070-4a0c-a00f-eea85b015a78 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:23.531722 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-f73d9921-9070-4a0c-a00f-eea85b015a78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fdc601e44154deba0a7e7915c517c7f'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:23.539096 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-f73d9921-9070-4a0c-a00f-eea85b015a78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fdc601e44154deba0a7e7915c517c7f'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:23.539758 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-f73d9921-9070-4a0c-a00f-eea85b015a78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fdc601e44154deba0a7e7915c517c7f'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:23.552526 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-f73d9921-9070-4a0c-a00f-eea85b015a78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fdc601e44154deba0a7e7915c517c7f'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:23.560971 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-f73d9921-9070-4a0c-a00f-eea85b015a78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fdc601e44154deba0a7e7915c517c7f'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:23.568042 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1266/2535] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:52:23 2022] DELETE /identity/v3/users/9fdc601e44154deba0a7e7915c517c7f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:52:23.572694 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39913d03-ba8c-4794-9a69-ee701ab90def None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:23.573186 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39913d03-ba8c-4794-9a69-ee701ab90def None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:23.573312 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39913d03-ba8c-4794-9a69-ee701ab90def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:23.593158 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-39913d03-ba8c-4794-9a69-ee701ab90def None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:23.594390 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-39913d03-ba8c-4794-9a69-ee701ab90def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:23.654307 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1270/2536] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:52:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:52:23.664178 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73d9921-9070-4a0c-a00f-eea85b015a78 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:23.665663 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-f73d9921-9070-4a0c-a00f-eea85b015a78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:23.723417 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73d9921-9070-4a0c-a00f-eea85b015a78 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:23.727107 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be67afe-799f-4870-9dfd-ab2e8058f1bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:23.727736 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be67afe-799f-4870-9dfd-ab2e8058f1bc service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:23.728016 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be67afe-799f-4870-9dfd-ab2e8058f1bc service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:23.728288 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be67afe-799f-4870-9dfd-ab2e8058f1bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:23.737400 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be67afe-799f-4870-9dfd-ab2e8058f1bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:23.738765 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be67afe-799f-4870-9dfd-ab2e8058f1bc service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:23.748625 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1267/2537] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:52:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:52:24.090639 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39913d03-ba8c-4794-9a69-ee701ab90def None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:24.092142 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-39913d03-ba8c-4794-9a69-ee701ab90def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:24.106256 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39913d03-ba8c-4794-9a69-ee701ab90def None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:24.111102 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29a38e0-07ae-4c55-8d3b-e7b3b6d96322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:24.112282 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a38e0-07ae-4c55-8d3b-e7b3b6d96322 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:24.112591 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a38e0-07ae-4c55-8d3b-e7b3b6d96322 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:24.113050 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a38e0-07ae-4c55-8d3b-e7b3b6d96322 admin admin] PATH_INFO: `/v3/projects/69eeca8c9e98492da5f8fa0b86d5e9bd` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:24.114233 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29a38e0-07ae-4c55-8d3b-e7b3b6d96322 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69eeca8c9e98492da5f8fa0b86d5e9bd)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:24.116264 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29a38e0-07ae-4c55-8d3b-e7b3b6d96322 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:24.168344 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-d29a38e0-07ae-4c55-8d3b-e7b3b6d96322 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69eeca8c9e98492da5f8fa0b86d5e9bd', 'request_id': 'req-d29a38e0-07ae-4c55-8d3b-e7b3b6d96322'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:24.176676 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-d29a38e0-07ae-4c55-8d3b-e7b3b6d96322 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69eeca8c9e98492da5f8fa0b86d5e9bd', 'request_id': 'req-d29a38e0-07ae-4c55-8d3b-e7b3b6d96322'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:24.182774 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-d29a38e0-07ae-4c55-8d3b-e7b3b6d96322 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69eeca8c9e98492da5f8fa0b86d5e9bd', 'request_id': 'req-d29a38e0-07ae-4c55-8d3b-e7b3b6d96322'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:24.195833 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-d29a38e0-07ae-4c55-8d3b-e7b3b6d96322 admin admin] The token cache is being invalidate because project 69eeca8c9e98492da5f8fa0b86d5e9bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:52:24.196144 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-d29a38e0-07ae-4c55-8d3b-e7b3b6d96322 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:24.196920 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-d29a38e0-07ae-4c55-8d3b-e7b3b6d96322 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:24.199121 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1271/2538] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:52:24 2022] DELETE /identity/v3/projects/69eeca8c9e98492da5f8fa0b86d5e9bd => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:52:24.203419 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be67afe-799f-4870-9dfd-ab2e8058f1bc service neutron] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:24.214294 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be67afe-799f-4870-9dfd-ab2e8058f1bc service neutron] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:24.234420 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:24.279954 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4399dd89-6b5f-4bd7-9b8b-77feeb386312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:24.280898 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399dd89-6b5f-4bd7-9b8b-77feeb386312 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:24.281177 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399dd89-6b5f-4bd7-9b8b-77feeb386312 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:24.281483 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399dd89-6b5f-4bd7-9b8b-77feeb386312 admin admin] PATH_INFO: `/v3/users/0ff68fd4238e4e8eb49408678aed15a4` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:24.282645 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4399dd89-6b5f-4bd7-9b8b-77feeb386312 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ff68fd4238e4e8eb49408678aed15a4)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:24.284591 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4399dd89-6b5f-4bd7-9b8b-77feeb386312 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:24.339619 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-4399dd89-6b5f-4bd7-9b8b-77feeb386312 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ff68fd4238e4e8eb49408678aed15a4'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:24.347606 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-4399dd89-6b5f-4bd7-9b8b-77feeb386312 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ff68fd4238e4e8eb49408678aed15a4'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:24.348328 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-4399dd89-6b5f-4bd7-9b8b-77feeb386312 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ff68fd4238e4e8eb49408678aed15a4'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:24.360871 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-4399dd89-6b5f-4bd7-9b8b-77feeb386312 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ff68fd4238e4e8eb49408678aed15a4'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:24.369435 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-4399dd89-6b5f-4bd7-9b8b-77feeb386312 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ff68fd4238e4e8eb49408678aed15a4'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:24.375877 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1268/2539] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:52:24 2022] DELETE /identity/v3/users/0ff68fd4238e4e8eb49408678aed15a4 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:52:24.665665 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29a38e0-07ae-4c55-8d3b-e7b3b6d96322 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:24.667886 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-d29a38e0-07ae-4c55-8d3b-e7b3b6d96322 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:24.681148 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29a38e0-07ae-4c55-8d3b-e7b3b6d96322 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:24.709548 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:24.743981 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde5193f-204b-401f-909d-df572ee18309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:24.745479 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5193f-204b-401f-909d-df572ee18309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:24.745783 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5193f-204b-401f-909d-df572ee18309 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:24.746061 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5193f-204b-401f-909d-df572ee18309 admin admin] PATH_INFO: `/v3/projects/1e8ac2eedf67437f885418be3c16a1a4` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:24.747263 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde5193f-204b-401f-909d-df572ee18309 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e8ac2eedf67437f885418be3c16a1a4)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:24.749255 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde5193f-204b-401f-909d-df572ee18309 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:24.799261 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-cde5193f-204b-401f-909d-df572ee18309 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e8ac2eedf67437f885418be3c16a1a4', 'request_id': 'req-cde5193f-204b-401f-909d-df572ee18309'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:24.807807 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-cde5193f-204b-401f-909d-df572ee18309 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e8ac2eedf67437f885418be3c16a1a4', 'request_id': 'req-cde5193f-204b-401f-909d-df572ee18309'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:24.814049 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-cde5193f-204b-401f-909d-df572ee18309 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e8ac2eedf67437f885418be3c16a1a4', 'request_id': 'req-cde5193f-204b-401f-909d-df572ee18309'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:24.827757 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-cde5193f-204b-401f-909d-df572ee18309 admin admin] The token cache is being invalidate because project 1e8ac2eedf67437f885418be3c16a1a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:52:24.828056 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-cde5193f-204b-401f-909d-df572ee18309 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:24.828675 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-cde5193f-204b-401f-909d-df572ee18309 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:24.830192 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1272/2540] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:52:24 2022] DELETE /identity/v3/projects/1e8ac2eedf67437f885418be3c16a1a4 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:52:24.835256 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e499cf3b-d5e8-4c9d-923d-dcac25fd54b3 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:24.835747 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e499cf3b-d5e8-4c9d-923d-dcac25fd54b3 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:24.835852 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e499cf3b-d5e8-4c9d-923d-dcac25fd54b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:24.857033 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-e499cf3b-d5e8-4c9d-923d-dcac25fd54b3 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:24.858312 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-e499cf3b-d5e8-4c9d-923d-dcac25fd54b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:24.919856 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1269/2541] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:52:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:52:24.927920 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68adf682-2f04-41f9-aab1-bd790674595b None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:24.928212 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68adf682-2f04-41f9-aab1-bd790674595b None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:24.928492 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68adf682-2f04-41f9-aab1-bd790674595b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:24.950106 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-68adf682-2f04-41f9-aab1-bd790674595b None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:24.951347 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-68adf682-2f04-41f9-aab1-bd790674595b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:24.959373 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1273/2542] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:52:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:52:24.963790 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e499cf3b-d5e8-4c9d-923d-dcac25fd54b3 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:24.973564 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e499cf3b-d5e8-4c9d-923d-dcac25fd54b3 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:24.978183 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77757baf-0543-4ee4-b0c6-9e12f1202e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:24.978917 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77757baf-0543-4ee4-b0c6-9e12f1202e69 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:24.979688 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77757baf-0543-4ee4-b0c6-9e12f1202e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:24.979953 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77757baf-0543-4ee4-b0c6-9e12f1202e69 admin admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:24.980845 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77757baf-0543-4ee4-b0c6-9e12f1202e69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:52:24.981139 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77757baf-0543-4ee4-b0c6-9e12f1202e69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:24.982844 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77757baf-0543-4ee4-b0c6-9e12f1202e69 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:24.996887 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1270/2543] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Aug 29 22:52:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:52:25.001254 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68adf682-2f04-41f9-aab1-bd790674595b None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:25.011840 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68adf682-2f04-41f9-aab1-bd790674595b None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:25.019415 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b30e30-c052-486c-83e4-b198f99e0e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:25.020023 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b30e30-c052-486c-83e4-b198f99e0e8a admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:25.020302 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b30e30-c052-486c-83e4-b198f99e0e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:25.020573 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b30e30-c052-486c-83e4-b198f99e0e8a admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:25.021212 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b30e30-c052-486c-83e4-b198f99e0e8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:25.023165 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b30e30-c052-486c-83e4-b198f99e0e8a admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:25.053926 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1274/2544] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:52:25 2022] POST /identity/v3/projects => generated 387 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:52:25.058517 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77757baf-0543-4ee4-b0c6-9e12f1202e69 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:25.069568 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77757baf-0543-4ee4-b0c6-9e12f1202e69 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:25.105963 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:25.142980 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc5d3b-a1e0-4984-93c0-5fa8115ce916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:25.143546 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc5d3b-a1e0-4984-93c0-5fa8115ce916 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:25.143838 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc5d3b-a1e0-4984-93c0-5fa8115ce916 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:25.144103 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc5d3b-a1e0-4984-93c0-5fa8115ce916 admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:25.145018 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dc5d3b-a1e0-4984-93c0-5fa8115ce916 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:25.147171 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dc5d3b-a1e0-4984-93c0-5fa8115ce916 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:25.177422 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1271/2545] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:52:25 2022] POST /identity/v3/users => generated 294 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:52:25.180911 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b30e30-c052-486c-83e4-b198f99e0e8a admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:25.192202 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b30e30-c052-486c-83e4-b198f99e0e8a admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:25.203996 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86651a3e-243c-4606-a958-c2e89c0a2245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:25.204730 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86651a3e-243c-4606-a958-c2e89c0a2245 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:25.205802 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86651a3e-243c-4606-a958-c2e89c0a2245 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:25.206176 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86651a3e-243c-4606-a958-c2e89c0a2245 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:25.207049 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86651a3e-243c-4606-a958-c2e89c0a2245 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:25.208837 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86651a3e-243c-4606-a958-c2e89c0a2245 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:25.225189 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1275/2546] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:52:25.226454 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc5d3b-a1e0-4984-93c0-5fa8115ce916 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:25.238199 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc5d3b-a1e0-4984-93c0-5fa8115ce916 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:25.243315 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f992a2-c179-4313-9122-6d3a5215679a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:25.243940 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f992a2-c179-4313-9122-6d3a5215679a admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:25.244273 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f992a2-c179-4313-9122-6d3a5215679a admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:25.244550 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f992a2-c179-4313-9122-6d3a5215679a admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:25.245438 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f992a2-c179-4313-9122-6d3a5215679a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:25.247082 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f992a2-c179-4313-9122-6d3a5215679a admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:25.259603 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1272/2547] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:52:25.263902 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86651a3e-243c-4606-a958-c2e89c0a2245 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:25.280469 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86651a3e-243c-4606-a958-c2e89c0a2245 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:25.286236 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4612435a-413d-41ae-9033-350ad43ee208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:25.287133 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4612435a-413d-41ae-9033-350ad43ee208 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:25.287523 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4612435a-413d-41ae-9033-350ad43ee208 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:25.287806 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4612435a-413d-41ae-9033-350ad43ee208 admin admin] PATH_INFO: `/v3/projects/47b3719c73be49b9876567b054d29085/users/0c214b5450db4bb995f6b820a4162955/roles/0c67797d444d4c929b2ccab47c468848` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:25.310416 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4612435a-413d-41ae-9033-350ad43ee208 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47b3719c73be49b9876567b054d29085, user_id=0c214b5450db4bb995f6b820a4162955, role_id=0c67797d444d4c929b2ccab47c468848)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:25.313308 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4612435a-413d-41ae-9033-350ad43ee208 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:25.328724 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1276/2548] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:52:25 2022] PUT /identity/v3/projects/47b3719c73be49b9876567b054d29085/users/0c214b5450db4bb995f6b820a4162955/roles/0c67797d444d4c929b2ccab47c468848 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:52:25.341459 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d2c6a-bec8-4f32-9c94-661d4a0b804e None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:25.341780 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d2c6a-bec8-4f32-9c94-661d4a0b804e None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:25.342494 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d2c6a-bec8-4f32-9c94-661d4a0b804e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:25.382089 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-c51d2c6a-bec8-4f32-9c94-661d4a0b804e None None] MFA Rules not processed for user `0c214b5450db4bb995f6b820a4162955`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:25.383677 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-c51d2c6a-bec8-4f32-9c94-661d4a0b804e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:25.501466 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1273/2549] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:52:25 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:52:25.504671 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4612435a-413d-41ae-9033-350ad43ee208 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:25.592247 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:25.603631 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4612435a-413d-41ae-9033-350ad43ee208 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:25.620050 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa23deda-847c-4b3f-a946-5ab091fb3792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:25.620856 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa23deda-847c-4b3f-a946-5ab091fb3792 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:25.621135 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa23deda-847c-4b3f-a946-5ab091fb3792 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:25.621423 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa23deda-847c-4b3f-a946-5ab091fb3792 admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:25.622259 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa23deda-847c-4b3f-a946-5ab091fb3792 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:25.623966 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa23deda-847c-4b3f-a946-5ab091fb3792 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:25.661768 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1277/2550] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:52:25 2022] POST /identity/v3/projects => generated 387 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:52:25.665869 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51d2c6a-bec8-4f32-9c94-661d4a0b804e None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:25.677194 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51d2c6a-bec8-4f32-9c94-661d4a0b804e None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:25.736268 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c8b031-4a84-4be1-ad5f-845909cd1948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:25.737026 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c8b031-4a84-4be1-ad5f-845909cd1948 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:25.737525 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c8b031-4a84-4be1-ad5f-845909cd1948 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:25.737809 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c8b031-4a84-4be1-ad5f-845909cd1948 admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:25.738447 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c8b031-4a84-4be1-ad5f-845909cd1948 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:25.740391 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c8b031-4a84-4be1-ad5f-845909cd1948 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:25.763666 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1274/2551] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:52:25 2022] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:52:25.767729 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa23deda-847c-4b3f-a946-5ab091fb3792 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:25.778487 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa23deda-847c-4b3f-a946-5ab091fb3792 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:25.783449 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a472d7-f4fe-48f4-9f32-522772c78f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:25.784055 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a472d7-f4fe-48f4-9f32-522772c78f0c admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:25.784332 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a472d7-f4fe-48f4-9f32-522772c78f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:25.784602 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a472d7-f4fe-48f4-9f32-522772c78f0c admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:25.785244 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a472d7-f4fe-48f4-9f32-522772c78f0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:25.786863 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a472d7-f4fe-48f4-9f32-522772c78f0c admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:25.798555 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1278/2552] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:52:25.802553 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c8b031-4a84-4be1-ad5f-845909cd1948 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:25.813518 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c8b031-4a84-4be1-ad5f-845909cd1948 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:25.818108 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7de325-b905-4a43-b693-2f7e98de4030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:25.818712 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7de325-b905-4a43-b693-2f7e98de4030 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:25.819006 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7de325-b905-4a43-b693-2f7e98de4030 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:25.819267 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7de325-b905-4a43-b693-2f7e98de4030 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:25.819908 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7de325-b905-4a43-b693-2f7e98de4030 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:25.821533 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7de325-b905-4a43-b693-2f7e98de4030 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:25.831944 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1275/2553] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:52:25.836154 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a472d7-f4fe-48f4-9f32-522772c78f0c admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:25.848032 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a472d7-f4fe-48f4-9f32-522772c78f0c admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:25.853025 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea6340-d68d-423d-b233-30e77e4b4235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:25.854661 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea6340-d68d-423d-b233-30e77e4b4235 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:25.854774 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea6340-d68d-423d-b233-30e77e4b4235 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:25.855229 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea6340-d68d-423d-b233-30e77e4b4235 admin admin] PATH_INFO: `/v3/projects/7c35006d1f034f8cb25c8e460fffa8b3/users/ec0148168e9d433c9cfcf4b1fec574df/roles/0c67797d444d4c929b2ccab47c468848` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:25.881080 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ea6340-d68d-423d-b233-30e77e4b4235 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c35006d1f034f8cb25c8e460fffa8b3, user_id=ec0148168e9d433c9cfcf4b1fec574df, role_id=0c67797d444d4c929b2ccab47c468848)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:25.883844 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ea6340-d68d-423d-b233-30e77e4b4235 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:25.901524 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1279/2554] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:52:25 2022] PUT /identity/v3/projects/7c35006d1f034f8cb25c8e460fffa8b3/users/ec0148168e9d433c9cfcf4b1fec574df/roles/0c67797d444d4c929b2ccab47c468848 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:52:25.915513 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85513dfa-55b7-412f-a7db-f50577681c1d None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:25.915942 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85513dfa-55b7-412f-a7db-f50577681c1d None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:25.917243 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85513dfa-55b7-412f-a7db-f50577681c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:25.955391 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-85513dfa-55b7-412f-a7db-f50577681c1d None None] MFA Rules not processed for user `ec0148168e9d433c9cfcf4b1fec574df`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:25.956340 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-85513dfa-55b7-412f-a7db-f50577681c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:25.963256 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:26.047290 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1276/2555] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:52:25 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:52:26.051715 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea6340-d68d-423d-b233-30e77e4b4235 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:26.130691 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea6340-d68d-423d-b233-30e77e4b4235 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:26.135989 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4b9710-794f-4f70-8a3c-0e3c7c9696e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:26.136743 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4b9710-794f-4f70-8a3c-0e3c7c9696e8 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:26.137097 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4b9710-794f-4f70-8a3c-0e3c7c9696e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:26.137478 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4b9710-794f-4f70-8a3c-0e3c7c9696e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:26.138323 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4b9710-794f-4f70-8a3c-0e3c7c9696e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:26.141315 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4b9710-794f-4f70-8a3c-0e3c7c9696e8 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:26.176577 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1280/2556] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:52:26 2022] POST /identity/v3/projects => generated 385 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:52:26.180749 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85513dfa-55b7-412f-a7db-f50577681c1d None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:26.194025 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85513dfa-55b7-412f-a7db-f50577681c1d None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:26.255441 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe04432-b8d9-49a5-9c3a-c8267fb3c9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:26.255974 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe04432-b8d9-49a5-9c3a-c8267fb3c9d3 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:26.256261 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe04432-b8d9-49a5-9c3a-c8267fb3c9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:26.256535 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe04432-b8d9-49a5-9c3a-c8267fb3c9d3 admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:26.257190 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe04432-b8d9-49a5-9c3a-c8267fb3c9d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:26.259155 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe04432-b8d9-49a5-9c3a-c8267fb3c9d3 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:26.284429 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1277/2557] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:52:26 2022] POST /identity/v3/users => generated 299 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:52:26.288494 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4b9710-794f-4f70-8a3c-0e3c7c9696e8 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:26.300462 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4b9710-794f-4f70-8a3c-0e3c7c9696e8 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:26.308582 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b63b5c-574b-4cb5-8411-49475f9fa6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:26.309302 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b63b5c-574b-4cb5-8411-49475f9fa6e4 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:26.309523 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b63b5c-574b-4cb5-8411-49475f9fa6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:26.309799 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b63b5c-574b-4cb5-8411-49475f9fa6e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:26.310467 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b63b5c-574b-4cb5-8411-49475f9fa6e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:26.312082 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b63b5c-574b-4cb5-8411-49475f9fa6e4 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:26.325274 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1281/2558] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:52:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:52:26.329637 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe04432-b8d9-49a5-9c3a-c8267fb3c9d3 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:26.340833 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe04432-b8d9-49a5-9c3a-c8267fb3c9d3 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:26.346273 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d51c8cc-41bd-44f0-82e1-8229ed9f5d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:26.346845 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51c8cc-41bd-44f0-82e1-8229ed9f5d48 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:26.347160 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51c8cc-41bd-44f0-82e1-8229ed9f5d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:26.358362 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51c8cc-41bd-44f0-82e1-8229ed9f5d48 admin admin] PATH_INFO: `/v3/projects/3a4152425b734344a59341e88d202aec/users/fb71c100a3d64a6da09c27aa89b713e5/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:26.377908 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d51c8cc-41bd-44f0-82e1-8229ed9f5d48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a4152425b734344a59341e88d202aec, user_id=fb71c100a3d64a6da09c27aa89b713e5, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:26.381523 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d51c8cc-41bd-44f0-82e1-8229ed9f5d48 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:26.398677 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1278/2559] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:52:26 2022] PUT /identity/v3/projects/3a4152425b734344a59341e88d202aec/users/fb71c100a3d64a6da09c27aa89b713e5/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:52:26.403811 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b63b5c-574b-4cb5-8411-49475f9fa6e4 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:26.420082 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b63b5c-574b-4cb5-8411-49475f9fa6e4 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:26.531344 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9e7eba-50e2-454d-b2df-b30e1669e24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:26.532105 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e7eba-50e2-454d-b2df-b30e1669e24f admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:26.532394 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e7eba-50e2-454d-b2df-b30e1669e24f admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:26.532662 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e7eba-50e2-454d-b2df-b30e1669e24f admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:26.533298 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9e7eba-50e2-454d-b2df-b30e1669e24f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:26.535259 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9e7eba-50e2-454d-b2df-b30e1669e24f admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:26.548032 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1282/2560] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:52:26 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:52:26.552285 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d51c8cc-41bd-44f0-82e1-8229ed9f5d48 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:26.566792 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d51c8cc-41bd-44f0-82e1-8229ed9f5d48 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:26.571631 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9e3184-5cc6-4512-b9b3-eb2ae0aac6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:26.572294 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e3184-5cc6-4512-b9b3-eb2ae0aac6e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:26.572578 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e3184-5cc6-4512-b9b3-eb2ae0aac6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:26.572900 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e3184-5cc6-4512-b9b3-eb2ae0aac6e6 admin admin] PATH_INFO: `/v3/projects/3a4152425b734344a59341e88d202aec/users/fb71c100a3d64a6da09c27aa89b713e5/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:26.575381 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9e3184-5cc6-4512-b9b3-eb2ae0aac6e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a4152425b734344a59341e88d202aec, user_id=fb71c100a3d64a6da09c27aa89b713e5, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:26.578746 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9e3184-5cc6-4512-b9b3-eb2ae0aac6e6 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:26.591057 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1279/2561] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:52:26 2022] PUT /identity/v3/projects/3a4152425b734344a59341e88d202aec/users/fb71c100a3d64a6da09c27aa89b713e5/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:52:26.601424 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d275a2-3cd2-49b9-81c4-1e280fb2e86e None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:26.602066 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d275a2-3cd2-49b9-81c4-1e280fb2e86e None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:26.602411 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d275a2-3cd2-49b9-81c4-1e280fb2e86e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:26.635608 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-a7d275a2-3cd2-49b9-81c4-1e280fb2e86e None None] MFA Rules not processed for user `fb71c100a3d64a6da09c27aa89b713e5`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:26.637054 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-a7d275a2-3cd2-49b9-81c4-1e280fb2e86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:26.641446 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:26.725469 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1283/2562] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:52:26 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:52:26.742270 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9e3184-5cc6-4512-b9b3-eb2ae0aac6e6 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:26.744345 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-0e9e3184-5cc6-4512-b9b3-eb2ae0aac6e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:26.812962 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9e3184-5cc6-4512-b9b3-eb2ae0aac6e6 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:26.816965 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03159647-d694-4e00-a7dc-c4dfdc42c651 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:26.818079 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03159647-d694-4e00-a7dc-c4dfdc42c651 service cinder] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:26.818079 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03159647-d694-4e00-a7dc-c4dfdc42c651 service cinder] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:26.818381 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03159647-d694-4e00-a7dc-c4dfdc42c651 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:26.828353 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03159647-d694-4e00-a7dc-c4dfdc42c651 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:26.829919 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03159647-d694-4e00-a7dc-c4dfdc42c651 service cinder] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:26.841403 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1280/2563] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:52:26 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:52:27.433306 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d275a2-3cd2-49b9-81c4-1e280fb2e86e None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:27.433306 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-a7d275a2-3cd2-49b9-81c4-1e280fb2e86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:27.445765 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d275a2-3cd2-49b9-81c4-1e280fb2e86e None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:27.450146 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5080b5-286e-49cd-b03b-ec2406fc6c2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:27.450758 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5080b5-286e-49cd-b03b-ec2406fc6c2d service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:27.451039 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5080b5-286e-49cd-b03b-ec2406fc6c2d service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:27.451307 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5080b5-286e-49cd-b03b-ec2406fc6c2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:27.521820 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5080b5-286e-49cd-b03b-ec2406fc6c2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:27.523809 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5080b5-286e-49cd-b03b-ec2406fc6c2d service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:27.534843 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1284/2564] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:52:27 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:52:30.998444 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03159647-d694-4e00-a7dc-c4dfdc42c651 service cinder] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:30.999863 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-03159647-d694-4e00-a7dc-c4dfdc42c651 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:31.005411 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:31.059836 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03159647-d694-4e00-a7dc-c4dfdc42c651 service cinder] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:31.063502 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f671c76-40f5-4a5d-ac10-901dfcc38353 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:31.064108 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f671c76-40f5-4a5d-ac10-901dfcc38353 service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:31.064390 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f671c76-40f5-4a5d-ac10-901dfcc38353 service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:31.064665 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f671c76-40f5-4a5d-ac10-901dfcc38353 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:31.066439 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-0f671c76-40f5-4a5d-ac10-901dfcc38353 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:31.132854 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f671c76-40f5-4a5d-ac10-901dfcc38353 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:31.134380 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f671c76-40f5-4a5d-ac10-901dfcc38353 service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:31.144075 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1281/2565] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:52:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:52:31.651959 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5080b5-286e-49cd-b03b-ec2406fc6c2d service cinder] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:31.661465 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5080b5-286e-49cd-b03b-ec2406fc6c2d service cinder] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:31.665179 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d0bce8-949c-4be3-8478-5f1bd1e37540 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:31.665828 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0bce8-949c-4be3-8478-5f1bd1e37540 service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:31.666105 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0bce8-949c-4be3-8478-5f1bd1e37540 service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:31.666375 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0bce8-949c-4be3-8478-5f1bd1e37540 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:31.730745 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d0bce8-949c-4be3-8478-5f1bd1e37540 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:31.732238 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d0bce8-949c-4be3-8478-5f1bd1e37540 service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:31.741978 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1285/2566] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:52:31 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:52:33.928278 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f671c76-40f5-4a5d-ac10-901dfcc38353 service neutron] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:33.939863 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f671c76-40f5-4a5d-ac10-901dfcc38353 service neutron] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:33.953990 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1373e642-9109-43b4-a313-1bbde0bf483d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:33.955048 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373e642-9109-43b4-a313-1bbde0bf483d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:33.955389 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373e642-9109-43b4-a313-1bbde0bf483d admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:33.955911 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373e642-9109-43b4-a313-1bbde0bf483d admin admin] PATH_INFO: `/v3/users/0c214b5450db4bb995f6b820a4162955` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:33.957593 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1373e642-9109-43b4-a313-1bbde0bf483d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c214b5450db4bb995f6b820a4162955)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:33.960333 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1373e642-9109-43b4-a313-1bbde0bf483d admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:34.030503 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-1373e642-9109-43b4-a313-1bbde0bf483d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c214b5450db4bb995f6b820a4162955'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:34.038627 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-1373e642-9109-43b4-a313-1bbde0bf483d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c214b5450db4bb995f6b820a4162955'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:34.039594 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-1373e642-9109-43b4-a313-1bbde0bf483d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c214b5450db4bb995f6b820a4162955'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:34.056601 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-1373e642-9109-43b4-a313-1bbde0bf483d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c214b5450db4bb995f6b820a4162955'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:34.064455 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-1373e642-9109-43b4-a313-1bbde0bf483d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c214b5450db4bb995f6b820a4162955'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:34.074178 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1282/2567] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:52:33 2022] DELETE /identity/v3/users/0c214b5450db4bb995f6b820a4162955 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:52:34.078784 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649cf598-b238-42c9-9327-960962dcaa52 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:34.079250 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649cf598-b238-42c9-9327-960962dcaa52 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:34.079367 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649cf598-b238-42c9-9327-960962dcaa52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:34.103754 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-649cf598-b238-42c9-9327-960962dcaa52 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:34.106550 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-649cf598-b238-42c9-9327-960962dcaa52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:34.153007 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:34.196426 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1286/2568] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:52:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:52:34.203418 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1373e642-9109-43b4-a313-1bbde0bf483d admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:34.204897 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-1373e642-9109-43b4-a313-1bbde0bf483d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:34.270376 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:34.326010 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1373e642-9109-43b4-a313-1bbde0bf483d admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:34.334293 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efa73ae-4e84-4701-b0a7-e593072d4d71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:34.335205 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa73ae-4e84-4701-b0a7-e593072d4d71 service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:34.335836 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa73ae-4e84-4701-b0a7-e593072d4d71 service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:34.335836 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa73ae-4e84-4701-b0a7-e593072d4d71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:34.351280 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efa73ae-4e84-4701-b0a7-e593072d4d71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:34.353658 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efa73ae-4e84-4701-b0a7-e593072d4d71 service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:34.372007 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1283/2569] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:52:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:52:34.611288 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649cf598-b238-42c9-9327-960962dcaa52 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:34.612824 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-649cf598-b238-42c9-9327-960962dcaa52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:34.627198 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649cf598-b238-42c9-9327-960962dcaa52 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:34.634722 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b53d788-9d87-4c49-9da6-41ff7c9a1a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:34.636056 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53d788-9d87-4c49-9da6-41ff7c9a1a6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:34.636367 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53d788-9d87-4c49-9da6-41ff7c9a1a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:34.636702 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53d788-9d87-4c49-9da6-41ff7c9a1a6d admin admin] PATH_INFO: `/v3/users/7b42516e12d346eea1561b745bf724a7` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:34.638286 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b53d788-9d87-4c49-9da6-41ff7c9a1a6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b42516e12d346eea1561b745bf724a7)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:34.641213 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b53d788-9d87-4c49-9da6-41ff7c9a1a6d admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:34.692458 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-5b53d788-9d87-4c49-9da6-41ff7c9a1a6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b42516e12d346eea1561b745bf724a7'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:34.703716 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-5b53d788-9d87-4c49-9da6-41ff7c9a1a6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b42516e12d346eea1561b745bf724a7'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:34.704830 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-5b53d788-9d87-4c49-9da6-41ff7c9a1a6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b42516e12d346eea1561b745bf724a7'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:34.713171 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-5b53d788-9d87-4c49-9da6-41ff7c9a1a6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b42516e12d346eea1561b745bf724a7'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:34.714652 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-5b53d788-9d87-4c49-9da6-41ff7c9a1a6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b42516e12d346eea1561b745bf724a7'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:34.716017 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efa73ae-4e84-4701-b0a7-e593072d4d71 service neutron] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:34.717623 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-8efa73ae-4e84-4701-b0a7-e593072d4d71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:34.736970 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1287/2570] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:52:34 2022] DELETE /identity/v3/users/7b42516e12d346eea1561b745bf724a7 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:52:34.737312 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efa73ae-4e84-4701-b0a7-e593072d4d71 service neutron] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:34.808326 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce481d4-6e18-4ecb-866b-e313230b0e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:34.808675 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce481d4-6e18-4ecb-866b-e313230b0e4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:34.808953 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce481d4-6e18-4ecb-866b-e313230b0e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:34.809226 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce481d4-6e18-4ecb-866b-e313230b0e4c admin admin] PATH_INFO: `/v3/projects/47b3719c73be49b9876567b054d29085` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:34.810428 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce481d4-6e18-4ecb-866b-e313230b0e4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=47b3719c73be49b9876567b054d29085)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:34.812348 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce481d4-6e18-4ecb-866b-e313230b0e4c admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:34.861966 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-5ce481d4-6e18-4ecb-866b-e313230b0e4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47b3719c73be49b9876567b054d29085', 'request_id': 'req-5ce481d4-6e18-4ecb-866b-e313230b0e4c'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:34.868398 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-5ce481d4-6e18-4ecb-866b-e313230b0e4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47b3719c73be49b9876567b054d29085', 'request_id': 'req-5ce481d4-6e18-4ecb-866b-e313230b0e4c'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:34.874413 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-5ce481d4-6e18-4ecb-866b-e313230b0e4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47b3719c73be49b9876567b054d29085', 'request_id': 'req-5ce481d4-6e18-4ecb-866b-e313230b0e4c'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:34.888717 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-5ce481d4-6e18-4ecb-866b-e313230b0e4c admin admin] The token cache is being invalidate because project 47b3719c73be49b9876567b054d29085 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:52:34.889023 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-5ce481d4-6e18-4ecb-866b-e313230b0e4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:34.890257 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-5ce481d4-6e18-4ecb-866b-e313230b0e4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:34.893018 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1284/2571] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:52:34 2022] DELETE /identity/v3/projects/47b3719c73be49b9876567b054d29085 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:52:34.897083 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b53d788-9d87-4c49-9da6-41ff7c9a1a6d admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:34.898835 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-5b53d788-9d87-4c49-9da6-41ff7c9a1a6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:34.913925 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce481d4-6e18-4ecb-866b-e313230b0e4c admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:34.915457 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-5ce481d4-6e18-4ecb-866b-e313230b0e4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:34.919021 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b53d788-9d87-4c49-9da6-41ff7c9a1a6d admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:34.980906 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:34.985240 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce481d4-6e18-4ecb-866b-e313230b0e4c admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:34.992069 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103cb51a-b029-414e-88e1-4b6440629851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:34.992936 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103cb51a-b029-414e-88e1-4b6440629851 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:34.993502 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103cb51a-b029-414e-88e1-4b6440629851 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:34.993815 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f407de-8b83-4cd3-a96c-dede6b945ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:34.993969 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103cb51a-b029-414e-88e1-4b6440629851 admin admin] PATH_INFO: `/v3/projects/8ce1893ba48f42c3b04ebd6f51f2d0e9` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:34.994574 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f407de-8b83-4cd3-a96c-dede6b945ec5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:34.995418 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f407de-8b83-4cd3-a96c-dede6b945ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:34.995948 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f407de-8b83-4cd3-a96c-dede6b945ec5 admin admin] PATH_INFO: `/v3/users/ec0148168e9d433c9cfcf4b1fec574df` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:34.996455 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103cb51a-b029-414e-88e1-4b6440629851 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ce1893ba48f42c3b04ebd6f51f2d0e9)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:34.997280 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f407de-8b83-4cd3-a96c-dede6b945ec5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec0148168e9d433c9cfcf4b1fec574df)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:34.998140 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103cb51a-b029-414e-88e1-4b6440629851 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:34.999226 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f407de-8b83-4cd3-a96c-dede6b945ec5 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:35.049067 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-41f407de-8b83-4cd3-a96c-dede6b945ec5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec0148168e9d433c9cfcf4b1fec574df'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:35.049389 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-103cb51a-b029-414e-88e1-4b6440629851 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ce1893ba48f42c3b04ebd6f51f2d0e9', 'request_id': 'req-103cb51a-b029-414e-88e1-4b6440629851'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:35.054042 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:35.056645 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-103cb51a-b029-414e-88e1-4b6440629851 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ce1893ba48f42c3b04ebd6f51f2d0e9', 'request_id': 'req-103cb51a-b029-414e-88e1-4b6440629851'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:35.058073 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-41f407de-8b83-4cd3-a96c-dede6b945ec5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec0148168e9d433c9cfcf4b1fec574df'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:35.059221 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-41f407de-8b83-4cd3-a96c-dede6b945ec5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec0148168e9d433c9cfcf4b1fec574df'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:35.064617 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-103cb51a-b029-414e-88e1-4b6440629851 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ce1893ba48f42c3b04ebd6f51f2d0e9', 'request_id': 'req-103cb51a-b029-414e-88e1-4b6440629851'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:35.067131 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-41f407de-8b83-4cd3-a96c-dede6b945ec5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec0148168e9d433c9cfcf4b1fec574df'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:35.067824 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-41f407de-8b83-4cd3-a96c-dede6b945ec5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec0148168e9d433c9cfcf4b1fec574df'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:35.078220 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-103cb51a-b029-414e-88e1-4b6440629851 admin admin] The token cache is being invalidate because project 8ce1893ba48f42c3b04ebd6f51f2d0e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:52:35.078595 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-103cb51a-b029-414e-88e1-4b6440629851 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:35.079424 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-103cb51a-b029-414e-88e1-4b6440629851 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:35.081137 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1285/2572] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:52:34 2022] DELETE /identity/v3/projects/8ce1893ba48f42c3b04ebd6f51f2d0e9 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:52:35.086025 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e123e419-7452-459e-a600-b52ab2f999b2 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:35.086316 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e123e419-7452-459e-a600-b52ab2f999b2 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:35.086490 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1288/2573] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:52:34 2022] DELETE /identity/v3/users/ec0148168e9d433c9cfcf4b1fec574df => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:52:35.086942 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e123e419-7452-459e-a600-b52ab2f999b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:35.111791 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-e123e419-7452-459e-a600-b52ab2f999b2 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:35.113033 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-e123e419-7452-459e-a600-b52ab2f999b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:35.184983 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1286/2574] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:52:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:52:35.187465 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b5c6d-d0ef-461a-a2a4-4aa98f5e8b10 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:35.187795 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b5c6d-d0ef-461a-a2a4-4aa98f5e8b10 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:35.188075 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b5c6d-d0ef-461a-a2a4-4aa98f5e8b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:35.208928 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-ba6b5c6d-d0ef-461a-a2a4-4aa98f5e8b10 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:35.210152 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-ba6b5c6d-d0ef-461a-a2a4-4aa98f5e8b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:35.219238 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1289/2575] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:52:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:52:35.223666 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e123e419-7452-459e-a600-b52ab2f999b2 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:35.235094 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e123e419-7452-459e-a600-b52ab2f999b2 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:35.240142 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477009ab-1aaf-4aca-b9f5-33ad9fccedc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:35.241048 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477009ab-1aaf-4aca-b9f5-33ad9fccedc8 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:35.241690 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477009ab-1aaf-4aca-b9f5-33ad9fccedc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:35.242169 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477009ab-1aaf-4aca-b9f5-33ad9fccedc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:35.243087 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477009ab-1aaf-4aca-b9f5-33ad9fccedc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:52:35.243492 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477009ab-1aaf-4aca-b9f5-33ad9fccedc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:35.245756 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477009ab-1aaf-4aca-b9f5-33ad9fccedc8 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:35.260835 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1287/2576] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Aug 29 22:52:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:52:35.265348 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b5c6d-d0ef-461a-a2a4-4aa98f5e8b10 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:35.275662 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b5c6d-d0ef-461a-a2a4-4aa98f5e8b10 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:35.281999 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c041735b-6258-45b0-afac-5fb7cadd0ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:35.282612 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c041735b-6258-45b0-afac-5fb7cadd0ea2 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:35.282890 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c041735b-6258-45b0-afac-5fb7cadd0ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:35.283157 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c041735b-6258-45b0-afac-5fb7cadd0ea2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:35.283789 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c041735b-6258-45b0-afac-5fb7cadd0ea2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:35.285749 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c041735b-6258-45b0-afac-5fb7cadd0ea2 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:35.321759 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1290/2577] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:52:35 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:52:35.323433 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477009ab-1aaf-4aca-b9f5-33ad9fccedc8 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:35.333706 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477009ab-1aaf-4aca-b9f5-33ad9fccedc8 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:35.374997 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c041735b-6258-45b0-afac-5fb7cadd0ea2 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:35.376765 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-c041735b-6258-45b0-afac-5fb7cadd0ea2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:35.415512 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7ab9b-0995-4762-889d-bf7ed13b6b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:35.416212 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7ab9b-0995-4762-889d-bf7ed13b6b51 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:35.416501 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7ab9b-0995-4762-889d-bf7ed13b6b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:35.417063 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7ab9b-0995-4762-889d-bf7ed13b6b51 admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:35.417821 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b7ab9b-0995-4762-889d-bf7ed13b6b51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:35.419824 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b7ab9b-0995-4762-889d-bf7ed13b6b51 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:35.445557 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1288/2578] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:52:35 2022] POST /identity/v3/users => generated 292 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:52:35.445557 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7ab9b-0995-4762-889d-bf7ed13b6b51 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:35.445557 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-32b7ab9b-0995-4762-889d-bf7ed13b6b51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:35.454767 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:35.458918 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7ab9b-0995-4762-889d-bf7ed13b6b51 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:35.459314 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c041735b-6258-45b0-afac-5fb7cadd0ea2 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:35.464832 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12f2ec0-4639-4af8-957a-33e3dda02c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:35.465486 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e72f75-6e55-43be-aec2-f94fa1a15dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:35.465977 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f2ec0-4639-4af8-957a-33e3dda02c2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:35.466286 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f2ec0-4639-4af8-957a-33e3dda02c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:35.466425 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e72f75-6e55-43be-aec2-f94fa1a15dea admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:35.466587 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f2ec0-4639-4af8-957a-33e3dda02c2a admin admin] PATH_INFO: `/v3/users/2896158821694bdf81f77e4672a21f28` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:35.466828 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e72f75-6e55-43be-aec2-f94fa1a15dea admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:35.467116 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e72f75-6e55-43be-aec2-f94fa1a15dea admin admin] PATH_INFO: `/v3/projects/7c35006d1f034f8cb25c8e460fffa8b3` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:35.468073 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12f2ec0-4639-4af8-957a-33e3dda02c2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2896158821694bdf81f77e4672a21f28)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:35.468266 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e72f75-6e55-43be-aec2-f94fa1a15dea admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c35006d1f034f8cb25c8e460fffa8b3)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:35.470222 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e72f75-6e55-43be-aec2-f94fa1a15dea admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:35.470360 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12f2ec0-4639-4af8-957a-33e3dda02c2a admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:35.519670 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-a12f2ec0-4639-4af8-957a-33e3dda02c2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2896158821694bdf81f77e4672a21f28'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:35.520258 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-10e72f75-6e55-43be-aec2-f94fa1a15dea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c35006d1f034f8cb25c8e460fffa8b3', 'request_id': 'req-10e72f75-6e55-43be-aec2-f94fa1a15dea'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:35.526497 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-10e72f75-6e55-43be-aec2-f94fa1a15dea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c35006d1f034f8cb25c8e460fffa8b3', 'request_id': 'req-10e72f75-6e55-43be-aec2-f94fa1a15dea'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:35.526886 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-a12f2ec0-4639-4af8-957a-33e3dda02c2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2896158821694bdf81f77e4672a21f28'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:35.528250 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-a12f2ec0-4639-4af8-957a-33e3dda02c2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2896158821694bdf81f77e4672a21f28'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:35.532629 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-10e72f75-6e55-43be-aec2-f94fa1a15dea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c35006d1f034f8cb25c8e460fffa8b3', 'request_id': 'req-10e72f75-6e55-43be-aec2-f94fa1a15dea'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:35.542780 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-a12f2ec0-4639-4af8-957a-33e3dda02c2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2896158821694bdf81f77e4672a21f28'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:35.546563 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-10e72f75-6e55-43be-aec2-f94fa1a15dea admin admin] The token cache is being invalidate because project 7c35006d1f034f8cb25c8e460fffa8b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:52:35.547121 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-10e72f75-6e55-43be-aec2-f94fa1a15dea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:35.548078 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-10e72f75-6e55-43be-aec2-f94fa1a15dea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:35.550737 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1291/2579] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:52:35 2022] DELETE /identity/v3/projects/7c35006d1f034f8cb25c8e460fffa8b3 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:52:35.552154 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e72f75-6e55-43be-aec2-f94fa1a15dea admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:35.552952 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-a12f2ec0-4639-4af8-957a-33e3dda02c2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2896158821694bdf81f77e4672a21f28'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:35.554338 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-10e72f75-6e55-43be-aec2-f94fa1a15dea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:35.560923 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1289/2580] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:52:35 2022] DELETE /identity/v3/users/2896158821694bdf81f77e4672a21f28 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:52:35.564036 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12f2ec0-4639-4af8-957a-33e3dda02c2a admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:35.564036 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-a12f2ec0-4639-4af8-957a-33e3dda02c2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:35.594451 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:35.629557 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e72f75-6e55-43be-aec2-f94fa1a15dea admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:35.630471 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12f2ec0-4639-4af8-957a-33e3dda02c2a admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:35.634307 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f4d473-d914-418a-951e-2fbe3027714c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:35.634913 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f4d473-d914-418a-951e-2fbe3027714c admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:35.635140 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283d7467-c31e-4833-a821-6c49aa0af41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:35.635255 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f4d473-d914-418a-951e-2fbe3027714c admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:35.635986 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f4d473-d914-418a-951e-2fbe3027714c admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:35.636371 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d7467-c31e-4833-a821-6c49aa0af41c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:35.636654 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f4d473-d914-418a-951e-2fbe3027714c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:35.636835 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d7467-c31e-4833-a821-6c49aa0af41c admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:35.636962 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d7467-c31e-4833-a821-6c49aa0af41c admin admin] PATH_INFO: `/v3/users/fb71c100a3d64a6da09c27aa89b713e5` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:35.638096 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283d7467-c31e-4833-a821-6c49aa0af41c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb71c100a3d64a6da09c27aa89b713e5)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:35.638267 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f4d473-d914-418a-951e-2fbe3027714c admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:35.640020 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283d7467-c31e-4833-a821-6c49aa0af41c admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:35.648368 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1292/2581] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:52:35 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:52:35.649773 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818da1de-22e1-4994-bb75-b28cd6d5191e None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:35.650077 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818da1de-22e1-4994-bb75-b28cd6d5191e None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:35.650323 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818da1de-22e1-4994-bb75-b28cd6d5191e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:35.672587 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-818da1de-22e1-4994-bb75-b28cd6d5191e None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:35.673834 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-818da1de-22e1-4994-bb75-b28cd6d5191e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:35.681656 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1293/2582] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:52:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:52:35.682507 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818da1de-22e1-4994-bb75-b28cd6d5191e None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:35.684426 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-818da1de-22e1-4994-bb75-b28cd6d5191e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:35.691223 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-283d7467-c31e-4833-a821-6c49aa0af41c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb71c100a3d64a6da09c27aa89b713e5'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:35.696442 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818da1de-22e1-4994-bb75-b28cd6d5191e None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:35.698352 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-283d7467-c31e-4833-a821-6c49aa0af41c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb71c100a3d64a6da09c27aa89b713e5'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:35.699079 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-283d7467-c31e-4833-a821-6c49aa0af41c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb71c100a3d64a6da09c27aa89b713e5'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:35.701530 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a283c6-40fe-42c9-b800-f6ad58ffaff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:35.702138 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a283c6-40fe-42c9-b800-f6ad58ffaff1 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:35.702415 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a283c6-40fe-42c9-b800-f6ad58ffaff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:35.702685 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a283c6-40fe-42c9-b800-f6ad58ffaff1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:35.703328 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a283c6-40fe-42c9-b800-f6ad58ffaff1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:35.704928 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a283c6-40fe-42c9-b800-f6ad58ffaff1 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:35.715195 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-283d7467-c31e-4833-a821-6c49aa0af41c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb71c100a3d64a6da09c27aa89b713e5'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:35.719409 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1294/2583] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:52:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:52:35.720327 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a283c6-40fe-42c9-b800-f6ad58ffaff1 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:35.720970 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:35.722484 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-f7a283c6-40fe-42c9-b800-f6ad58ffaff1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:35.725648 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-283d7467-c31e-4833-a821-6c49aa0af41c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb71c100a3d64a6da09c27aa89b713e5'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:35.735754 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1290/2584] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:52:35 2022] DELETE /identity/v3/users/fb71c100a3d64a6da09c27aa89b713e5 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:52:35.737038 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283d7467-c31e-4833-a821-6c49aa0af41c admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:35.741765 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-283d7467-c31e-4833-a821-6c49aa0af41c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:35.787531 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a283c6-40fe-42c9-b800-f6ad58ffaff1 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:35.827283 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283d7467-c31e-4833-a821-6c49aa0af41c admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:35.834434 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d598f9f-7b74-43ce-80db-337df1504a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:35.835356 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d598f9f-7b74-43ce-80db-337df1504a35 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:35.835795 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d598f9f-7b74-43ce-80db-337df1504a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:35.836165 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d598f9f-7b74-43ce-80db-337df1504a35 admin admin] PATH_INFO: `/v3/projects/9ebd6705b79140df8e54314aee9ea96d/users/f93d3fedb819423394be400e98eb0d60/roles/0c67797d444d4c929b2ccab47c468848` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:35.847625 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a657af05-3e67-4006-bccc-7a0eb58e9f8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:35.848331 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657af05-3e67-4006-bccc-7a0eb58e9f8c service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:35.848610 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657af05-3e67-4006-bccc-7a0eb58e9f8c service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:35.848933 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657af05-3e67-4006-bccc-7a0eb58e9f8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:35.850820 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-a657af05-3e67-4006-bccc-7a0eb58e9f8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:35.857371 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d598f9f-7b74-43ce-80db-337df1504a35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ebd6705b79140df8e54314aee9ea96d, user_id=f93d3fedb819423394be400e98eb0d60, role_id=0c67797d444d4c929b2ccab47c468848)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:35.860240 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d598f9f-7b74-43ce-80db-337df1504a35 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:35.864151 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a657af05-3e67-4006-bccc-7a0eb58e9f8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:35.865713 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a657af05-3e67-4006-bccc-7a0eb58e9f8c service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:35.876582 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1291/2585] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:52:35 2022] PUT /identity/v3/projects/9ebd6705b79140df8e54314aee9ea96d/users/f93d3fedb819423394be400e98eb0d60/roles/0c67797d444d4c929b2ccab47c468848 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:52:35.878060 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1295/2586] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:52:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:52:35.888051 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f1e98-b86e-4da2-aec2-560c82919e5c None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:35.888308 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f1e98-b86e-4da2-aec2-560c82919e5c None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:35.888581 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f1e98-b86e-4da2-aec2-560c82919e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:35.921938 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-f06f1e98-b86e-4da2-aec2-560c82919e5c None None] MFA Rules not processed for user `f93d3fedb819423394be400e98eb0d60`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:35.923506 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-f06f1e98-b86e-4da2-aec2-560c82919e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:36.014738 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1292/2587] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:52:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:52:36.015703 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a657af05-3e67-4006-bccc-7a0eb58e9f8c service neutron] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:36.017841 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-a657af05-3e67-4006-bccc-7a0eb58e9f8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:36.076271 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f1e98-b86e-4da2-aec2-560c82919e5c None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:36.077960 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-f06f1e98-b86e-4da2-aec2-560c82919e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:36.136615 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a657af05-3e67-4006-bccc-7a0eb58e9f8c service neutron] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:36.140724 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:36.179774 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f1e98-b86e-4da2-aec2-560c82919e5c None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:36.185716 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eaf53d-eaf3-42e2-a67c-a0b771474538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:36.186358 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eaf53d-eaf3-42e2-a67c-a0b771474538 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:36.186635 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eaf53d-eaf3-42e2-a67c-a0b771474538 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:36.186910 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eaf53d-eaf3-42e2-a67c-a0b771474538 admin admin] PATH_INFO: `/v3/projects/3a4152425b734344a59341e88d202aec` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:36.188070 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eaf53d-eaf3-42e2-a67c-a0b771474538 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a4152425b734344a59341e88d202aec)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:36.190083 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eaf53d-eaf3-42e2-a67c-a0b771474538 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:36.203932 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:36.216042 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f7d12-7d3c-4606-9c1c-6fcead67b555 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35441c061e514b1b9341e7694ec2c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:36.216680 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f7d12-7d3c-4606-9c1c-6fcead67b555 service nova] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:36.216920 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f7d12-7d3c-4606-9c1c-6fcead67b555 service nova] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:36.217190 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f7d12-7d3c-4606-9c1c-6fcead67b555 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:36.228993 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5f7d12-7d3c-4606-9c1c-6fcead67b555 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:36.231360 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5f7d12-7d3c-4606-9c1c-6fcead67b555 service nova] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:36.241104 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1296/2588] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:52:36 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:52:36.242122 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f7d12-7d3c-4606-9c1c-6fcead67b555 service nova] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:36.243586 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-4c5f7d12-7d3c-4606-9c1c-6fcead67b555 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:36.256206 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-75eaf53d-eaf3-42e2-a67c-a0b771474538 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a4152425b734344a59341e88d202aec', 'request_id': 'req-75eaf53d-eaf3-42e2-a67c-a0b771474538'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:36.259353 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f7d12-7d3c-4606-9c1c-6fcead67b555 service nova] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:36.264049 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-75eaf53d-eaf3-42e2-a67c-a0b771474538 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a4152425b734344a59341e88d202aec', 'request_id': 'req-75eaf53d-eaf3-42e2-a67c-a0b771474538'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:36.278395 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-75eaf53d-eaf3-42e2-a67c-a0b771474538 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a4152425b734344a59341e88d202aec', 'request_id': 'req-75eaf53d-eaf3-42e2-a67c-a0b771474538'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:36.297132 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-75eaf53d-eaf3-42e2-a67c-a0b771474538 admin admin] The token cache is being invalidate because project 3a4152425b734344a59341e88d202aec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:52:36.297653 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-75eaf53d-eaf3-42e2-a67c-a0b771474538 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:36.298451 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-75eaf53d-eaf3-42e2-a67c-a0b771474538 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:36.299978 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1293/2589] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:52:36 2022] DELETE /identity/v3/projects/3a4152425b734344a59341e88d202aec => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:52:36.306965 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac334a-98f2-4f9f-92c8-6dd21d6dd766 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:36.307905 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac334a-98f2-4f9f-92c8-6dd21d6dd766 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:36.308297 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac334a-98f2-4f9f-92c8-6dd21d6dd766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:36.331146 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a7c8f-44b0-4dff-9bb8-e43597118fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:36.331331 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-c4ac334a-98f2-4f9f-92c8-6dd21d6dd766 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:36.331787 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a7c8f-44b0-4dff-9bb8-e43597118fb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:36.332086 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a7c8f-44b0-4dff-9bb8-e43597118fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:36.332335 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a7c8f-44b0-4dff-9bb8-e43597118fb4 admin admin] PATH_INFO: `/v3/projects/89d72dd40abb4af7a5ce042bd34b88e3` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:36.332540 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-c4ac334a-98f2-4f9f-92c8-6dd21d6dd766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:36.333823 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308a7c8f-44b0-4dff-9bb8-e43597118fb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89d72dd40abb4af7a5ce042bd34b88e3)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:36.336440 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308a7c8f-44b0-4dff-9bb8-e43597118fb4 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:36.348266 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1294/2590] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:52:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:52:36.350200 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9adf779-a0a0-4609-9deb-15929585f5d2 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:36.350505 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9adf779-a0a0-4609-9deb-15929585f5d2 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:36.350783 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9adf779-a0a0-4609-9deb-15929585f5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:36.373585 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-a9adf779-a0a0-4609-9deb-15929585f5d2 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:36.374800 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-a9adf779-a0a0-4609-9deb-15929585f5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:36.382741 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1295/2591] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:52:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:52:36.387122 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9adf779-a0a0-4609-9deb-15929585f5d2 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:36.394113 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-308a7c8f-44b0-4dff-9bb8-e43597118fb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89d72dd40abb4af7a5ce042bd34b88e3', 'request_id': 'req-308a7c8f-44b0-4dff-9bb8-e43597118fb4'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:36.396785 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9adf779-a0a0-4609-9deb-15929585f5d2 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:36.402723 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-308a7c8f-44b0-4dff-9bb8-e43597118fb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89d72dd40abb4af7a5ce042bd34b88e3', 'request_id': 'req-308a7c8f-44b0-4dff-9bb8-e43597118fb4'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:36.409786 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-308a7c8f-44b0-4dff-9bb8-e43597118fb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89d72dd40abb4af7a5ce042bd34b88e3', 'request_id': 'req-308a7c8f-44b0-4dff-9bb8-e43597118fb4'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:36.426004 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-308a7c8f-44b0-4dff-9bb8-e43597118fb4 admin admin] The token cache is being invalidate because project 89d72dd40abb4af7a5ce042bd34b88e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:52:36.426502 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-308a7c8f-44b0-4dff-9bb8-e43597118fb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:36.427429 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-308a7c8f-44b0-4dff-9bb8-e43597118fb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:36.429362 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1297/2592] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:52:36 2022] DELETE /identity/v3/projects/89d72dd40abb4af7a5ce042bd34b88e3 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:52:36.433837 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a7c8f-44b0-4dff-9bb8-e43597118fb4 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:36.436730 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-308a7c8f-44b0-4dff-9bb8-e43597118fb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:36.468059 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e22d680-ffff-42a1-a4f2-5bbd5eb6888d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:36.469060 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22d680-ffff-42a1-a4f2-5bbd5eb6888d admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:36.469698 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:36.470171 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22d680-ffff-42a1-a4f2-5bbd5eb6888d admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:36.470976 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22d680-ffff-42a1-a4f2-5bbd5eb6888d admin admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:36.471614 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e22d680-ffff-42a1-a4f2-5bbd5eb6888d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:52:36.471946 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e22d680-ffff-42a1-a4f2-5bbd5eb6888d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:36.473895 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e22d680-ffff-42a1-a4f2-5bbd5eb6888d admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:36.489728 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1296/2593] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Aug 29 22:52:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:52:36.494549 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e22d680-ffff-42a1-a4f2-5bbd5eb6888d admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:36.496760 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-2e22d680-ffff-42a1-a4f2-5bbd5eb6888d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:36.510110 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e22d680-ffff-42a1-a4f2-5bbd5eb6888d admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:36.515747 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a7c8f-44b0-4dff-9bb8-e43597118fb4 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:36.516477 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd92e4-c3f5-431e-8430-6042f4ef422a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:36.517130 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd92e4-c3f5-431e-8430-6042f4ef422a admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:36.517477 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd92e4-c3f5-431e-8430-6042f4ef422a admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:36.517883 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd92e4-c3f5-431e-8430-6042f4ef422a admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:36.518791 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bd92e4-c3f5-431e-8430-6042f4ef422a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:36.521194 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bd92e4-c3f5-431e-8430-6042f4ef422a admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:36.522533 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6bdaeb-b4bf-41a4-95fd-20729052dbf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:36.523482 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6bdaeb-b4bf-41a4-95fd-20729052dbf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:36.523482 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6bdaeb-b4bf-41a4-95fd-20729052dbf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:36.523696 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6bdaeb-b4bf-41a4-95fd-20729052dbf5 admin admin] PATH_INFO: `/v3/users/17655351689f4912ab0e142228d7c9e0` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:36.524915 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6bdaeb-b4bf-41a4-95fd-20729052dbf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17655351689f4912ab0e142228d7c9e0)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:36.527845 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6bdaeb-b4bf-41a4-95fd-20729052dbf5 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:36.555634 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1297/2594] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:52:36 2022] POST /identity/v3/projects => generated 375 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:52:36.559433 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd92e4-c3f5-431e-8430-6042f4ef422a admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:36.590859 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-4e6bdaeb-b4bf-41a4-95fd-20729052dbf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17655351689f4912ab0e142228d7c9e0'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:36.600393 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-4e6bdaeb-b4bf-41a4-95fd-20729052dbf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17655351689f4912ab0e142228d7c9e0'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:36.601392 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-4e6bdaeb-b4bf-41a4-95fd-20729052dbf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17655351689f4912ab0e142228d7c9e0'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:36.614036 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-4e6bdaeb-b4bf-41a4-95fd-20729052dbf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17655351689f4912ab0e142228d7c9e0'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:36.614697 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-4e6bdaeb-b4bf-41a4-95fd-20729052dbf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17655351689f4912ab0e142228d7c9e0'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:36.635398 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1298/2595] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:52:36 2022] DELETE /identity/v3/users/17655351689f4912ab0e142228d7c9e0 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:52:36.641405 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:36.646032 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd92e4-c3f5-431e-8430-6042f4ef422a admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:36.736207 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18466466-55ac-45df-b1b4-c9bfd70bdabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:36.736899 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18466466-55ac-45df-b1b4-c9bfd70bdabf admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:36.737268 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18466466-55ac-45df-b1b4-c9bfd70bdabf admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:36.737685 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18466466-55ac-45df-b1b4-c9bfd70bdabf admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:36.738453 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18466466-55ac-45df-b1b4-c9bfd70bdabf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:36.740894 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18466466-55ac-45df-b1b4-c9bfd70bdabf admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:36.766643 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1298/2596] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:52:36 2022] POST /identity/v3/users => generated 288 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:52:36.768023 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6bdaeb-b4bf-41a4-95fd-20729052dbf5 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:36.769538 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-4e6bdaeb-b4bf-41a4-95fd-20729052dbf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:36.784046 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6bdaeb-b4bf-41a4-95fd-20729052dbf5 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:36.788938 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae41b82-8322-4f60-998d-75f5c1efb720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:36.789662 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae41b82-8322-4f60-998d-75f5c1efb720 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:36.790123 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae41b82-8322-4f60-998d-75f5c1efb720 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:36.790493 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae41b82-8322-4f60-998d-75f5c1efb720 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:36.791186 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae41b82-8322-4f60-998d-75f5c1efb720 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:36.793545 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae41b82-8322-4f60-998d-75f5c1efb720 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:36.804690 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1299/2597] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:52:36 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:52:36.808865 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18466466-55ac-45df-b1b4-c9bfd70bdabf admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:36.820412 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18466466-55ac-45df-b1b4-c9bfd70bdabf admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:36.826412 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d465ac-d1b2-4b8e-9838-0428e964159e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:36.827324 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d465ac-d1b2-4b8e-9838-0428e964159e admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:36.827612 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d465ac-d1b2-4b8e-9838-0428e964159e admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:36.827899 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d465ac-d1b2-4b8e-9838-0428e964159e admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:36.828549 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d465ac-d1b2-4b8e-9838-0428e964159e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:36.830370 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d465ac-d1b2-4b8e-9838-0428e964159e admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:36.842257 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1299/2598] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:52:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:52:36.846399 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae41b82-8322-4f60-998d-75f5c1efb720 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:36.859568 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae41b82-8322-4f60-998d-75f5c1efb720 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:36.864266 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e69c86f-695d-4803-8a5d-cda1a389cfa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:36.864953 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69c86f-695d-4803-8a5d-cda1a389cfa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:36.865233 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69c86f-695d-4803-8a5d-cda1a389cfa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:36.865538 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69c86f-695d-4803-8a5d-cda1a389cfa4 admin admin] PATH_INFO: `/v3/projects/43397754a872483eb439962cb6f9530e/users/f893d5c330644bd98c7c635c24e60984/roles/0c67797d444d4c929b2ccab47c468848` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:36.883854 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e69c86f-695d-4803-8a5d-cda1a389cfa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43397754a872483eb439962cb6f9530e, user_id=f893d5c330644bd98c7c635c24e60984, role_id=0c67797d444d4c929b2ccab47c468848)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:36.887122 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e69c86f-695d-4803-8a5d-cda1a389cfa4 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:36.901860 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1300/2599] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:52:36 2022] PUT /identity/v3/projects/43397754a872483eb439962cb6f9530e/users/f893d5c330644bd98c7c635c24e60984/roles/0c67797d444d4c929b2ccab47c468848 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:52:36.913782 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a59416-18d7-4013-9c4e-18c2708abb1e None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:36.914168 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a59416-18d7-4013-9c4e-18c2708abb1e None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:36.914828 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a59416-18d7-4013-9c4e-18c2708abb1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:36.946302 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-60a59416-18d7-4013-9c4e-18c2708abb1e None None] MFA Rules not processed for user `f893d5c330644bd98c7c635c24e60984`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:36.948458 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-60a59416-18d7-4013-9c4e-18c2708abb1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:36.969948 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e69c86f-695d-4803-8a5d-cda1a389cfa4 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:36.973279 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-8e69c86f-695d-4803-8a5d-cda1a389cfa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:37.050449 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1300/2600] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:52:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:52:37.055323 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a59416-18d7-4013-9c4e-18c2708abb1e None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:37.058219 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e69c86f-695d-4803-8a5d-cda1a389cfa4 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:37.063198 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a1485b-96a7-4799-912c-a8a34047222c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:37.063820 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1485b-96a7-4799-912c-a8a34047222c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:37.064098 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1485b-96a7-4799-912c-a8a34047222c admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:37.064373 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1485b-96a7-4799-912c-a8a34047222c admin admin] PATH_INFO: `/v3/projects/18a981e73cc4489d868233af96ed692f` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:37.065550 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a1485b-96a7-4799-912c-a8a34047222c admin admin] RBAC: Authorizing `identity:delete_project(project_id=18a981e73cc4489d868233af96ed692f)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:37.067167 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a59416-18d7-4013-9c4e-18c2708abb1e None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:37.067458 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a1485b-96a7-4799-912c-a8a34047222c admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:37.072190 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3375e963-6901-4af3-9508-ce54f4ec1c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:37.072826 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375e963-6901-4af3-9508-ce54f4ec1c7e admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:37.073974 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375e963-6901-4af3-9508-ce54f4ec1c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:37.074515 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375e963-6901-4af3-9508-ce54f4ec1c7e admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:37.074895 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3375e963-6901-4af3-9508-ce54f4ec1c7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:37.076877 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3375e963-6901-4af3-9508-ce54f4ec1c7e admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:37.077205 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:37.105466 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1301/2601] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:52:37 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:52:37.109459 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3375e963-6901-4af3-9508-ce54f4ec1c7e admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:37.120434 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-71a1485b-96a7-4799-912c-a8a34047222c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18a981e73cc4489d868233af96ed692f', 'request_id': 'req-71a1485b-96a7-4799-912c-a8a34047222c'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:37.128235 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-71a1485b-96a7-4799-912c-a8a34047222c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18a981e73cc4489d868233af96ed692f', 'request_id': 'req-71a1485b-96a7-4799-912c-a8a34047222c'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:37.134290 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-71a1485b-96a7-4799-912c-a8a34047222c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18a981e73cc4489d868233af96ed692f', 'request_id': 'req-71a1485b-96a7-4799-912c-a8a34047222c'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:37.147194 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-71a1485b-96a7-4799-912c-a8a34047222c admin admin] The token cache is being invalidate because project 18a981e73cc4489d868233af96ed692f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:52:37.147874 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-71a1485b-96a7-4799-912c-a8a34047222c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:37.148132 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-71a1485b-96a7-4799-912c-a8a34047222c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:37.153416 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1301/2602] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:52:36 2022] DELETE /identity/v3/projects/18a981e73cc4489d868233af96ed692f => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:52:37.156669 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d07bf-90eb-4d92-9ab8-af6a1c72fe67 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:37.157025 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d07bf-90eb-4d92-9ab8-af6a1c72fe67 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:37.157315 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d07bf-90eb-4d92-9ab8-af6a1c72fe67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:37.164694 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:37.177962 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3375e963-6901-4af3-9508-ce54f4ec1c7e admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:37.179592 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-243d07bf-90eb-4d92-9ab8-af6a1c72fe67 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:37.180814 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-243d07bf-90eb-4d92-9ab8-af6a1c72fe67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:37.236570 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69804fe5-ef71-4d07-a2a0-444a99a834fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:37.237098 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69804fe5-ef71-4d07-a2a0-444a99a834fb admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:37.237410 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69804fe5-ef71-4d07-a2a0-444a99a834fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:37.237687 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69804fe5-ef71-4d07-a2a0-444a99a834fb admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:37.238320 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69804fe5-ef71-4d07-a2a0-444a99a834fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:37.240227 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69804fe5-ef71-4d07-a2a0-444a99a834fb admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:37.248384 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1302/2603] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:52:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:52:37.256312 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2c5e4-100f-491b-a885-7c3e41b8abde None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:37.256756 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2c5e4-100f-491b-a885-7c3e41b8abde None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:37.257146 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2c5e4-100f-491b-a885-7c3e41b8abde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:37.268988 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1302/2604] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:52:37 2022] POST /identity/v3/users => generated 289 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:52:37.270199 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69804fe5-ef71-4d07-a2a0-444a99a834fb admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:37.271880 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-69804fe5-ef71-4d07-a2a0-444a99a834fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:37.283033 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-10c2c5e4-100f-491b-a885-7c3e41b8abde None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:37.284310 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-10c2c5e4-100f-491b-a885-7c3e41b8abde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:37.285264 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69804fe5-ef71-4d07-a2a0-444a99a834fb admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:37.289956 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420286cd-7750-49be-a6b8-98d544c47af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:37.290569 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420286cd-7750-49be-a6b8-98d544c47af8 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:37.290854 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420286cd-7750-49be-a6b8-98d544c47af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:37.291134 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420286cd-7750-49be-a6b8-98d544c47af8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:37.292131 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420286cd-7750-49be-a6b8-98d544c47af8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:37.292843 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1303/2605] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:52:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:52:37.293785 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420286cd-7750-49be-a6b8-98d544c47af8 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:37.297013 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c2c5e4-100f-491b-a885-7c3e41b8abde None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:37.308325 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1303/2606] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:52:37 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:52:37.312486 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c2c5e4-100f-491b-a885-7c3e41b8abde None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:37.313451 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420286cd-7750-49be-a6b8-98d544c47af8 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:37.313752 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef1c44-4166-45f8-8d23-fa39559c4724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:37.314373 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef1c44-4166-45f8-8d23-fa39559c4724 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:37.314657 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef1c44-4166-45f8-8d23-fa39559c4724 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:37.315299 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef1c44-4166-45f8-8d23-fa39559c4724 admin admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:37.315572 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eef1c44-4166-45f8-8d23-fa39559c4724 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:52:37.315877 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eef1c44-4166-45f8-8d23-fa39559c4724 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:37.317513 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eef1c44-4166-45f8-8d23-fa39559c4724 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:37.324523 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420286cd-7750-49be-a6b8-98d544c47af8 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:37.330034 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e163ba-f85c-4346-bb4e-5327190dfccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:37.330677 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e163ba-f85c-4346-bb4e-5327190dfccd admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:37.330961 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e163ba-f85c-4346-bb4e-5327190dfccd admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:37.331244 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e163ba-f85c-4346-bb4e-5327190dfccd admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:37.331491 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1304/2607] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Aug 29 22:52:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:52:37.331912 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e163ba-f85c-4346-bb4e-5327190dfccd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:37.333515 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e163ba-f85c-4346-bb4e-5327190dfccd admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:37.335891 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef1c44-4166-45f8-8d23-fa39559c4724 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:37.348642 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1304/2608] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:52:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:52:37.348823 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef1c44-4166-45f8-8d23-fa39559c4724 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:37.349960 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e163ba-f85c-4346-bb4e-5327190dfccd admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:37.350454 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d89a07e-16f0-4445-97c4-152eb9af5469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:37.351056 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89a07e-16f0-4445-97c4-152eb9af5469 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:37.351327 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89a07e-16f0-4445-97c4-152eb9af5469 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:37.351605 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89a07e-16f0-4445-97c4-152eb9af5469 admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:37.352234 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d89a07e-16f0-4445-97c4-152eb9af5469 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:37.354210 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d89a07e-16f0-4445-97c4-152eb9af5469 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:37.359759 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e163ba-f85c-4346-bb4e-5327190dfccd admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:37.364399 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a69427c-032b-40e2-bc05-06e482e2a0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:37.365044 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69427c-032b-40e2-bc05-06e482e2a0b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:37.365354 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69427c-032b-40e2-bc05-06e482e2a0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:37.365635 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69427c-032b-40e2-bc05-06e482e2a0b6 admin admin] PATH_INFO: `/v3/projects/6433a970ce364a3397531364780ccbb3/users/f98f4355a733431b9b3fdcd4625d2c16/roles/0c67797d444d4c929b2ccab47c468848` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:37.382020 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a69427c-032b-40e2-bc05-06e482e2a0b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6433a970ce364a3397531364780ccbb3, user_id=f98f4355a733431b9b3fdcd4625d2c16, role_id=0c67797d444d4c929b2ccab47c468848)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:37.382590 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1305/2609] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:52:37 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:52:37.384746 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a69427c-032b-40e2-bc05-06e482e2a0b6 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:37.387077 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d89a07e-16f0-4445-97c4-152eb9af5469 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:37.399682 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1305/2610] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:52:37 2022] PUT /identity/v3/projects/6433a970ce364a3397531364780ccbb3/users/f98f4355a733431b9b3fdcd4625d2c16/roles/0c67797d444d4c929b2ccab47c468848 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:52:37.410777 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d5388-cb5e-406b-8e3b-3f2eb712e9b0 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:37.411064 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d5388-cb5e-406b-8e3b-3f2eb712e9b0 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:37.411344 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d5388-cb5e-406b-8e3b-3f2eb712e9b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:37.439860 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-324d5388-cb5e-406b-8e3b-3f2eb712e9b0 None None] MFA Rules not processed for user `f98f4355a733431b9b3fdcd4625d2c16`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:37.441104 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-324d5388-cb5e-406b-8e3b-3f2eb712e9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:37.446481 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:37.453561 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d89a07e-16f0-4445-97c4-152eb9af5469 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:37.508208 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1306/2611] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:52:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:52:37.512758 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324d5388-cb5e-406b-8e3b-3f2eb712e9b0 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:37.514849 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e0c5c3-52d6-4b43-99ef-abe5f6b575fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:37.515681 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0c5c3-52d6-4b43-99ef-abe5f6b575fd admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:37.515965 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0c5c3-52d6-4b43-99ef-abe5f6b575fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:37.516234 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0c5c3-52d6-4b43-99ef-abe5f6b575fd admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:37.516896 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e0c5c3-52d6-4b43-99ef-abe5f6b575fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:37.518852 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e0c5c3-52d6-4b43-99ef-abe5f6b575fd admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:37.523975 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324d5388-cb5e-406b-8e3b-3f2eb712e9b0 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:37.529640 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68053009-1567-4969-98f0-d0aa58583677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:37.530522 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68053009-1567-4969-98f0-d0aa58583677 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:37.530805 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68053009-1567-4969-98f0-d0aa58583677 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:37.531082 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68053009-1567-4969-98f0-d0aa58583677 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:37.531771 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68053009-1567-4969-98f0-d0aa58583677 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:37.533751 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68053009-1567-4969-98f0-d0aa58583677 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:37.545090 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1306/2612] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:52:37 2022] POST /identity/v3/users => generated 293 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:52:37.546162 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e0c5c3-52d6-4b43-99ef-abe5f6b575fd admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:37.556889 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e0c5c3-52d6-4b43-99ef-abe5f6b575fd admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:37.561891 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de4dfb8-9aaf-4b99-8f8e-3347ca330570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:37.562502 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4dfb8-9aaf-4b99-8f8e-3347ca330570 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:37.562782 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4dfb8-9aaf-4b99-8f8e-3347ca330570 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:37.563017 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1307/2613] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:52:37 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:52:37.565410 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4dfb8-9aaf-4b99-8f8e-3347ca330570 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:37.566101 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de4dfb8-9aaf-4b99-8f8e-3347ca330570 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:37.567071 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68053009-1567-4969-98f0-d0aa58583677 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:37.567705 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de4dfb8-9aaf-4b99-8f8e-3347ca330570 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:37.578554 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:37.578714 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1307/2614] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:52:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:52:37.582791 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de4dfb8-9aaf-4b99-8f8e-3347ca330570 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:37.594258 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de4dfb8-9aaf-4b99-8f8e-3347ca330570 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:37.638839 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68053009-1567-4969-98f0-d0aa58583677 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:37.644226 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ddb85c-5870-468e-8694-318ca036963c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:37.644843 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ddb85c-5870-468e-8694-318ca036963c admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:37.645127 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ddb85c-5870-468e-8694-318ca036963c admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:37.645760 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ddb85c-5870-468e-8694-318ca036963c admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:37.646076 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ddb85c-5870-468e-8694-318ca036963c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:37.648030 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ddb85c-5870-468e-8694-318ca036963c admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:37.655094 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b8753-1bc5-49c9-bf84-94064e65661f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:37.655956 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b8753-1bc5-49c9-bf84-94064e65661f admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:37.656246 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b8753-1bc5-49c9-bf84-94064e65661f admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:37.656501 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b8753-1bc5-49c9-bf84-94064e65661f admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:37.657131 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0b8753-1bc5-49c9-bf84-94064e65661f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:37.658746 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0b8753-1bc5-49c9-bf84-94064e65661f admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:37.672532 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1308/2615] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:52:37 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:52:37.673646 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b8753-1bc5-49c9-bf84-94064e65661f admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:37.675779 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1308/2616] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:52:37 2022] POST /identity/v3/users => generated 295 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:52:37.679517 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ddb85c-5870-468e-8694-318ca036963c admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:37.684863 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b8753-1bc5-49c9-bf84-94064e65661f admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:37.689408 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ddb85c-5870-468e-8694-318ca036963c admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:37.690095 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbf2c77-71f8-447a-a541-afeb3d8bbef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:37.690809 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf2c77-71f8-447a-a541-afeb3d8bbef0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:37.691017 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf2c77-71f8-447a-a541-afeb3d8bbef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:37.691292 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf2c77-71f8-447a-a541-afeb3d8bbef0 admin admin] PATH_INFO: `/v3/projects/746cfbe203fc4fd7970e91544fd2daff/users/8ece49affb4d475fa13bb26fce309d0d/roles/0c67797d444d4c929b2ccab47c468848` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:37.694103 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfa61c2-dbc3-4a59-93b4-d1147022c40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:37.694695 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa61c2-dbc3-4a59-93b4-d1147022c40c admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:37.694976 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa61c2-dbc3-4a59-93b4-d1147022c40c admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:37.695250 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa61c2-dbc3-4a59-93b4-d1147022c40c admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:37.695890 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfa61c2-dbc3-4a59-93b4-d1147022c40c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:37.697515 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfa61c2-dbc3-4a59-93b4-d1147022c40c admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:37.706958 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbf2c77-71f8-447a-a541-afeb3d8bbef0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=746cfbe203fc4fd7970e91544fd2daff, user_id=8ece49affb4d475fa13bb26fce309d0d, role_id=0c67797d444d4c929b2ccab47c468848)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:37.708328 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1309/2617] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:52:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:52:37.709791 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbf2c77-71f8-447a-a541-afeb3d8bbef0 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:37.712802 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfa61c2-dbc3-4a59-93b4-d1147022c40c admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:37.723793 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfa61c2-dbc3-4a59-93b4-d1147022c40c admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:37.724314 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1309/2618] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:52:37 2022] PUT /identity/v3/projects/746cfbe203fc4fd7970e91544fd2daff/users/8ece49affb4d475fa13bb26fce309d0d/roles/0c67797d444d4c929b2ccab47c468848 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:52:37.735833 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb3d2b-a34d-48bb-a8cc-748b893cdb42 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:37.736892 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb3d2b-a34d-48bb-a8cc-748b893cdb42 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:37.738762 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb3d2b-a34d-48bb-a8cc-748b893cdb42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:37.770143 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-4ffb3d2b-a34d-48bb-a8cc-748b893cdb42 None None] MFA Rules not processed for user `8ece49affb4d475fa13bb26fce309d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:37.771322 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-4ffb3d2b-a34d-48bb-a8cc-748b893cdb42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:37.790735 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea82cd7-ca1b-4102-a7b1-997a3772f47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:37.791358 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea82cd7-ca1b-4102-a7b1-997a3772f47e admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:37.791666 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea82cd7-ca1b-4102-a7b1-997a3772f47e admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:37.791944 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea82cd7-ca1b-4102-a7b1-997a3772f47e admin admin] PATH_INFO: `/v3/projects/31f593e21b8942c0974adaa9e1e68588/users/70d08c04e09a4efeb56cd535fbb292ff/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:37.808700 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea82cd7-ca1b-4102-a7b1-997a3772f47e admin admin] RBAC: Authorizing `identity:create_grant(project_id=31f593e21b8942c0974adaa9e1e68588, user_id=70d08c04e09a4efeb56cd535fbb292ff, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:37.812255 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea82cd7-ca1b-4102-a7b1-997a3772f47e admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:37.819022 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:37.829713 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1310/2619] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:52:37 2022] PUT /identity/v3/projects/31f593e21b8942c0974adaa9e1e68588/users/70d08c04e09a4efeb56cd535fbb292ff/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:52:37.833639 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea82cd7-ca1b-4102-a7b1-997a3772f47e admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:37.850828 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1310/2620] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:52:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:52:37.856100 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb3d2b-a34d-48bb-a8cc-748b893cdb42 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:37.868601 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb3d2b-a34d-48bb-a8cc-748b893cdb42 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:37.912541 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea82cd7-ca1b-4102-a7b1-997a3772f47e admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:37.917952 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af282e5-8172-49f5-9f61-2b69702dc2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:37.918525 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af282e5-8172-49f5-9f61-2b69702dc2e5 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:37.918806 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af282e5-8172-49f5-9f61-2b69702dc2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:37.919080 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af282e5-8172-49f5-9f61-2b69702dc2e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:37.919720 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af282e5-8172-49f5-9f61-2b69702dc2e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:37.921367 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af282e5-8172-49f5-9f61-2b69702dc2e5 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:37.933201 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1311/2621] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:52:37 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:52:37.937442 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af282e5-8172-49f5-9f61-2b69702dc2e5 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:37.940703 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a857fc9f-6757-4f66-93db-774d94f230f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:37.941502 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857fc9f-6757-4f66-93db-774d94f230f5 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:37.941789 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857fc9f-6757-4f66-93db-774d94f230f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:37.942062 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857fc9f-6757-4f66-93db-774d94f230f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:37.942705 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a857fc9f-6757-4f66-93db-774d94f230f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:37.944659 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a857fc9f-6757-4f66-93db-774d94f230f5 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:37.947693 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af282e5-8172-49f5-9f61-2b69702dc2e5 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:37.953395 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554b9504-4f23-43e3-92ed-1b8e6954f876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:37.954227 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b9504-4f23-43e3-92ed-1b8e6954f876 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:37.954515 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b9504-4f23-43e3-92ed-1b8e6954f876 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:37.955357 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b9504-4f23-43e3-92ed-1b8e6954f876 admin admin] PATH_INFO: `/v3/projects/31f593e21b8942c0974adaa9e1e68588/users/70d08c04e09a4efeb56cd535fbb292ff/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:37.958136 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554b9504-4f23-43e3-92ed-1b8e6954f876 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31f593e21b8942c0974adaa9e1e68588, user_id=70d08c04e09a4efeb56cd535fbb292ff, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:37.960900 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554b9504-4f23-43e3-92ed-1b8e6954f876 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:37.963363 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:37.976323 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1312/2622] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:52:37 2022] PUT /identity/v3/projects/31f593e21b8942c0974adaa9e1e68588/users/70d08c04e09a4efeb56cd535fbb292ff/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:52:37.986403 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1311/2623] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:52:37 2022] POST /identity/v3/projects => generated 385 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:52:37.990305 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a857fc9f-6757-4f66-93db-774d94f230f5 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:37.999327 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd162c1a-2b4f-4519-a8a3-faa02813260e None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:37.999701 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd162c1a-2b4f-4519-a8a3-faa02813260e None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:38.000277 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd162c1a-2b4f-4519-a8a3-faa02813260e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:38.042332 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-dd162c1a-2b4f-4519-a8a3-faa02813260e None None] MFA Rules not processed for user `70d08c04e09a4efeb56cd535fbb292ff`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:38.043788 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-dd162c1a-2b4f-4519-a8a3-faa02813260e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:38.072016 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a857fc9f-6757-4f66-93db-774d94f230f5 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:38.077096 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb6c3e-8bac-495e-981b-0590dfa9fe20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:38.077911 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb6c3e-8bac-495e-981b-0590dfa9fe20 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:38.078251 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb6c3e-8bac-495e-981b-0590dfa9fe20 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:38.078735 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb6c3e-8bac-495e-981b-0590dfa9fe20 admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:38.079573 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fb6c3e-8bac-495e-981b-0590dfa9fe20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:38.081807 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fb6c3e-8bac-495e-981b-0590dfa9fe20 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:38.118742 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1312/2624] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:52:37 2022] POST /identity/v3/users => generated 299 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:52:38.120482 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb6c3e-8bac-495e-981b-0590dfa9fe20 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:38.130969 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb6c3e-8bac-495e-981b-0590dfa9fe20 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:38.135972 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51043ef-325a-4131-a82b-74bb8a623379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:38.136580 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51043ef-325a-4131-a82b-74bb8a623379 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:38.136876 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51043ef-325a-4131-a82b-74bb8a623379 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:38.137153 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51043ef-325a-4131-a82b-74bb8a623379 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:38.137838 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51043ef-325a-4131-a82b-74bb8a623379 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:38.138901 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1313/2625] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:52:37 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:52:38.139763 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51043ef-325a-4131-a82b-74bb8a623379 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:38.152415 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1313/2626] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:52:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:52:38.154000 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd162c1a-2b4f-4519-a8a3-faa02813260e None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:38.155590 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-dd162c1a-2b4f-4519-a8a3-faa02813260e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:38.157291 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51043ef-325a-4131-a82b-74bb8a623379 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:38.170421 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51043ef-325a-4131-a82b-74bb8a623379 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:38.175385 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e5f79-6768-4a87-812d-d512c79e0388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:38.176032 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e5f79-6768-4a87-812d-d512c79e0388 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:38.176303 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e5f79-6768-4a87-812d-d512c79e0388 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:38.176596 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e5f79-6768-4a87-812d-d512c79e0388 admin admin] PATH_INFO: `/v3/projects/eb906db04c884a07b5524f166dc68473/users/c83626adf8ac49aebba0d0009a5b6226/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:38.191987 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9e5f79-6768-4a87-812d-d512c79e0388 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb906db04c884a07b5524f166dc68473, user_id=c83626adf8ac49aebba0d0009a5b6226, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:38.194671 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9e5f79-6768-4a87-812d-d512c79e0388 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:38.208437 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1314/2627] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:52:38 2022] PUT /identity/v3/projects/eb906db04c884a07b5524f166dc68473/users/c83626adf8ac49aebba0d0009a5b6226/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:52:38.212399 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e5f79-6768-4a87-812d-d512c79e0388 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:38.218789 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd162c1a-2b4f-4519-a8a3-faa02813260e None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:38.237162 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:38.269460 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c01a75c-a0c2-4f61-aade-1c30518f9cf6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:38.270075 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c01a75c-a0c2-4f61-aade-1c30518f9cf6 service cinder] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:38.270353 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c01a75c-a0c2-4f61-aade-1c30518f9cf6 service cinder] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:38.270623 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c01a75c-a0c2-4f61-aade-1c30518f9cf6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:38.272400 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-5c01a75c-a0c2-4f61-aade-1c30518f9cf6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:38.284893 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e5f79-6768-4a87-812d-d512c79e0388 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:38.290691 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e65a395-954f-4fa4-9fae-28220e152830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:38.291382 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65a395-954f-4fa4-9fae-28220e152830 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:38.292377 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65a395-954f-4fa4-9fae-28220e152830 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:38.292650 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65a395-954f-4fa4-9fae-28220e152830 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:38.293306 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e65a395-954f-4fa4-9fae-28220e152830 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:38.294947 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e65a395-954f-4fa4-9fae-28220e152830 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:38.305237 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1315/2628] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:52:38 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:52:38.309817 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e65a395-954f-4fa4-9fae-28220e152830 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:38.319531 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e65a395-954f-4fa4-9fae-28220e152830 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:38.325217 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd03f0-59d6-494f-a79c-c3c646540e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:38.325907 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd03f0-59d6-494f-a79c-c3c646540e5c admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:38.326169 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd03f0-59d6-494f-a79c-c3c646540e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:38.326463 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd03f0-59d6-494f-a79c-c3c646540e5c admin admin] PATH_INFO: `/v3/projects/eb906db04c884a07b5524f166dc68473/users/c83626adf8ac49aebba0d0009a5b6226/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:38.328016 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:38.328388 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbd03f0-59d6-494f-a79c-c3c646540e5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb906db04c884a07b5524f166dc68473, user_id=c83626adf8ac49aebba0d0009a5b6226, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:38.331076 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbd03f0-59d6-494f-a79c-c3c646540e5c admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:38.342168 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1316/2629] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:52:38 2022] PUT /identity/v3/projects/eb906db04c884a07b5524f166dc68473/users/c83626adf8ac49aebba0d0009a5b6226/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:52:38.342408 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c01a75c-a0c2-4f61-aade-1c30518f9cf6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:38.343860 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c01a75c-a0c2-4f61-aade-1c30518f9cf6 service cinder] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:38.353008 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64928a20-f377-474e-ae79-a1535612e4a5 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:38.353296 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64928a20-f377-474e-ae79-a1535612e4a5 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:38.353654 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1314/2630] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:52:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:52:38.353780 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64928a20-f377-474e-ae79-a1535612e4a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:38.382251 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-64928a20-f377-474e-ae79-a1535612e4a5 None None] MFA Rules not processed for user `c83626adf8ac49aebba0d0009a5b6226`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:38.383548 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-64928a20-f377-474e-ae79-a1535612e4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:38.454172 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1317/2631] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:52:38 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:52:38.465936 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c01a75c-a0c2-4f61-aade-1c30518f9cf6 service cinder] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:38.467377 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-5c01a75c-a0c2-4f61-aade-1c30518f9cf6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:38.478643 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c01a75c-a0c2-4f61-aade-1c30518f9cf6 service cinder] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:38.535070 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2280b8-34f5-4687-a716-843a24fe36d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:38.535597 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2280b8-34f5-4687-a716-843a24fe36d0 service cinder] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:38.535888 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2280b8-34f5-4687-a716-843a24fe36d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:38.536132 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2280b8-34f5-4687-a716-843a24fe36d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:38.545722 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2280b8-34f5-4687-a716-843a24fe36d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:38.547150 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2280b8-34f5-4687-a716-843a24fe36d0 service cinder] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:38.557022 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1315/2632] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:52:38 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:52:38.586900 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64928a20-f377-474e-ae79-a1535612e4a5 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:38.660458 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64928a20-f377-474e-ae79-a1535612e4a5 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:38.668106 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69b0841-344d-435b-b482-926a3738b07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:38.668868 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b0841-344d-435b-b482-926a3738b07e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:38.669191 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b0841-344d-435b-b482-926a3738b07e admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:38.669570 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b0841-344d-435b-b482-926a3738b07e admin admin] PATH_INFO: `/v3/users/8ece49affb4d475fa13bb26fce309d0d` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:38.670809 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69b0841-344d-435b-b482-926a3738b07e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ece49affb4d475fa13bb26fce309d0d)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:38.672927 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69b0841-344d-435b-b482-926a3738b07e admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:38.711653 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:38.725891 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-f69b0841-344d-435b-b482-926a3738b07e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ece49affb4d475fa13bb26fce309d0d'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:38.733655 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-f69b0841-344d-435b-b482-926a3738b07e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ece49affb4d475fa13bb26fce309d0d'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:38.734462 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-f69b0841-344d-435b-b482-926a3738b07e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ece49affb4d475fa13bb26fce309d0d'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:38.741848 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-f69b0841-344d-435b-b482-926a3738b07e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ece49affb4d475fa13bb26fce309d0d'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:38.742498 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-f69b0841-344d-435b-b482-926a3738b07e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ece49affb4d475fa13bb26fce309d0d'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:38.761662 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1318/2633] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:52:38 2022] DELETE /identity/v3/users/8ece49affb4d475fa13bb26fce309d0d => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:52:38.766388 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750edec1-086f-490c-8142-dae86b1f5b15 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:38.766704 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750edec1-086f-490c-8142-dae86b1f5b15 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:38.766983 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750edec1-086f-490c-8142-dae86b1f5b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:38.786595 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-750edec1-086f-490c-8142-dae86b1f5b15 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:38.787732 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-750edec1-086f-490c-8142-dae86b1f5b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:38.846526 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1316/2634] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:52:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:52:38.856507 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69b0841-344d-435b-b482-926a3738b07e admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:38.858297 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-f69b0841-344d-435b-b482-926a3738b07e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:38.918677 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69b0841-344d-435b-b482-926a3738b07e admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:38.922313 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa994f-9c6f-4da8-af68-0f9e6d72974f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:38.922914 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa994f-9c6f-4da8-af68-0f9e6d72974f service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:38.923187 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa994f-9c6f-4da8-af68-0f9e6d72974f service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:38.923455 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa994f-9c6f-4da8-af68-0f9e6d72974f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:38.932945 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aa994f-9c6f-4da8-af68-0f9e6d72974f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:38.934581 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aa994f-9c6f-4da8-af68-0f9e6d72974f service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:38.943918 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1319/2635] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:52:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:52:39.217279 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750edec1-086f-490c-8142-dae86b1f5b15 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:39.218749 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-750edec1-086f-490c-8142-dae86b1f5b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:39.232616 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750edec1-086f-490c-8142-dae86b1f5b15 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:39.238033 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4220a0bc-b4eb-453b-8c5a-380ab5745211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:39.238368 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220a0bc-b4eb-453b-8c5a-380ab5745211 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:39.238714 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220a0bc-b4eb-453b-8c5a-380ab5745211 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:39.239091 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220a0bc-b4eb-453b-8c5a-380ab5745211 admin admin] PATH_INFO: `/v3/projects/746cfbe203fc4fd7970e91544fd2daff` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:39.240226 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4220a0bc-b4eb-453b-8c5a-380ab5745211 admin admin] RBAC: Authorizing `identity:delete_project(project_id=746cfbe203fc4fd7970e91544fd2daff)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:39.242372 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4220a0bc-b4eb-453b-8c5a-380ab5745211 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:39.299566 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-4220a0bc-b4eb-453b-8c5a-380ab5745211 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '746cfbe203fc4fd7970e91544fd2daff', 'request_id': 'req-4220a0bc-b4eb-453b-8c5a-380ab5745211'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:39.308095 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-4220a0bc-b4eb-453b-8c5a-380ab5745211 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '746cfbe203fc4fd7970e91544fd2daff', 'request_id': 'req-4220a0bc-b4eb-453b-8c5a-380ab5745211'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:39.315929 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-4220a0bc-b4eb-453b-8c5a-380ab5745211 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '746cfbe203fc4fd7970e91544fd2daff', 'request_id': 'req-4220a0bc-b4eb-453b-8c5a-380ab5745211'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:39.328958 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-4220a0bc-b4eb-453b-8c5a-380ab5745211 admin admin] The token cache is being invalidate because project 746cfbe203fc4fd7970e91544fd2daff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:52:39.329248 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-4220a0bc-b4eb-453b-8c5a-380ab5745211 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:39.329891 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-4220a0bc-b4eb-453b-8c5a-380ab5745211 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:39.331384 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1317/2636] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:52:39 2022] DELETE /identity/v3/projects/746cfbe203fc4fd7970e91544fd2daff => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:52:39.335345 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa994f-9c6f-4da8-af68-0f9e6d72974f service neutron] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:39.345717 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa994f-9c6f-4da8-af68-0f9e6d72974f service neutron] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:39.405852 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59664f2e-444d-40af-a024-57d95aacf010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:39.406475 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59664f2e-444d-40af-a024-57d95aacf010 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:39.406753 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59664f2e-444d-40af-a024-57d95aacf010 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:39.407026 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59664f2e-444d-40af-a024-57d95aacf010 admin admin] PATH_INFO: `/v3/users/c83626adf8ac49aebba0d0009a5b6226` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:39.408148 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59664f2e-444d-40af-a024-57d95aacf010 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c83626adf8ac49aebba0d0009a5b6226)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:39.410124 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59664f2e-444d-40af-a024-57d95aacf010 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:39.460125 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-59664f2e-444d-40af-a024-57d95aacf010 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c83626adf8ac49aebba0d0009a5b6226'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:39.466343 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:39.468545 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-59664f2e-444d-40af-a024-57d95aacf010 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c83626adf8ac49aebba0d0009a5b6226'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:39.469578 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-59664f2e-444d-40af-a024-57d95aacf010 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c83626adf8ac49aebba0d0009a5b6226'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:39.478433 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-59664f2e-444d-40af-a024-57d95aacf010 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c83626adf8ac49aebba0d0009a5b6226'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:39.479046 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-59664f2e-444d-40af-a024-57d95aacf010 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c83626adf8ac49aebba0d0009a5b6226'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:39.498969 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1320/2637] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:52:39 2022] DELETE /identity/v3/users/c83626adf8ac49aebba0d0009a5b6226 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:52:39.782836 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4220a0bc-b4eb-453b-8c5a-380ab5745211 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:39.784367 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-4220a0bc-b4eb-453b-8c5a-380ab5745211 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:39.799457 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4220a0bc-b4eb-453b-8c5a-380ab5745211 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:39.813563 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:39.865367 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11427270-d33e-478a-a95e-1c3a732305d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:39.866013 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11427270-d33e-478a-a95e-1c3a732305d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:39.866294 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11427270-d33e-478a-a95e-1c3a732305d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:39.866573 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11427270-d33e-478a-a95e-1c3a732305d2 admin admin] PATH_INFO: `/v3/projects/eb906db04c884a07b5524f166dc68473` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:39.867860 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11427270-d33e-478a-a95e-1c3a732305d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb906db04c884a07b5524f166dc68473)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:39.869678 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11427270-d33e-478a-a95e-1c3a732305d2 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:39.882582 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59664f2e-444d-40af-a024-57d95aacf010 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:39.884420 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-59664f2e-444d-40af-a024-57d95aacf010 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:39.920967 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-11427270-d33e-478a-a95e-1c3a732305d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb906db04c884a07b5524f166dc68473', 'request_id': 'req-11427270-d33e-478a-a95e-1c3a732305d2'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:39.927197 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-11427270-d33e-478a-a95e-1c3a732305d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb906db04c884a07b5524f166dc68473', 'request_id': 'req-11427270-d33e-478a-a95e-1c3a732305d2'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:39.932871 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-11427270-d33e-478a-a95e-1c3a732305d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb906db04c884a07b5524f166dc68473', 'request_id': 'req-11427270-d33e-478a-a95e-1c3a732305d2'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:39.945990 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59664f2e-444d-40af-a024-57d95aacf010 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:39.946465 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-11427270-d33e-478a-a95e-1c3a732305d2 admin admin] The token cache is being invalidate because project eb906db04c884a07b5524f166dc68473 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:52:39.946759 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-11427270-d33e-478a-a95e-1c3a732305d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:39.947404 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-11427270-d33e-478a-a95e-1c3a732305d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:39.949714 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1318/2638] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:52:39 2022] DELETE /identity/v3/projects/eb906db04c884a07b5524f166dc68473 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:52:39.954446 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59b15a-6ee3-42ac-be28-d263751a7d8a None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:39.954853 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59b15a-6ee3-42ac-be28-d263751a7d8a None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:39.955011 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59b15a-6ee3-42ac-be28-d263751a7d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:39.980171 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-bc59b15a-6ee3-42ac-be28-d263751a7d8a None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:39.981907 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-bc59b15a-6ee3-42ac-be28-d263751a7d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:40.002896 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b04ae8-3c0c-487e-bb44-5f8743d51b18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:40.003948 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b04ae8-3c0c-487e-bb44-5f8743d51b18 service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:40.004330 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b04ae8-3c0c-487e-bb44-5f8743d51b18 service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:40.004704 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b04ae8-3c0c-487e-bb44-5f8743d51b18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:40.006601 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-44b04ae8-3c0c-487e-bb44-5f8743d51b18 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:40.045445 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1319/2639] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:52:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:52:40.054488 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483cbd26-71a9-46e2-a0c4-8ae382fa06af None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:40.054777 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483cbd26-71a9-46e2-a0c4-8ae382fa06af None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:40.055057 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483cbd26-71a9-46e2-a0c4-8ae382fa06af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:40.068610 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b04ae8-3c0c-487e-bb44-5f8743d51b18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:40.070081 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b04ae8-3c0c-487e-bb44-5f8743d51b18 service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:40.075760 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-483cbd26-71a9-46e2-a0c4-8ae382fa06af None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:40.077002 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-483cbd26-71a9-46e2-a0c4-8ae382fa06af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:40.079578 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1321/2640] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:52:39 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:52:40.085687 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1320/2641] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:52:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:52:40.089809 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b04ae8-3c0c-487e-bb44-5f8743d51b18 service cinder] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:40.101778 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b04ae8-3c0c-487e-bb44-5f8743d51b18 service cinder] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:40.107561 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4165457d-7c8d-4038-ae48-04d0e549e594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:40.108113 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165457d-7c8d-4038-ae48-04d0e549e594 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:40.108395 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165457d-7c8d-4038-ae48-04d0e549e594 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:40.108800 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165457d-7c8d-4038-ae48-04d0e549e594 admin admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:40.109486 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4165457d-7c8d-4038-ae48-04d0e549e594 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:52:40.109792 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4165457d-7c8d-4038-ae48-04d0e549e594 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:40.111396 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4165457d-7c8d-4038-ae48-04d0e549e594 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:40.124263 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1322/2642] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Aug 29 22:52:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:52:40.128490 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483cbd26-71a9-46e2-a0c4-8ae382fa06af None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:40.138079 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483cbd26-71a9-46e2-a0c4-8ae382fa06af None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:40.142806 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1211dec1-e665-4aac-868a-ada45237dc34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:40.143415 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1211dec1-e665-4aac-868a-ada45237dc34 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:40.143695 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1211dec1-e665-4aac-868a-ada45237dc34 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:40.143967 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1211dec1-e665-4aac-868a-ada45237dc34 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:40.144610 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1211dec1-e665-4aac-868a-ada45237dc34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:40.146569 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1211dec1-e665-4aac-868a-ada45237dc34 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:40.179110 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1321/2643] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:52:40 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:52:40.180439 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4165457d-7c8d-4038-ae48-04d0e549e594 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:40.191465 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4165457d-7c8d-4038-ae48-04d0e549e594 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:40.219076 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:40.253451 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e2547-4c44-4c37-9846-4b81abdd6c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:40.254066 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e2547-4c44-4c37-9846-4b81abdd6c4c admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:40.254356 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e2547-4c44-4c37-9846-4b81abdd6c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:40.254630 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e2547-4c44-4c37-9846-4b81abdd6c4c admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:40.255358 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57e2547-4c44-4c37-9846-4b81abdd6c4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:40.257796 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57e2547-4c44-4c37-9846-4b81abdd6c4c admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:40.283239 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1323/2644] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:52:40 2022] POST /identity/v3/users => generated 290 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:52:40.288760 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1211dec1-e665-4aac-868a-ada45237dc34 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:40.300463 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1211dec1-e665-4aac-868a-ada45237dc34 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:40.307065 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42c2796-32ad-49b0-9347-6c1cfaa6c098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:40.308291 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c2796-32ad-49b0-9347-6c1cfaa6c098 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:40.308868 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c2796-32ad-49b0-9347-6c1cfaa6c098 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:40.309574 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c2796-32ad-49b0-9347-6c1cfaa6c098 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:40.310243 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42c2796-32ad-49b0-9347-6c1cfaa6c098 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:40.311845 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42c2796-32ad-49b0-9347-6c1cfaa6c098 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:40.327044 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1322/2645] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:52:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:52:40.328211 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e2547-4c44-4c37-9846-4b81abdd6c4c admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:40.344448 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e2547-4c44-4c37-9846-4b81abdd6c4c admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:40.349599 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cb8e71-494d-42b2-a74f-b23c08deaa83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:40.350212 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb8e71-494d-42b2-a74f-b23c08deaa83 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:40.350640 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb8e71-494d-42b2-a74f-b23c08deaa83 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:40.350911 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb8e71-494d-42b2-a74f-b23c08deaa83 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:40.351559 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cb8e71-494d-42b2-a74f-b23c08deaa83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:40.353270 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cb8e71-494d-42b2-a74f-b23c08deaa83 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:40.375571 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1324/2646] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:52:40 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:52:40.376936 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42c2796-32ad-49b0-9347-6c1cfaa6c098 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:40.388851 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42c2796-32ad-49b0-9347-6c1cfaa6c098 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:40.395152 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37545260-72cc-4466-ab1d-c78f3af7ed37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:40.395842 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37545260-72cc-4466-ab1d-c78f3af7ed37 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:40.396818 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37545260-72cc-4466-ab1d-c78f3af7ed37 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:40.397270 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37545260-72cc-4466-ab1d-c78f3af7ed37 admin admin] PATH_INFO: `/v3/projects/28322d40404c47dfaeea1b0d83499e04/users/f541b432baee4a0387ca8565a8d11362/roles/0c67797d444d4c929b2ccab47c468848` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:40.400192 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:40.421854 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37545260-72cc-4466-ab1d-c78f3af7ed37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28322d40404c47dfaeea1b0d83499e04, user_id=f541b432baee4a0387ca8565a8d11362, role_id=0c67797d444d4c929b2ccab47c468848)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:40.425657 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37545260-72cc-4466-ab1d-c78f3af7ed37 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:40.445027 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1323/2647] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:52:40 2022] PUT /identity/v3/projects/28322d40404c47dfaeea1b0d83499e04/users/f541b432baee4a0387ca8565a8d11362/roles/0c67797d444d4c929b2ccab47c468848 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:52:40.453584 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb039257-6901-4f64-a7b3-ae6af3642c0f None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:40.453870 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb039257-6901-4f64-a7b3-ae6af3642c0f None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:40.454147 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb039257-6901-4f64-a7b3-ae6af3642c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:40.496335 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-cb039257-6901-4f64-a7b3-ae6af3642c0f None None] MFA Rules not processed for user `f541b432baee4a0387ca8565a8d11362`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:40.497774 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-cb039257-6901-4f64-a7b3-ae6af3642c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:40.571452 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1325/2648] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:52:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:52:40.576841 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37545260-72cc-4466-ab1d-c78f3af7ed37 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:40.655079 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37545260-72cc-4466-ab1d-c78f3af7ed37 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:40.660299 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa45e91-e854-43ee-a28d-b80ebd837221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:40.660984 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa45e91-e854-43ee-a28d-b80ebd837221 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:40.661297 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa45e91-e854-43ee-a28d-b80ebd837221 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:40.661744 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa45e91-e854-43ee-a28d-b80ebd837221 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:40.662231 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa45e91-e854-43ee-a28d-b80ebd837221 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:40.666962 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa45e91-e854-43ee-a28d-b80ebd837221 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:40.697642 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1324/2649] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:52:40 2022] POST /identity/v3/projects => generated 377 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:52:40.703164 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb039257-6901-4f64-a7b3-ae6af3642c0f None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:40.706490 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa45e91-e854-43ee-a28d-b80ebd837221 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:40.708160 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-0fa45e91-e854-43ee-a28d-b80ebd837221 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:40.716358 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb039257-6901-4f64-a7b3-ae6af3642c0f None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:40.768600 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa45e91-e854-43ee-a28d-b80ebd837221 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:40.772522 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9921140-a22f-4509-94fe-7a107f834168 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:40.773133 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9921140-a22f-4509-94fe-7a107f834168 service cinder] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:40.773443 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9921140-a22f-4509-94fe-7a107f834168 service cinder] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:40.773718 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9921140-a22f-4509-94fe-7a107f834168 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:40.774913 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee8e49-4848-49d0-8103-79823dc21a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:40.775467 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-d9921140-a22f-4509-94fe-7a107f834168 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:40.775578 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee8e49-4848-49d0-8103-79823dc21a69 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:40.775768 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee8e49-4848-49d0-8103-79823dc21a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:40.776630 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee8e49-4848-49d0-8103-79823dc21a69 admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:40.777270 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee8e49-4848-49d0-8103-79823dc21a69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:40.779207 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee8e49-4848-49d0-8103-79823dc21a69 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:40.804023 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1326/2650] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:52:40 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:52:40.805565 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee8e49-4848-49d0-8103-79823dc21a69 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:40.815592 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee8e49-4848-49d0-8103-79823dc21a69 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:40.820583 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1661e4bb-af19-49e5-ba58-85175eea54a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:40.821257 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661e4bb-af19-49e5-ba58-85175eea54a5 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:40.821631 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661e4bb-af19-49e5-ba58-85175eea54a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:40.821971 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661e4bb-af19-49e5-ba58-85175eea54a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:40.822683 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1661e4bb-af19-49e5-ba58-85175eea54a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:40.824948 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1661e4bb-af19-49e5-ba58-85175eea54a5 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:40.835288 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1327/2651] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:52:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:52:40.839725 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1661e4bb-af19-49e5-ba58-85175eea54a5 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:40.842924 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9921140-a22f-4509-94fe-7a107f834168 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:40.844602 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9921140-a22f-4509-94fe-7a107f834168 service cinder] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:40.849648 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1661e4bb-af19-49e5-ba58-85175eea54a5 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:40.854415 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1325/2652] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:52:40 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:52:40.854603 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb4baa-a03a-4d50-8e99-a13e59fa3e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:40.855255 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb4baa-a03a-4d50-8e99-a13e59fa3e47 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:40.855532 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb4baa-a03a-4d50-8e99-a13e59fa3e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:40.855809 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb4baa-a03a-4d50-8e99-a13e59fa3e47 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:40.856535 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfb4baa-a03a-4d50-8e99-a13e59fa3e47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:40.858102 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfb4baa-a03a-4d50-8e99-a13e59fa3e47 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:40.871143 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1328/2653] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:52:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:52:40.875391 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9921140-a22f-4509-94fe-7a107f834168 service cinder] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:40.886474 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9921140-a22f-4509-94fe-7a107f834168 service cinder] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:40.891982 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed886024-1388-4558-859c-1b6896d204b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:40.892704 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed886024-1388-4558-859c-1b6896d204b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:40.892957 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed886024-1388-4558-859c-1b6896d204b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:40.893224 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed886024-1388-4558-859c-1b6896d204b2 admin admin] PATH_INFO: `/v3/projects/3fb29c95adb947a88ef144f09c7cb501/users/bc991221ef1c473eb86ca5e2ae799874/roles/0c67797d444d4c929b2ccab47c468848` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:40.913548 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed886024-1388-4558-859c-1b6896d204b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fb29c95adb947a88ef144f09c7cb501, user_id=bc991221ef1c473eb86ca5e2ae799874, role_id=0c67797d444d4c929b2ccab47c468848)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:40.916204 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed886024-1388-4558-859c-1b6896d204b2 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:40.918847 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:40.933691 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1326/2654] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:52:40 2022] PUT /identity/v3/projects/3fb29c95adb947a88ef144f09c7cb501/users/bc991221ef1c473eb86ca5e2ae799874/roles/0c67797d444d4c929b2ccab47c468848 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:52:40.945038 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f16dc72-e51e-4588-8ead-6405769a9cf6 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:40.945351 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f16dc72-e51e-4588-8ead-6405769a9cf6 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:40.945644 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f16dc72-e51e-4588-8ead-6405769a9cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:40.954669 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:40.977115 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-1f16dc72-e51e-4588-8ead-6405769a9cf6 None None] MFA Rules not processed for user `bc991221ef1c473eb86ca5e2ae799874`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:40.978431 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-1f16dc72-e51e-4588-8ead-6405769a9cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:41.049586 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1329/2655] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:52:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:52:41.054032 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed886024-1388-4558-859c-1b6896d204b2 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:41.118431 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed886024-1388-4558-859c-1b6896d204b2 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:41.123712 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d13f45-a575-4940-b9df-fcd9cb064151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:41.124257 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d13f45-a575-4940-b9df-fcd9cb064151 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:41.124537 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d13f45-a575-4940-b9df-fcd9cb064151 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:41.124811 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d13f45-a575-4940-b9df-fcd9cb064151 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:41.125477 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d13f45-a575-4940-b9df-fcd9cb064151 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:41.127387 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d13f45-a575-4940-b9df-fcd9cb064151 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:41.154220 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1327/2656] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:52:41 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:52:41.158787 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f16dc72-e51e-4588-8ead-6405769a9cf6 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:41.172314 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f16dc72-e51e-4588-8ead-6405769a9cf6 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:41.231923 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f0b6c-eb9a-40cf-ab73-c84eb470e7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:41.232524 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f0b6c-eb9a-40cf-ab73-c84eb470e7f4 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:41.232798 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f0b6c-eb9a-40cf-ab73-c84eb470e7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:41.233065 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f0b6c-eb9a-40cf-ab73-c84eb470e7f4 admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:41.233720 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8f0b6c-eb9a-40cf-ab73-c84eb470e7f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:41.235632 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8f0b6c-eb9a-40cf-ab73-c84eb470e7f4 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:41.257678 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1330/2657] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:52:41 2022] POST /identity/v3/users => generated 295 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:52:41.262651 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d13f45-a575-4940-b9df-fcd9cb064151 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:41.272957 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d13f45-a575-4940-b9df-fcd9cb064151 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:41.277723 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb8bc2-e3fb-4f49-addc-ebb37f1c7b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:41.278330 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb8bc2-e3fb-4f49-addc-ebb37f1c7b61 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:41.278611 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb8bc2-e3fb-4f49-addc-ebb37f1c7b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:41.278888 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb8bc2-e3fb-4f49-addc-ebb37f1c7b61 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:41.279557 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cb8bc2-e3fb-4f49-addc-ebb37f1c7b61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:41.281433 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cb8bc2-e3fb-4f49-addc-ebb37f1c7b61 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:41.292290 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1328/2658] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:52:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:52:41.296574 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f0b6c-eb9a-40cf-ab73-c84eb470e7f4 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:41.307062 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f0b6c-eb9a-40cf-ab73-c84eb470e7f4 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:41.312506 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d24a2-62ff-41a6-b070-fbba72715f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:41.313162 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d24a2-62ff-41a6-b070-fbba72715f04 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:41.313587 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d24a2-62ff-41a6-b070-fbba72715f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:41.313863 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d24a2-62ff-41a6-b070-fbba72715f04 admin admin] PATH_INFO: `/v3/projects/f6f37073122f47f78460e7fdf40e173b/users/242fa3ae40014a9098ffe8fa19c3a272/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:41.330741 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5d24a2-62ff-41a6-b070-fbba72715f04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6f37073122f47f78460e7fdf40e173b, user_id=242fa3ae40014a9098ffe8fa19c3a272, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:41.333449 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5d24a2-62ff-41a6-b070-fbba72715f04 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:41.346598 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1331/2659] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:52:41 2022] PUT /identity/v3/projects/f6f37073122f47f78460e7fdf40e173b/users/242fa3ae40014a9098ffe8fa19c3a272/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:52:41.350711 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb8bc2-e3fb-4f49-addc-ebb37f1c7b61 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:41.361075 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb8bc2-e3fb-4f49-addc-ebb37f1c7b61 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:41.417709 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d15ef6-25c1-491c-813a-d4470e9c069a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:41.418237 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d15ef6-25c1-491c-813a-d4470e9c069a admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:41.418516 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d15ef6-25c1-491c-813a-d4470e9c069a admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:41.418783 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d15ef6-25c1-491c-813a-d4470e9c069a admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:41.419407 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d15ef6-25c1-491c-813a-d4470e9c069a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:41.421018 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d15ef6-25c1-491c-813a-d4470e9c069a admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:41.430707 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1329/2660] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:52:41 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:52:41.435478 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d24a2-62ff-41a6-b070-fbba72715f04 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:41.445845 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d24a2-62ff-41a6-b070-fbba72715f04 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:41.450771 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2945090a-3043-4eac-bcad-883718996c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:41.451407 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2945090a-3043-4eac-bcad-883718996c02 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:41.451686 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2945090a-3043-4eac-bcad-883718996c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:41.451955 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2945090a-3043-4eac-bcad-883718996c02 admin admin] PATH_INFO: `/v3/projects/f6f37073122f47f78460e7fdf40e173b/users/242fa3ae40014a9098ffe8fa19c3a272/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:41.453961 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2945090a-3043-4eac-bcad-883718996c02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6f37073122f47f78460e7fdf40e173b, user_id=242fa3ae40014a9098ffe8fa19c3a272, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:41.456628 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2945090a-3043-4eac-bcad-883718996c02 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:41.466977 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1332/2661] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:52:41 2022] PUT /identity/v3/projects/f6f37073122f47f78460e7fdf40e173b/users/242fa3ae40014a9098ffe8fa19c3a272/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:52:41.477002 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c265dc31-e43c-4e3d-8381-4b1f950acddd None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:41.477299 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c265dc31-e43c-4e3d-8381-4b1f950acddd None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:41.477611 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c265dc31-e43c-4e3d-8381-4b1f950acddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:41.507320 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-c265dc31-e43c-4e3d-8381-4b1f950acddd None None] MFA Rules not processed for user `242fa3ae40014a9098ffe8fa19c3a272`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:41.508561 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-c265dc31-e43c-4e3d-8381-4b1f950acddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:41.570427 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:41.593427 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1330/2662] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:52:41 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:52:41.606062 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2945090a-3043-4eac-bcad-883718996c02 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:41.659303 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c265dc31-e43c-4e3d-8381-4b1f950acddd None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:41.660760 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-c265dc31-e43c-4e3d-8381-4b1f950acddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:41.663787 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:41.671040 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2945090a-3043-4eac-bcad-883718996c02 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:41.674928 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb293ecb-05f8-4357-a41b-9fd8048d0962 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:41.675538 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb293ecb-05f8-4357-a41b-9fd8048d0962 service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:41.675847 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb293ecb-05f8-4357-a41b-9fd8048d0962 service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:41.676120 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb293ecb-05f8-4357-a41b-9fd8048d0962 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:41.686092 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb293ecb-05f8-4357-a41b-9fd8048d0962 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:41.687730 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb293ecb-05f8-4357-a41b-9fd8048d0962 service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:41.697250 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1333/2663] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:52:41 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:52:41.732161 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c265dc31-e43c-4e3d-8381-4b1f950acddd None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:41.738773 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a6e16-ed43-4b8e-bc3d-12a0ea5d8bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:41.739449 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a6e16-ed43-4b8e-bc3d-12a0ea5d8bf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:41.739733 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a6e16-ed43-4b8e-bc3d-12a0ea5d8bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:41.740009 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a6e16-ed43-4b8e-bc3d-12a0ea5d8bf3 admin admin] PATH_INFO: `/v3/users/f93d3fedb819423394be400e98eb0d60` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:41.741432 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540a6e16-ed43-4b8e-bc3d-12a0ea5d8bf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f93d3fedb819423394be400e98eb0d60)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:41.741574 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb293ecb-05f8-4357-a41b-9fd8048d0962 service cinder] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:41.743013 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-fb293ecb-05f8-4357-a41b-9fd8048d0962 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:41.743435 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540a6e16-ed43-4b8e-bc3d-12a0ea5d8bf3 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:41.755332 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb293ecb-05f8-4357-a41b-9fd8048d0962 service cinder] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:41.759038 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74205a4a-e436-488d-8447-36cea3813424 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:41.759637 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74205a4a-e436-488d-8447-36cea3813424 service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:41.759917 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74205a4a-e436-488d-8447-36cea3813424 service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:41.760184 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74205a4a-e436-488d-8447-36cea3813424 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:41.798858 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-540a6e16-ed43-4b8e-bc3d-12a0ea5d8bf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f93d3fedb819423394be400e98eb0d60'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:41.811106 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-540a6e16-ed43-4b8e-bc3d-12a0ea5d8bf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f93d3fedb819423394be400e98eb0d60'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:41.811975 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-540a6e16-ed43-4b8e-bc3d-12a0ea5d8bf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f93d3fedb819423394be400e98eb0d60'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:41.825204 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-540a6e16-ed43-4b8e-bc3d-12a0ea5d8bf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f93d3fedb819423394be400e98eb0d60'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:41.826330 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74205a4a-e436-488d-8447-36cea3813424 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:41.827794 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74205a4a-e436-488d-8447-36cea3813424 service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:41.834502 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-540a6e16-ed43-4b8e-bc3d-12a0ea5d8bf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f93d3fedb819423394be400e98eb0d60'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:41.838225 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1334/2664] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:52:41 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:52:41.841623 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1331/2665] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:52:41 2022] DELETE /identity/v3/users/f93d3fedb819423394be400e98eb0d60 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:52:41.846807 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5269196-2d3a-41c6-ad72-f411e5cff852 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:41.847086 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5269196-2d3a-41c6-ad72-f411e5cff852 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:41.847380 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5269196-2d3a-41c6-ad72-f411e5cff852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:41.871354 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-b5269196-2d3a-41c6-ad72-f411e5cff852 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:41.872557 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-b5269196-2d3a-41c6-ad72-f411e5cff852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:41.939591 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1335/2666] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:52:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:52:41.949925 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a6e16-ed43-4b8e-bc3d-12a0ea5d8bf3 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:41.951382 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-540a6e16-ed43-4b8e-bc3d-12a0ea5d8bf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:42.015525 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a6e16-ed43-4b8e-bc3d-12a0ea5d8bf3 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:42.019482 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5314a416-94c2-415a-9d95-f295a640b205 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:42.020172 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5314a416-94c2-415a-9d95-f295a640b205 service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:42.020527 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5314a416-94c2-415a-9d95-f295a640b205 service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:42.020874 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5314a416-94c2-415a-9d95-f295a640b205 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:42.033521 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5314a416-94c2-415a-9d95-f295a640b205 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:42.035281 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5314a416-94c2-415a-9d95-f295a640b205 service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:42.049225 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1332/2667] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:52:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:52:42.383029 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5269196-2d3a-41c6-ad72-f411e5cff852 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:42.384375 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-b5269196-2d3a-41c6-ad72-f411e5cff852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:42.397828 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5269196-2d3a-41c6-ad72-f411e5cff852 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:42.403696 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59e8fe3-2fbc-4632-ba6d-4d82879aedfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:42.404396 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e8fe3-2fbc-4632-ba6d-4d82879aedfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:42.404754 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e8fe3-2fbc-4632-ba6d-4d82879aedfa admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:42.404957 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e8fe3-2fbc-4632-ba6d-4d82879aedfa admin admin] PATH_INFO: `/v3/projects/9ebd6705b79140df8e54314aee9ea96d` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:42.406386 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59e8fe3-2fbc-4632-ba6d-4d82879aedfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ebd6705b79140df8e54314aee9ea96d)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:42.408292 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59e8fe3-2fbc-4632-ba6d-4d82879aedfa admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:42.456821 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-b59e8fe3-2fbc-4632-ba6d-4d82879aedfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ebd6705b79140df8e54314aee9ea96d', 'request_id': 'req-b59e8fe3-2fbc-4632-ba6d-4d82879aedfa'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:42.462971 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-b59e8fe3-2fbc-4632-ba6d-4d82879aedfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ebd6705b79140df8e54314aee9ea96d', 'request_id': 'req-b59e8fe3-2fbc-4632-ba6d-4d82879aedfa'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:42.469660 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-b59e8fe3-2fbc-4632-ba6d-4d82879aedfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ebd6705b79140df8e54314aee9ea96d', 'request_id': 'req-b59e8fe3-2fbc-4632-ba6d-4d82879aedfa'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:42.483839 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-b59e8fe3-2fbc-4632-ba6d-4d82879aedfa admin admin] The token cache is being invalidate because project 9ebd6705b79140df8e54314aee9ea96d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:52:42.484131 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-b59e8fe3-2fbc-4632-ba6d-4d82879aedfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:42.484778 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-b59e8fe3-2fbc-4632-ba6d-4d82879aedfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:42.486300 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1336/2668] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:52:42 2022] DELETE /identity/v3/projects/9ebd6705b79140df8e54314aee9ea96d => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:52:42.491332 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b0e29-7408-49a1-a0e7-620d35e54628 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:42.491811 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b0e29-7408-49a1-a0e7-620d35e54628 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:42.491906 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b0e29-7408-49a1-a0e7-620d35e54628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:42.511268 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-f08b0e29-7408-49a1-a0e7-620d35e54628 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:42.512488 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-f08b0e29-7408-49a1-a0e7-620d35e54628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:42.518218 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:42.579496 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1333/2669] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:52:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:52:42.587274 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c5da0-3ac1-4192-ad8b-824574d175ab None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:42.587560 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c5da0-3ac1-4192-ad8b-824574d175ab None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:42.587836 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c5da0-3ac1-4192-ad8b-824574d175ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:42.608854 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-559c5da0-3ac1-4192-ad8b-824574d175ab None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:42.610103 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-559c5da0-3ac1-4192-ad8b-824574d175ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:42.619096 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1337/2670] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:52:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:52:42.625245 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b0e29-7408-49a1-a0e7-620d35e54628 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:42.634950 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b0e29-7408-49a1-a0e7-620d35e54628 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:42.640211 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf79b6d-e990-4e03-a955-6a72b029278e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:42.640815 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf79b6d-e990-4e03-a955-6a72b029278e admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:42.641095 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf79b6d-e990-4e03-a955-6a72b029278e admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:42.641394 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf79b6d-e990-4e03-a955-6a72b029278e admin admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:42.642042 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf79b6d-e990-4e03-a955-6a72b029278e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:52:42.642342 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf79b6d-e990-4e03-a955-6a72b029278e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:42.643940 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf79b6d-e990-4e03-a955-6a72b029278e admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:42.656562 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1334/2671] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Aug 29 22:52:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:52:42.660871 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c5da0-3ac1-4192-ad8b-824574d175ab None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:42.667358 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:42.672161 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c5da0-3ac1-4192-ad8b-824574d175ab None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:42.678406 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56890e42-eeb4-4ac0-bfcb-e5d03ab40fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:42.679232 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56890e42-eeb4-4ac0-bfcb-e5d03ab40fc4 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:42.679672 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56890e42-eeb4-4ac0-bfcb-e5d03ab40fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:42.679993 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56890e42-eeb4-4ac0-bfcb-e5d03ab40fc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:42.680832 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56890e42-eeb4-4ac0-bfcb-e5d03ab40fc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:42.682818 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56890e42-eeb4-4ac0-bfcb-e5d03ab40fc4 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:42.712771 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1338/2672] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:52:42 2022] POST /identity/v3/projects => generated 367 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:52:42.717895 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf79b6d-e990-4e03-a955-6a72b029278e admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:42.728134 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf79b6d-e990-4e03-a955-6a72b029278e admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:42.786040 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5166b954-e4d0-4d70-9a33-0e9551b1b02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:42.786661 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166b954-e4d0-4d70-9a33-0e9551b1b02e admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:42.786942 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166b954-e4d0-4d70-9a33-0e9551b1b02e admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:42.787220 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166b954-e4d0-4d70-9a33-0e9551b1b02e admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:42.787868 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5166b954-e4d0-4d70-9a33-0e9551b1b02e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:42.789809 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5166b954-e4d0-4d70-9a33-0e9551b1b02e admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:42.811360 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1335/2673] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:52:42 2022] POST /identity/v3/users => generated 284 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:52:42.815694 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56890e42-eeb4-4ac0-bfcb-e5d03ab40fc4 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:42.826557 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56890e42-eeb4-4ac0-bfcb-e5d03ab40fc4 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:42.831106 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cc86b9-affe-491e-a768-992d0f8ccde1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:42.831695 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc86b9-affe-491e-a768-992d0f8ccde1 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:42.831969 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc86b9-affe-491e-a768-992d0f8ccde1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:42.832235 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc86b9-affe-491e-a768-992d0f8ccde1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:42.832872 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cc86b9-affe-491e-a768-992d0f8ccde1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:42.834484 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cc86b9-affe-491e-a768-992d0f8ccde1 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:42.844992 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1339/2674] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:52:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:52:42.849053 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5166b954-e4d0-4d70-9a33-0e9551b1b02e admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:42.859784 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5166b954-e4d0-4d70-9a33-0e9551b1b02e admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:42.864486 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed384b20-074c-4d0c-b87b-dc6352e52371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:42.865084 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed384b20-074c-4d0c-b87b-dc6352e52371 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:42.865397 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed384b20-074c-4d0c-b87b-dc6352e52371 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:42.865682 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed384b20-074c-4d0c-b87b-dc6352e52371 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:42.866330 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed384b20-074c-4d0c-b87b-dc6352e52371 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:42.868165 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed384b20-074c-4d0c-b87b-dc6352e52371 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:42.879038 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1336/2675] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:52:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:52:42.883116 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cc86b9-affe-491e-a768-992d0f8ccde1 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:42.893651 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cc86b9-affe-491e-a768-992d0f8ccde1 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:42.898195 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76de2784-90bc-4ed9-8112-ad828e2d86d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:42.898827 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de2784-90bc-4ed9-8112-ad828e2d86d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:42.899102 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de2784-90bc-4ed9-8112-ad828e2d86d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:42.899369 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de2784-90bc-4ed9-8112-ad828e2d86d7 admin admin] PATH_INFO: `/v3/projects/4079da906c9d4b799fc63d1ebda8b450/users/0d5b6b756a2e4482ba994ebc9f2800c1/roles/0c67797d444d4c929b2ccab47c468848` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:42.914852 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76de2784-90bc-4ed9-8112-ad828e2d86d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4079da906c9d4b799fc63d1ebda8b450, user_id=0d5b6b756a2e4482ba994ebc9f2800c1, role_id=0c67797d444d4c929b2ccab47c468848)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:42.917525 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76de2784-90bc-4ed9-8112-ad828e2d86d7 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:42.930430 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1340/2676] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:52:42 2022] PUT /identity/v3/projects/4079da906c9d4b799fc63d1ebda8b450/users/0d5b6b756a2e4482ba994ebc9f2800c1/roles/0c67797d444d4c929b2ccab47c468848 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:52:42.940519 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91465a2-8b94-4713-a36f-6aa2baff69dd None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:42.940811 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91465a2-8b94-4713-a36f-6aa2baff69dd None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:42.941117 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91465a2-8b94-4713-a36f-6aa2baff69dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:42.970197 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-b91465a2-8b94-4713-a36f-6aa2baff69dd None None] MFA Rules not processed for user `0d5b6b756a2e4482ba994ebc9f2800c1`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:42.971363 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-b91465a2-8b94-4713-a36f-6aa2baff69dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:43.037693 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1337/2677] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:52:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:52:43.050537 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76de2784-90bc-4ed9-8112-ad828e2d86d7 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:43.052686 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-76de2784-90bc-4ed9-8112-ad828e2d86d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:43.116232 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76de2784-90bc-4ed9-8112-ad828e2d86d7 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:43.120970 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344cbde1-d645-4aea-bd0e-05e3e16dc99e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:43.121609 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344cbde1-d645-4aea-bd0e-05e3e16dc99e service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:43.121918 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344cbde1-d645-4aea-bd0e-05e3e16dc99e service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:43.122191 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344cbde1-d645-4aea-bd0e-05e3e16dc99e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:43.130906 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344cbde1-d645-4aea-bd0e-05e3e16dc99e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:43.132336 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344cbde1-d645-4aea-bd0e-05e3e16dc99e service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:43.141200 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1341/2678] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:52:43 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:52:44.914901 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91465a2-8b94-4713-a36f-6aa2baff69dd None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:44.916383 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-b91465a2-8b94-4713-a36f-6aa2baff69dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:44.926820 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:44.931970 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344cbde1-d645-4aea-bd0e-05e3e16dc99e service cinder] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:44.933586 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-344cbde1-d645-4aea-bd0e-05e3e16dc99e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:44.987826 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91465a2-8b94-4713-a36f-6aa2baff69dd None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:44.992355 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932b8198-ce89-4c67-b063-ee7aa156bb69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:44.992984 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b8198-ce89-4c67-b063-ee7aa156bb69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:44.993263 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b8198-ce89-4c67-b063-ee7aa156bb69 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:44.993570 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b8198-ce89-4c67-b063-ee7aa156bb69 admin admin] PATH_INFO: `/v3/users/f541b432baee4a0387ca8565a8d11362` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:44.994831 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932b8198-ce89-4c67-b063-ee7aa156bb69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f541b432baee4a0387ca8565a8d11362)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:44.996784 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932b8198-ce89-4c67-b063-ee7aa156bb69 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:45.001980 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344cbde1-d645-4aea-bd0e-05e3e16dc99e service cinder] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:45.006520 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c28b7e-4dfe-402f-8d39-39aba3c1ff77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:45.007143 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c28b7e-4dfe-402f-8d39-39aba3c1ff77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:45.007421 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c28b7e-4dfe-402f-8d39-39aba3c1ff77 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:45.007693 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c28b7e-4dfe-402f-8d39-39aba3c1ff77 admin admin] PATH_INFO: `/v3/users/f893d5c330644bd98c7c635c24e60984` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:45.008972 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c28b7e-4dfe-402f-8d39-39aba3c1ff77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f893d5c330644bd98c7c635c24e60984)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:45.010989 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c28b7e-4dfe-402f-8d39-39aba3c1ff77 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:45.046415 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-932b8198-ce89-4c67-b063-ee7aa156bb69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f541b432baee4a0387ca8565a8d11362'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:45.053716 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-932b8198-ce89-4c67-b063-ee7aa156bb69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f541b432baee4a0387ca8565a8d11362'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:45.054422 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-932b8198-ce89-4c67-b063-ee7aa156bb69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f541b432baee4a0387ca8565a8d11362'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:45.062057 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-c5c28b7e-4dfe-402f-8d39-39aba3c1ff77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f893d5c330644bd98c7c635c24e60984'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:45.067523 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-932b8198-ce89-4c67-b063-ee7aa156bb69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f541b432baee4a0387ca8565a8d11362'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:45.067663 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:45.070777 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-c5c28b7e-4dfe-402f-8d39-39aba3c1ff77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f893d5c330644bd98c7c635c24e60984'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:45.071592 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-c5c28b7e-4dfe-402f-8d39-39aba3c1ff77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f893d5c330644bd98c7c635c24e60984'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:45.076228 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-932b8198-ce89-4c67-b063-ee7aa156bb69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f541b432baee4a0387ca8565a8d11362'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:45.082102 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-c5c28b7e-4dfe-402f-8d39-39aba3c1ff77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f893d5c330644bd98c7c635c24e60984'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:45.083826 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-c5c28b7e-4dfe-402f-8d39-39aba3c1ff77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f893d5c330644bd98c7c635c24e60984'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:45.083985 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1338/2679] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:52:44 2022] DELETE /identity/v3/users/f541b432baee4a0387ca8565a8d11362 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:52:45.088228 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad347a2-f268-43fa-92b1-de86e1a27e8b None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:45.088516 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad347a2-f268-43fa-92b1-de86e1a27e8b None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:45.088935 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad347a2-f268-43fa-92b1-de86e1a27e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:45.102504 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1342/2680] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:52:44 2022] DELETE /identity/v3/users/f893d5c330644bd98c7c635c24e60984 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:52:45.108261 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24806c5-5a30-4f11-98b4-a5443d601acd None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:45.108626 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24806c5-5a30-4f11-98b4-a5443d601acd None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:45.108990 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24806c5-5a30-4f11-98b4-a5443d601acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:45.110242 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-4ad347a2-f268-43fa-92b1-de86e1a27e8b None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:45.111476 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-4ad347a2-f268-43fa-92b1-de86e1a27e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:45.130253 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-a24806c5-5a30-4f11-98b4-a5443d601acd None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:45.131496 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-a24806c5-5a30-4f11-98b4-a5443d601acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:45.195432 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1343/2681] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:52:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:52:45.207679 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24806c5-5a30-4f11-98b4-a5443d601acd None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:45.209157 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-a24806c5-5a30-4f11-98b4-a5443d601acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:45.272208 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24806c5-5a30-4f11-98b4-a5443d601acd None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:45.275952 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e00a0-cb03-48bc-8e5d-d9f26ea8225b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:45.277314 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e00a0-cb03-48bc-8e5d-d9f26ea8225b service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:45.277658 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e00a0-cb03-48bc-8e5d-d9f26ea8225b service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:45.277898 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e00a0-cb03-48bc-8e5d-d9f26ea8225b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:45.287823 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4e00a0-cb03-48bc-8e5d-d9f26ea8225b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:45.289307 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4e00a0-cb03-48bc-8e5d-d9f26ea8225b service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:45.299716 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1344/2682] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:52:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:52:45.300775 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1339/2683] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:52:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:52:45.310533 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e00a0-cb03-48bc-8e5d-d9f26ea8225b service neutron] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:45.312021 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-de4e00a0-cb03-48bc-8e5d-d9f26ea8225b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:45.324062 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e00a0-cb03-48bc-8e5d-d9f26ea8225b service neutron] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:45.328475 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cf0590-9643-4c23-b66c-622a9242c82a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:45.329080 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf0590-9643-4c23-b66c-622a9242c82a service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:45.329379 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf0590-9643-4c23-b66c-622a9242c82a service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:45.329660 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf0590-9643-4c23-b66c-622a9242c82a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:45.340007 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cf0590-9643-4c23-b66c-622a9242c82a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:45.341606 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cf0590-9643-4c23-b66c-622a9242c82a service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:45.351531 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1345/2684] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:52:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:52:45.650385 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad347a2-f268-43fa-92b1-de86e1a27e8b None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:45.653698 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-4ad347a2-f268-43fa-92b1-de86e1a27e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:45.673783 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad347a2-f268-43fa-92b1-de86e1a27e8b None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:45.678631 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc58f6-f847-4fee-98eb-2502f18298aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:45.679285 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc58f6-f847-4fee-98eb-2502f18298aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:45.679561 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc58f6-f847-4fee-98eb-2502f18298aa admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:45.679876 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc58f6-f847-4fee-98eb-2502f18298aa admin admin] PATH_INFO: `/v3/projects/28322d40404c47dfaeea1b0d83499e04` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:45.680977 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cc58f6-f847-4fee-98eb-2502f18298aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=28322d40404c47dfaeea1b0d83499e04)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:45.683909 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cc58f6-f847-4fee-98eb-2502f18298aa admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:45.709243 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:45.739173 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-41cc58f6-f847-4fee-98eb-2502f18298aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28322d40404c47dfaeea1b0d83499e04', 'request_id': 'req-41cc58f6-f847-4fee-98eb-2502f18298aa'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:45.744714 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-41cc58f6-f847-4fee-98eb-2502f18298aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28322d40404c47dfaeea1b0d83499e04', 'request_id': 'req-41cc58f6-f847-4fee-98eb-2502f18298aa'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:45.751407 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-41cc58f6-f847-4fee-98eb-2502f18298aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28322d40404c47dfaeea1b0d83499e04', 'request_id': 'req-41cc58f6-f847-4fee-98eb-2502f18298aa'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:45.767082 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-41cc58f6-f847-4fee-98eb-2502f18298aa admin admin] The token cache is being invalidate because project 28322d40404c47dfaeea1b0d83499e04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:52:45.767364 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-41cc58f6-f847-4fee-98eb-2502f18298aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:45.768163 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-41cc58f6-f847-4fee-98eb-2502f18298aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:45.769814 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1340/2685] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:52:45 2022] DELETE /identity/v3/projects/28322d40404c47dfaeea1b0d83499e04 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:52:45.773967 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cf0590-9643-4c23-b66c-622a9242c82a service neutron] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:45.784739 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cf0590-9643-4c23-b66c-622a9242c82a service neutron] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:45.835037 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc58f6-f847-4fee-98eb-2502f18298aa admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:45.836549 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-41cc58f6-f847-4fee-98eb-2502f18298aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:45.851227 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6152a0-1f44-46df-b16a-7b2795f60210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:45.851875 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6152a0-1f44-46df-b16a-7b2795f60210 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:45.852157 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6152a0-1f44-46df-b16a-7b2795f60210 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:45.852464 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6152a0-1f44-46df-b16a-7b2795f60210 admin admin] PATH_INFO: `/v3/users/bc991221ef1c473eb86ca5e2ae799874` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:45.853638 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6152a0-1f44-46df-b16a-7b2795f60210 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc991221ef1c473eb86ca5e2ae799874)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:45.855698 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6152a0-1f44-46df-b16a-7b2795f60210 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:45.857434 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:45.916942 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-bd6152a0-1f44-46df-b16a-7b2795f60210 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc991221ef1c473eb86ca5e2ae799874'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:45.928130 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-bd6152a0-1f44-46df-b16a-7b2795f60210 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc991221ef1c473eb86ca5e2ae799874'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:45.928909 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-bd6152a0-1f44-46df-b16a-7b2795f60210 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc991221ef1c473eb86ca5e2ae799874'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:45.930062 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc58f6-f847-4fee-98eb-2502f18298aa admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:45.935376 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a58bbe4-6e17-418d-8ee9-b8564965393f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:45.936022 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58bbe4-6e17-418d-8ee9-b8564965393f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:45.936294 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58bbe4-6e17-418d-8ee9-b8564965393f admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:45.936565 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58bbe4-6e17-418d-8ee9-b8564965393f admin admin] PATH_INFO: `/v3/projects/43397754a872483eb439962cb6f9530e` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:45.937870 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a58bbe4-6e17-418d-8ee9-b8564965393f admin admin] RBAC: Authorizing `identity:delete_project(project_id=43397754a872483eb439962cb6f9530e)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:45.939391 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-bd6152a0-1f44-46df-b16a-7b2795f60210 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc991221ef1c473eb86ca5e2ae799874'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:45.939841 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a58bbe4-6e17-418d-8ee9-b8564965393f admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:45.940775 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-bd6152a0-1f44-46df-b16a-7b2795f60210 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc991221ef1c473eb86ca5e2ae799874'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:45.964884 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1346/2686] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:52:45 2022] DELETE /identity/v3/users/bc991221ef1c473eb86ca5e2ae799874 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:52:46.002389 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-5a58bbe4-6e17-418d-8ee9-b8564965393f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43397754a872483eb439962cb6f9530e', 'request_id': 'req-5a58bbe4-6e17-418d-8ee9-b8564965393f'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:46.012221 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-5a58bbe4-6e17-418d-8ee9-b8564965393f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43397754a872483eb439962cb6f9530e', 'request_id': 'req-5a58bbe4-6e17-418d-8ee9-b8564965393f'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:46.019348 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-5a58bbe4-6e17-418d-8ee9-b8564965393f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43397754a872483eb439962cb6f9530e', 'request_id': 'req-5a58bbe4-6e17-418d-8ee9-b8564965393f'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:46.036207 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-5a58bbe4-6e17-418d-8ee9-b8564965393f admin admin] The token cache is being invalidate because project 43397754a872483eb439962cb6f9530e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:52:46.036466 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-5a58bbe4-6e17-418d-8ee9-b8564965393f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:46.037394 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-5a58bbe4-6e17-418d-8ee9-b8564965393f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:46.039926 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1341/2687] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:52:45 2022] DELETE /identity/v3/projects/43397754a872483eb439962cb6f9530e => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:52:46.043645 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6152a0-1f44-46df-b16a-7b2795f60210 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:46.045142 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-bd6152a0-1f44-46df-b16a-7b2795f60210 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:46.121879 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6152a0-1f44-46df-b16a-7b2795f60210 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:46.192536 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d289b2-dff1-44b7-8089-002c8b06c982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:46.193531 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d289b2-dff1-44b7-8089-002c8b06c982 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:46.194004 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d289b2-dff1-44b7-8089-002c8b06c982 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:46.194392 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d289b2-dff1-44b7-8089-002c8b06c982 admin admin] PATH_INFO: `/v3/users/f98f4355a733431b9b3fdcd4625d2c16` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:46.195746 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d289b2-dff1-44b7-8089-002c8b06c982 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f98f4355a733431b9b3fdcd4625d2c16)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:46.198769 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d289b2-dff1-44b7-8089-002c8b06c982 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:46.236784 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:46.276655 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-49d289b2-dff1-44b7-8089-002c8b06c982 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f98f4355a733431b9b3fdcd4625d2c16'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:46.293391 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-49d289b2-dff1-44b7-8089-002c8b06c982 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f98f4355a733431b9b3fdcd4625d2c16'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:46.294441 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-49d289b2-dff1-44b7-8089-002c8b06c982 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f98f4355a733431b9b3fdcd4625d2c16'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:46.309351 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-49d289b2-dff1-44b7-8089-002c8b06c982 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f98f4355a733431b9b3fdcd4625d2c16'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:46.310066 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-49d289b2-dff1-44b7-8089-002c8b06c982 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f98f4355a733431b9b3fdcd4625d2c16'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:46.314416 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a58bbe4-6e17-418d-8ee9-b8564965393f admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:46.315911 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-5a58bbe4-6e17-418d-8ee9-b8564965393f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:46.332750 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a58bbe4-6e17-418d-8ee9-b8564965393f admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:46.343344 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1347/2688] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:52:46 2022] DELETE /identity/v3/users/f98f4355a733431b9b3fdcd4625d2c16 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:52:46.391489 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:46.415250 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a3b6e-4645-4f5c-aa41-9b8474056159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:46.415903 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a3b6e-4645-4f5c-aa41-9b8474056159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:46.416185 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a3b6e-4645-4f5c-aa41-9b8474056159 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:46.416456 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a3b6e-4645-4f5c-aa41-9b8474056159 admin admin] PATH_INFO: `/v3/projects/3fb29c95adb947a88ef144f09c7cb501` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:46.418746 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24a3b6e-4645-4f5c-aa41-9b8474056159 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fb29c95adb947a88ef144f09c7cb501)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:46.420773 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24a3b6e-4645-4f5c-aa41-9b8474056159 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:46.470227 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-b24a3b6e-4645-4f5c-aa41-9b8474056159 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fb29c95adb947a88ef144f09c7cb501', 'request_id': 'req-b24a3b6e-4645-4f5c-aa41-9b8474056159'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:46.476778 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-b24a3b6e-4645-4f5c-aa41-9b8474056159 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fb29c95adb947a88ef144f09c7cb501', 'request_id': 'req-b24a3b6e-4645-4f5c-aa41-9b8474056159'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:46.483064 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-b24a3b6e-4645-4f5c-aa41-9b8474056159 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fb29c95adb947a88ef144f09c7cb501', 'request_id': 'req-b24a3b6e-4645-4f5c-aa41-9b8474056159'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:46.498881 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-b24a3b6e-4645-4f5c-aa41-9b8474056159 admin admin] The token cache is being invalidate because project 3fb29c95adb947a88ef144f09c7cb501 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:52:46.499178 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-b24a3b6e-4645-4f5c-aa41-9b8474056159 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:46.500132 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-b24a3b6e-4645-4f5c-aa41-9b8474056159 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:46.501887 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1342/2689] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:52:46 2022] DELETE /identity/v3/projects/3fb29c95adb947a88ef144f09c7cb501 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:52:46.505969 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d289b2-dff1-44b7-8089-002c8b06c982 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:46.508378 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-49d289b2-dff1-44b7-8089-002c8b06c982 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:46.523563 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d289b2-dff1-44b7-8089-002c8b06c982 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:46.589142 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373dce00-5174-4f5d-b575-4a3fb9e73dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:46.589845 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373dce00-5174-4f5d-b575-4a3fb9e73dea admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:46.590129 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373dce00-5174-4f5d-b575-4a3fb9e73dea admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:46.590403 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373dce00-5174-4f5d-b575-4a3fb9e73dea admin admin] PATH_INFO: `/v3/users/242fa3ae40014a9098ffe8fa19c3a272` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:46.591564 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373dce00-5174-4f5d-b575-4a3fb9e73dea admin admin] RBAC: Authorizing `identity:delete_user(user_id=242fa3ae40014a9098ffe8fa19c3a272)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:46.593548 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373dce00-5174-4f5d-b575-4a3fb9e73dea admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:46.636404 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a3b6e-4645-4f5c-aa41-9b8474056159 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:46.638021 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-b24a3b6e-4645-4f5c-aa41-9b8474056159 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:46.645996 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-373dce00-5174-4f5d-b575-4a3fb9e73dea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '242fa3ae40014a9098ffe8fa19c3a272'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:46.654823 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-373dce00-5174-4f5d-b575-4a3fb9e73dea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '242fa3ae40014a9098ffe8fa19c3a272'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:46.655818 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-373dce00-5174-4f5d-b575-4a3fb9e73dea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '242fa3ae40014a9098ffe8fa19c3a272'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:46.662743 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a3b6e-4645-4f5c-aa41-9b8474056159 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:46.666422 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-373dce00-5174-4f5d-b575-4a3fb9e73dea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '242fa3ae40014a9098ffe8fa19c3a272'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:46.667754 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-373dce00-5174-4f5d-b575-4a3fb9e73dea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '242fa3ae40014a9098ffe8fa19c3a272'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:46.668558 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed09cf1f-72f6-4047-87b7-191e48c138cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:46.669288 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09cf1f-72f6-4047-87b7-191e48c138cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:46.669624 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09cf1f-72f6-4047-87b7-191e48c138cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:46.669867 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09cf1f-72f6-4047-87b7-191e48c138cb admin admin] PATH_INFO: `/v3/projects/6433a970ce364a3397531364780ccbb3` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:46.671060 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed09cf1f-72f6-4047-87b7-191e48c138cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=6433a970ce364a3397531364780ccbb3)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:46.672985 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed09cf1f-72f6-4047-87b7-191e48c138cb admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:46.691698 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1348/2690] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:52:46 2022] DELETE /identity/v3/users/242fa3ae40014a9098ffe8fa19c3a272 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:52:46.723056 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-ed09cf1f-72f6-4047-87b7-191e48c138cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6433a970ce364a3397531364780ccbb3', 'request_id': 'req-ed09cf1f-72f6-4047-87b7-191e48c138cb'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:46.730602 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-ed09cf1f-72f6-4047-87b7-191e48c138cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6433a970ce364a3397531364780ccbb3', 'request_id': 'req-ed09cf1f-72f6-4047-87b7-191e48c138cb'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:46.737215 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-ed09cf1f-72f6-4047-87b7-191e48c138cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6433a970ce364a3397531364780ccbb3', 'request_id': 'req-ed09cf1f-72f6-4047-87b7-191e48c138cb'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:46.754115 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-ed09cf1f-72f6-4047-87b7-191e48c138cb admin admin] The token cache is being invalidate because project 6433a970ce364a3397531364780ccbb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:52:46.754395 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-ed09cf1f-72f6-4047-87b7-191e48c138cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:46.755076 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-ed09cf1f-72f6-4047-87b7-191e48c138cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:46.756810 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1343/2691] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:52:46 2022] DELETE /identity/v3/projects/6433a970ce364a3397531364780ccbb3 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:52:46.761488 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373dce00-5174-4f5d-b575-4a3fb9e73dea admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:46.762977 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-373dce00-5174-4f5d-b575-4a3fb9e73dea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:46.794113 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:46.837744 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373dce00-5174-4f5d-b575-4a3fb9e73dea admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:46.897066 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d68fc0b-0df8-4a3d-96bc-664ed1fabbd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:46.897826 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68fc0b-0df8-4a3d-96bc-664ed1fabbd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:46.898108 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68fc0b-0df8-4a3d-96bc-664ed1fabbd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:46.898382 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68fc0b-0df8-4a3d-96bc-664ed1fabbd8 admin admin] PATH_INFO: `/v3/users/70d08c04e09a4efeb56cd535fbb292ff` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:46.899513 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d68fc0b-0df8-4a3d-96bc-664ed1fabbd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70d08c04e09a4efeb56cd535fbb292ff)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:46.902222 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d68fc0b-0df8-4a3d-96bc-664ed1fabbd8 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:46.955351 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-5d68fc0b-0df8-4a3d-96bc-664ed1fabbd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70d08c04e09a4efeb56cd535fbb292ff'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:46.963141 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-5d68fc0b-0df8-4a3d-96bc-664ed1fabbd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70d08c04e09a4efeb56cd535fbb292ff'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:46.963917 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-5d68fc0b-0df8-4a3d-96bc-664ed1fabbd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70d08c04e09a4efeb56cd535fbb292ff'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:46.972279 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-5d68fc0b-0df8-4a3d-96bc-664ed1fabbd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70d08c04e09a4efeb56cd535fbb292ff'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:46.972932 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-5d68fc0b-0df8-4a3d-96bc-664ed1fabbd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70d08c04e09a4efeb56cd535fbb292ff'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:46.995987 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1349/2692] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:52:46 2022] DELETE /identity/v3/users/70d08c04e09a4efeb56cd535fbb292ff => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:52:46.997145 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed09cf1f-72f6-4047-87b7-191e48c138cb admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:46.998803 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-ed09cf1f-72f6-4047-87b7-191e48c138cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:47.014808 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed09cf1f-72f6-4047-87b7-191e48c138cb admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:47.070499 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:47.084727 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8086d9c7-3cf1-4d7d-b021-1ec6a627f115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:47.087460 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086d9c7-3cf1-4d7d-b021-1ec6a627f115 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:47.087460 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086d9c7-3cf1-4d7d-b021-1ec6a627f115 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:47.087460 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086d9c7-3cf1-4d7d-b021-1ec6a627f115 admin admin] PATH_INFO: `/v3/projects/f6f37073122f47f78460e7fdf40e173b` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:47.088146 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8086d9c7-3cf1-4d7d-b021-1ec6a627f115 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6f37073122f47f78460e7fdf40e173b)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:47.090352 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8086d9c7-3cf1-4d7d-b021-1ec6a627f115 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:47.142296 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-8086d9c7-3cf1-4d7d-b021-1ec6a627f115 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6f37073122f47f78460e7fdf40e173b', 'request_id': 'req-8086d9c7-3cf1-4d7d-b021-1ec6a627f115'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:47.149603 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-8086d9c7-3cf1-4d7d-b021-1ec6a627f115 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6f37073122f47f78460e7fdf40e173b', 'request_id': 'req-8086d9c7-3cf1-4d7d-b021-1ec6a627f115'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:47.156272 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-8086d9c7-3cf1-4d7d-b021-1ec6a627f115 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6f37073122f47f78460e7fdf40e173b', 'request_id': 'req-8086d9c7-3cf1-4d7d-b021-1ec6a627f115'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:47.171697 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-8086d9c7-3cf1-4d7d-b021-1ec6a627f115 admin admin] The token cache is being invalidate because project f6f37073122f47f78460e7fdf40e173b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:52:47.172139 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-8086d9c7-3cf1-4d7d-b021-1ec6a627f115 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:47.172817 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-8086d9c7-3cf1-4d7d-b021-1ec6a627f115 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:47.177400 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1344/2693] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:52:46 2022] DELETE /identity/v3/projects/f6f37073122f47f78460e7fdf40e173b => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:52:47.180311 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d4ad9-0c2c-43f3-a9af-6de1d9c1c800 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:47.180601 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d4ad9-0c2c-43f3-a9af-6de1d9c1c800 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:47.180881 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d4ad9-0c2c-43f3-a9af-6de1d9c1c800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:47.201870 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-6d5d4ad9-0c2c-43f3-a9af-6de1d9c1c800 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:47.203106 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-6d5d4ad9-0c2c-43f3-a9af-6de1d9c1c800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:47.252326 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:47.270732 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1350/2694] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:52:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:52:47.281495 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e88adc-61a0-4e58-b3d1-cb446e658ebf None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:47.281784 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e88adc-61a0-4e58-b3d1-cb446e658ebf None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:47.282152 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e88adc-61a0-4e58-b3d1-cb446e658ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:47.302914 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5d4ad9-0c2c-43f3-a9af-6de1d9c1c800 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:47.304732 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-6d5d4ad9-0c2c-43f3-a9af-6de1d9c1c800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:47.309369 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-65e88adc-61a0-4e58-b3d1-cb446e658ebf None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:47.310576 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-65e88adc-61a0-4e58-b3d1-cb446e658ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:47.319081 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5d4ad9-0c2c-43f3-a9af-6de1d9c1c800 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:47.319980 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1345/2695] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:52:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:52:47.324603 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e88adc-61a0-4e58-b3d1-cb446e658ebf None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:47.326533 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc0167c-c5a8-4ce6-a16c-edc0112c73af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:47.327453 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0167c-c5a8-4ce6-a16c-edc0112c73af admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:47.327848 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0167c-c5a8-4ce6-a16c-edc0112c73af admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:47.328227 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0167c-c5a8-4ce6-a16c-edc0112c73af admin admin] PATH_INFO: `/v3/projects/31f593e21b8942c0974adaa9e1e68588` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:47.329656 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc0167c-c5a8-4ce6-a16c-edc0112c73af admin admin] RBAC: Authorizing `identity:delete_project(project_id=31f593e21b8942c0974adaa9e1e68588)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:47.332040 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc0167c-c5a8-4ce6-a16c-edc0112c73af admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:47.336571 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e88adc-61a0-4e58-b3d1-cb446e658ebf None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:47.342397 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02992f4f-71f4-4c01-bbee-feaee02c7dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:47.343131 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02992f4f-71f4-4c01-bbee-feaee02c7dbf admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:47.343416 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02992f4f-71f4-4c01-bbee-feaee02c7dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:47.343689 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02992f4f-71f4-4c01-bbee-feaee02c7dbf admin admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:47.344339 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02992f4f-71f4-4c01-bbee-feaee02c7dbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:52:47.344722 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02992f4f-71f4-4c01-bbee-feaee02c7dbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:47.346389 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02992f4f-71f4-4c01-bbee-feaee02c7dbf admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:47.361850 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1346/2696] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Aug 29 22:52:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:52:47.365857 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02992f4f-71f4-4c01-bbee-feaee02c7dbf admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:47.378218 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02992f4f-71f4-4c01-bbee-feaee02c7dbf admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:47.392284 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-dcc0167c-c5a8-4ce6-a16c-edc0112c73af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31f593e21b8942c0974adaa9e1e68588', 'request_id': 'req-dcc0167c-c5a8-4ce6-a16c-edc0112c73af'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:47.401690 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-dcc0167c-c5a8-4ce6-a16c-edc0112c73af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31f593e21b8942c0974adaa9e1e68588', 'request_id': 'req-dcc0167c-c5a8-4ce6-a16c-edc0112c73af'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:47.408983 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-dcc0167c-c5a8-4ce6-a16c-edc0112c73af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31f593e21b8942c0974adaa9e1e68588', 'request_id': 'req-dcc0167c-c5a8-4ce6-a16c-edc0112c73af'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:47.424576 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-dcc0167c-c5a8-4ce6-a16c-edc0112c73af admin admin] The token cache is being invalidate because project 31f593e21b8942c0974adaa9e1e68588 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:52:47.424892 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-dcc0167c-c5a8-4ce6-a16c-edc0112c73af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:47.425566 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-dcc0167c-c5a8-4ce6-a16c-edc0112c73af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:47.427746 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1351/2697] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:52:47 2022] DELETE /identity/v3/projects/31f593e21b8942c0974adaa9e1e68588 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:52:47.433275 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46b368-59b4-4a24-be9a-101a40bfef23 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:47.433592 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46b368-59b4-4a24-be9a-101a40bfef23 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:47.433876 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46b368-59b4-4a24-be9a-101a40bfef23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:47.462015 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aedfe92-3018-4342-8f62-3c517a272839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:47.462749 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aedfe92-3018-4342-8f62-3c517a272839 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:47.463123 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aedfe92-3018-4342-8f62-3c517a272839 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:47.463902 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aedfe92-3018-4342-8f62-3c517a272839 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:47.472111 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-7f46b368-59b4-4a24-be9a-101a40bfef23 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:47.472256 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aedfe92-3018-4342-8f62-3c517a272839 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:47.472359 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-7f46b368-59b4-4a24-be9a-101a40bfef23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:47.472453 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aedfe92-3018-4342-8f62-3c517a272839 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:47.489592 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1352/2698] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:52:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:52:47.491430 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672e6cb-7021-4fa2-9165-e94b939fcc5e None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:47.491713 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672e6cb-7021-4fa2-9165-e94b939fcc5e None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:47.491991 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672e6cb-7021-4fa2-9165-e94b939fcc5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:47.514790 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1347/2699] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:52:47 2022] POST /identity/v3/projects => generated 365 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:52:47.518965 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aedfe92-3018-4342-8f62-3c517a272839 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:47.522934 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-2aedfe92-3018-4342-8f62-3c517a272839 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:47.523208 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-7672e6cb-7021-4fa2-9165-e94b939fcc5e None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:47.526214 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-7672e6cb-7021-4fa2-9165-e94b939fcc5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:47.591036 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:47.610241 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aedfe92-3018-4342-8f62-3c517a272839 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:47.619699 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24df8ede-902f-48bc-b69d-515be323fb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:47.620739 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df8ede-902f-48bc-b69d-515be323fb9a admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:47.621204 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df8ede-902f-48bc-b69d-515be323fb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:47.621716 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df8ede-902f-48bc-b69d-515be323fb9a admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:47.622842 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24df8ede-902f-48bc-b69d-515be323fb9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:47.625744 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24df8ede-902f-48bc-b69d-515be323fb9a admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:47.633926 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1353/2700] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:52:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:52:47.638988 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7672e6cb-7021-4fa2-9165-e94b939fcc5e None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:47.649658 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7672e6cb-7021-4fa2-9165-e94b939fcc5e None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:47.655602 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ec22ff-6edc-4e04-aab5-7ef7cc3368dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:47.656222 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec22ff-6edc-4e04-aab5-7ef7cc3368dc admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:47.656527 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec22ff-6edc-4e04-aab5-7ef7cc3368dc admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:47.656776 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec22ff-6edc-4e04-aab5-7ef7cc3368dc admin admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:47.657607 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ec22ff-6edc-4e04-aab5-7ef7cc3368dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:52:47.657920 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ec22ff-6edc-4e04-aab5-7ef7cc3368dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:47.659532 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ec22ff-6edc-4e04-aab5-7ef7cc3368dc admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:47.660291 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1348/2701] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:52:47 2022] POST /identity/v3/users => generated 283 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:52:47.664486 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24df8ede-902f-48bc-b69d-515be323fb9a admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:47.675128 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24df8ede-902f-48bc-b69d-515be323fb9a admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:47.680396 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64306dd-f39a-4dda-9f88-7fefa6d9a913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:47.681006 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64306dd-f39a-4dda-9f88-7fefa6d9a913 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:47.681281 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64306dd-f39a-4dda-9f88-7fefa6d9a913 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:47.681580 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64306dd-f39a-4dda-9f88-7fefa6d9a913 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:47.682218 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64306dd-f39a-4dda-9f88-7fefa6d9a913 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:47.684579 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1354/2702] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Aug 29 22:52:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:52:47.684805 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64306dd-f39a-4dda-9f88-7fefa6d9a913 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:47.693426 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ec22ff-6edc-4e04-aab5-7ef7cc3368dc admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:47.696045 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1349/2703] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:52:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:52:47.701538 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64306dd-f39a-4dda-9f88-7fefa6d9a913 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:47.707109 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ec22ff-6edc-4e04-aab5-7ef7cc3368dc admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:47.711595 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892a4f77-f019-46ad-a2a8-821853c4163a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:47.712234 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a4f77-f019-46ad-a2a8-821853c4163a admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:47.712517 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a4f77-f019-46ad-a2a8-821853c4163a admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:47.712817 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a4f77-f019-46ad-a2a8-821853c4163a admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:47.713530 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892a4f77-f019-46ad-a2a8-821853c4163a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:47.715504 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892a4f77-f019-46ad-a2a8-821853c4163a admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:47.716129 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64306dd-f39a-4dda-9f88-7fefa6d9a913 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:47.721648 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e2409-7576-4252-a763-cdabe46cd61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:47.722524 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e2409-7576-4252-a763-cdabe46cd61c admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:47.723025 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e2409-7576-4252-a763-cdabe46cd61c admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:47.723713 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e2409-7576-4252-a763-cdabe46cd61c admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:47.724931 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7e2409-7576-4252-a763-cdabe46cd61c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:47.738803 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7e2409-7576-4252-a763-cdabe46cd61c admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:47.760882 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1355/2704] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:52:47 2022] POST /identity/v3/projects => generated 367 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:52:47.764579 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892a4f77-f019-46ad-a2a8-821853c4163a admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:47.768046 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1350/2705] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:52:47 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:52:47.769042 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e2409-7576-4252-a763-cdabe46cd61c admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:47.781010 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e2409-7576-4252-a763-cdabe46cd61c admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:47.802581 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:47.833128 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892a4f77-f019-46ad-a2a8-821853c4163a admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:47.841082 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12351c2e-b926-4acd-a0f6-b7448801e4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:47.842071 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12351c2e-b926-4acd-a0f6-b7448801e4d7 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:47.842499 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12351c2e-b926-4acd-a0f6-b7448801e4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:47.842782 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12351c2e-b926-4acd-a0f6-b7448801e4d7 admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:47.843422 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12351c2e-b926-4acd-a0f6-b7448801e4d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:47.845359 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12351c2e-b926-4acd-a0f6-b7448801e4d7 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:47.851321 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1680158-d462-4ebd-bdc4-9cb1ba969db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:47.851921 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1680158-d462-4ebd-bdc4-9cb1ba969db2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:47.852281 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1680158-d462-4ebd-bdc4-9cb1ba969db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:47.852687 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1680158-d462-4ebd-bdc4-9cb1ba969db2 admin admin] PATH_INFO: `/v3/projects/8bd2001590924dd9ba6d2d394f5fc9ea/users/c65b9b6c38eb48ff9addba47690aa985/roles/0c67797d444d4c929b2ccab47c468848` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:47.869763 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1356/2706] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:52:47 2022] POST /identity/v3/users => generated 284 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:52:47.871685 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1680158-d462-4ebd-bdc4-9cb1ba969db2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bd2001590924dd9ba6d2d394f5fc9ea, user_id=c65b9b6c38eb48ff9addba47690aa985, role_id=0c67797d444d4c929b2ccab47c468848)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:47.874299 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12351c2e-b926-4acd-a0f6-b7448801e4d7 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:47.874831 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1680158-d462-4ebd-bdc4-9cb1ba969db2 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:47.887538 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12351c2e-b926-4acd-a0f6-b7448801e4d7 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:47.890557 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1351/2707] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:52:47 2022] PUT /identity/v3/projects/8bd2001590924dd9ba6d2d394f5fc9ea/users/c65b9b6c38eb48ff9addba47690aa985/roles/0c67797d444d4c929b2ccab47c468848 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:52:47.902996 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b0c61-1c49-49d8-967a-a36fead299c3 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:47.903285 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b0c61-1c49-49d8-967a-a36fead299c3 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:47.903552 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b0c61-1c49-49d8-967a-a36fead299c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:47.936321 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-0b6b0c61-1c49-49d8-967a-a36fead299c3 None None] MFA Rules not processed for user `c65b9b6c38eb48ff9addba47690aa985`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:47.937573 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-0b6b0c61-1c49-49d8-967a-a36fead299c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:47.955088 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53681915-196c-49cb-97dd-27d24d0b09f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:47.955800 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53681915-196c-49cb-97dd-27d24d0b09f9 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:47.956377 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53681915-196c-49cb-97dd-27d24d0b09f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:47.956377 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53681915-196c-49cb-97dd-27d24d0b09f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:47.957005 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53681915-196c-49cb-97dd-27d24d0b09f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:47.958925 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53681915-196c-49cb-97dd-27d24d0b09f9 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:47.974673 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1357/2708] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:52:47 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:52:47.976261 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53681915-196c-49cb-97dd-27d24d0b09f9 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:47.988336 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53681915-196c-49cb-97dd-27d24d0b09f9 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:47.992777 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca4209b-f777-4fe9-a49b-096faef319c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:47.993407 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4209b-f777-4fe9-a49b-096faef319c9 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:47.993689 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4209b-f777-4fe9-a49b-096faef319c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:47.994044 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4209b-f777-4fe9-a49b-096faef319c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:47.994581 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca4209b-f777-4fe9-a49b-096faef319c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:47.996578 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca4209b-f777-4fe9-a49b-096faef319c9 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:48.008290 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1358/2709] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:52:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:52:48.012928 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca4209b-f777-4fe9-a49b-096faef319c9 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:48.022215 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1352/2710] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:52:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:52:48.023032 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca4209b-f777-4fe9-a49b-096faef319c9 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:48.027182 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b0c61-1c49-49d8-967a-a36fead299c3 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:48.028369 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5289c1-11ee-4cc6-85a5-f1713a6d3590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:48.029053 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5289c1-11ee-4cc6-85a5-f1713a6d3590 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:48.029360 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5289c1-11ee-4cc6-85a5-f1713a6d3590 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:48.029645 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5289c1-11ee-4cc6-85a5-f1713a6d3590 admin admin] PATH_INFO: `/v3/projects/644a79a84cdb443286c58323b1c0ff50/users/32c45e38db8a472ab8b0aea274e49c21/roles/0c67797d444d4c929b2ccab47c468848` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:48.037909 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b0c61-1c49-49d8-967a-a36fead299c3 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:48.043079 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9581cc64-d956-40cd-9558-f2fb53a57170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:48.043684 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9581cc64-d956-40cd-9558-f2fb53a57170 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:48.043963 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9581cc64-d956-40cd-9558-f2fb53a57170 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:48.044235 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9581cc64-d956-40cd-9558-f2fb53a57170 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:48.044870 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9581cc64-d956-40cd-9558-f2fb53a57170 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:48.046930 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9581cc64-d956-40cd-9558-f2fb53a57170 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:48.049460 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5289c1-11ee-4cc6-85a5-f1713a6d3590 admin admin] RBAC: Authorizing `identity:create_grant(project_id=644a79a84cdb443286c58323b1c0ff50, user_id=32c45e38db8a472ab8b0aea274e49c21, role_id=0c67797d444d4c929b2ccab47c468848)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:48.053061 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5289c1-11ee-4cc6-85a5-f1713a6d3590 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:48.071319 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1359/2711] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:52:48 2022] PUT /identity/v3/projects/644a79a84cdb443286c58323b1c0ff50/users/32c45e38db8a472ab8b0aea274e49c21/roles/0c67797d444d4c929b2ccab47c468848 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:52:48.087340 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1353/2712] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:52:48 2022] POST /identity/v3/projects => generated 365 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:52:48.088846 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5289c1-11ee-4cc6-85a5-f1713a6d3590 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:48.143075 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8f1d5-308d-4f81-8876-73049c8f0327 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:48.143280 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8f1d5-308d-4f81-8876-73049c8f0327 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:48.143521 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8f1d5-308d-4f81-8876-73049c8f0327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:48.157318 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:48.177421 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-46c8f1d5-308d-4f81-8876-73049c8f0327 None None] MFA Rules not processed for user `32c45e38db8a472ab8b0aea274e49c21`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:48.178549 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-46c8f1d5-308d-4f81-8876-73049c8f0327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:48.202374 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5289c1-11ee-4cc6-85a5-f1713a6d3590 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:48.237167 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:48.253786 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1354/2713] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:52:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:52:48.267901 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c8f1d5-308d-4f81-8876-73049c8f0327 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:48.269396 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-46c8f1d5-308d-4f81-8876-73049c8f0327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:48.270394 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf4b75-d670-482a-8714-2dd0c3af5389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:48.271016 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf4b75-d670-482a-8714-2dd0c3af5389 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:48.276420 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf4b75-d670-482a-8714-2dd0c3af5389 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:48.276420 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf4b75-d670-482a-8714-2dd0c3af5389 admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:48.276420 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcf4b75-d670-482a-8714-2dd0c3af5389 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:48.276420 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcf4b75-d670-482a-8714-2dd0c3af5389 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:48.306335 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1360/2714] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:52:48 2022] POST /identity/v3/users => generated 289 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:52:48.310852 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf4b75-d670-482a-8714-2dd0c3af5389 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:48.322789 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf4b75-d670-482a-8714-2dd0c3af5389 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:48.327716 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb45673-3fa9-4c01-8b8a-e2f660ac5bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:48.328322 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb45673-3fa9-4c01-8b8a-e2f660ac5bb0 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:48.328602 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb45673-3fa9-4c01-8b8a-e2f660ac5bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:48.328876 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb45673-3fa9-4c01-8b8a-e2f660ac5bb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:48.329741 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb45673-3fa9-4c01-8b8a-e2f660ac5bb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:48.331517 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb45673-3fa9-4c01-8b8a-e2f660ac5bb0 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:48.345516 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1361/2715] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:52:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:52:48.350262 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb45673-3fa9-4c01-8b8a-e2f660ac5bb0 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:48.351265 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c8f1d5-308d-4f81-8876-73049c8f0327 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:48.355565 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cf2954-0f12-44bb-942d-fed646dde6a7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5c4e692fd714354b96bd3ef4fcecdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:48.356371 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf2954-0f12-44bb-942d-fed646dde6a7 service glance] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:48.356656 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf2954-0f12-44bb-942d-fed646dde6a7 service glance] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:48.356954 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf2954-0f12-44bb-942d-fed646dde6a7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:48.361252 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb45673-3fa9-4c01-8b8a-e2f660ac5bb0 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:48.365963 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cf2954-0f12-44bb-942d-fed646dde6a7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:48.367171 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86273aa5-4eb6-4856-a071-9bd1993442dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:48.367673 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cf2954-0f12-44bb-942d-fed646dde6a7 service glance] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:48.367894 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86273aa5-4eb6-4856-a071-9bd1993442dc admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:48.368183 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86273aa5-4eb6-4856-a071-9bd1993442dc admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:48.368464 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86273aa5-4eb6-4856-a071-9bd1993442dc admin admin] PATH_INFO: `/v3/projects/aefa392cb6be4436b6120a1fb517e419/users/94c78dab3221417c88c59a5feb17a868/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:48.378963 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1355/2716] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:52:48 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:52:48.391190 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86273aa5-4eb6-4856-a071-9bd1993442dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=aefa392cb6be4436b6120a1fb517e419, user_id=94c78dab3221417c88c59a5feb17a868, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:48.393977 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86273aa5-4eb6-4856-a071-9bd1993442dc admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:48.411022 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1362/2717] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:52:48 2022] PUT /identity/v3/projects/aefa392cb6be4436b6120a1fb517e419/users/94c78dab3221417c88c59a5feb17a868/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:52:48.415216 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cf2954-0f12-44bb-942d-fed646dde6a7 service glance] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:48.428510 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cf2954-0f12-44bb-942d-fed646dde6a7 service glance] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:48.504996 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b5512a-598b-4d66-bd29-e39b66a1ef26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:48.505807 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5512a-598b-4d66-bd29-e39b66a1ef26 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:48.506490 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5512a-598b-4d66-bd29-e39b66a1ef26 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:48.506830 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5512a-598b-4d66-bd29-e39b66a1ef26 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:48.508223 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b5512a-598b-4d66-bd29-e39b66a1ef26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:48.509881 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b5512a-598b-4d66-bd29-e39b66a1ef26 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:48.520837 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1356/2718] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:52:48 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:52:48.525080 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86273aa5-4eb6-4856-a071-9bd1993442dc admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:48.536560 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86273aa5-4eb6-4856-a071-9bd1993442dc admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:48.541534 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09318022-b4ca-4486-a2b1-eb87b65b3238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:48.542824 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09318022-b4ca-4486-a2b1-eb87b65b3238 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:48.543324 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09318022-b4ca-4486-a2b1-eb87b65b3238 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:48.543606 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09318022-b4ca-4486-a2b1-eb87b65b3238 admin admin] PATH_INFO: `/v3/projects/aefa392cb6be4436b6120a1fb517e419/users/94c78dab3221417c88c59a5feb17a868/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:48.545639 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09318022-b4ca-4486-a2b1-eb87b65b3238 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aefa392cb6be4436b6120a1fb517e419, user_id=94c78dab3221417c88c59a5feb17a868, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:48.548497 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09318022-b4ca-4486-a2b1-eb87b65b3238 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:48.561425 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1363/2719] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:52:48 2022] PUT /identity/v3/projects/aefa392cb6be4436b6120a1fb517e419/users/94c78dab3221417c88c59a5feb17a868/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:52:48.572359 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7896197-88d4-4799-845b-8186d57cf04d None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:48.572649 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7896197-88d4-4799-845b-8186d57cf04d None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:48.572947 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7896197-88d4-4799-845b-8186d57cf04d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:48.604005 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-c7896197-88d4-4799-845b-8186d57cf04d None None] MFA Rules not processed for user `94c78dab3221417c88c59a5feb17a868`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:48.606085 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-c7896197-88d4-4799-845b-8186d57cf04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:48.632585 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:48.687697 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1357/2720] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:52:48 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:52:48.700064 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09318022-b4ca-4486-a2b1-eb87b65b3238 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:48.701943 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-09318022-b4ca-4486-a2b1-eb87b65b3238 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:48.765868 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09318022-b4ca-4486-a2b1-eb87b65b3238 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:48.769904 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2924f215-3641-48ae-94b7-de736e7d60f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:48.770526 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2924f215-3641-48ae-94b7-de736e7d60f7 service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:48.770801 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2924f215-3641-48ae-94b7-de736e7d60f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:48.771073 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2924f215-3641-48ae-94b7-de736e7d60f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:48.782738 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2924f215-3641-48ae-94b7-de736e7d60f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:48.784180 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2924f215-3641-48ae-94b7-de736e7d60f7 service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:48.795044 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1364/2721] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:52:48 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:52:48.898493 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7896197-88d4-4799-845b-8186d57cf04d None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:48.910228 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7896197-88d4-4799-845b-8186d57cf04d None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:48.914440 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e0f787-225a-4fb1-9f2a-e82c267a02ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:48.915152 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e0f787-225a-4fb1-9f2a-e82c267a02ca service cinder] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:48.915486 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e0f787-225a-4fb1-9f2a-e82c267a02ca service cinder] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:48.915858 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e0f787-225a-4fb1-9f2a-e82c267a02ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:48.975388 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e0f787-225a-4fb1-9f2a-e82c267a02ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:48.976881 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e0f787-225a-4fb1-9f2a-e82c267a02ca service cinder] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:48.986514 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1358/2722] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:52:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:52:51.834636 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2924f215-3641-48ae-94b7-de736e7d60f7 service cinder] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:51.836047 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-2924f215-3641-48ae-94b7-de736e7d60f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:51.923351 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2924f215-3641-48ae-94b7-de736e7d60f7 service cinder] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:51.929428 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb347680-614a-4c3a-b3d0-69cc7a117202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:51.930081 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb347680-614a-4c3a-b3d0-69cc7a117202 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:51.930397 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb347680-614a-4c3a-b3d0-69cc7a117202 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:51.930631 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb347680-614a-4c3a-b3d0-69cc7a117202 admin admin] PATH_INFO: `/v3/users/0d5b6b756a2e4482ba994ebc9f2800c1` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:51.937576 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb347680-614a-4c3a-b3d0-69cc7a117202 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d5b6b756a2e4482ba994ebc9f2800c1)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:51.939538 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb347680-614a-4c3a-b3d0-69cc7a117202 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:51.957515 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:52.003020 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-cb347680-614a-4c3a-b3d0-69cc7a117202 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d5b6b756a2e4482ba994ebc9f2800c1'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:52.010498 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-cb347680-614a-4c3a-b3d0-69cc7a117202 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d5b6b756a2e4482ba994ebc9f2800c1'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:52.011621 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-cb347680-614a-4c3a-b3d0-69cc7a117202 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d5b6b756a2e4482ba994ebc9f2800c1'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:52.025349 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-cb347680-614a-4c3a-b3d0-69cc7a117202 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d5b6b756a2e4482ba994ebc9f2800c1'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:52.026026 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-cb347680-614a-4c3a-b3d0-69cc7a117202 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d5b6b756a2e4482ba994ebc9f2800c1'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:52.048742 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1365/2723] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:52:51 2022] DELETE /identity/v3/users/0d5b6b756a2e4482ba994ebc9f2800c1 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:52:52.055544 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3818e43-1915-472d-aae9-411a02c9bf61 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:52.056020 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3818e43-1915-472d-aae9-411a02c9bf61 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:52.056166 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3818e43-1915-472d-aae9-411a02c9bf61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:52.078389 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-b3818e43-1915-472d-aae9-411a02c9bf61 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:52.079653 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-b3818e43-1915-472d-aae9-411a02c9bf61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:52.151541 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1359/2724] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:52:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:52:52.162882 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb347680-614a-4c3a-b3d0-69cc7a117202 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:52.164516 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-cb347680-614a-4c3a-b3d0-69cc7a117202 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:52.236813 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb347680-614a-4c3a-b3d0-69cc7a117202 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:52.240744 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d74987-d61b-4406-92c3-d79aff81c01f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:52.241428 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d74987-d61b-4406-92c3-d79aff81c01f service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:52.241709 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d74987-d61b-4406-92c3-d79aff81c01f service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:52.241983 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d74987-d61b-4406-92c3-d79aff81c01f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:52.252094 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d74987-d61b-4406-92c3-d79aff81c01f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:52.253565 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d74987-d61b-4406-92c3-d79aff81c01f service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:52.263788 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1366/2725] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:52:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:52:52.579943 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3818e43-1915-472d-aae9-411a02c9bf61 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:52.581431 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-b3818e43-1915-472d-aae9-411a02c9bf61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:52.595089 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3818e43-1915-472d-aae9-411a02c9bf61 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:52.603418 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c40d05-03b7-446a-ab59-9c9ab6854b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:52.604064 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c40d05-03b7-446a-ab59-9c9ab6854b23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:52.604448 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c40d05-03b7-446a-ab59-9c9ab6854b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:52.604827 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c40d05-03b7-446a-ab59-9c9ab6854b23 admin admin] PATH_INFO: `/v3/projects/4079da906c9d4b799fc63d1ebda8b450` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:52.605898 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c40d05-03b7-446a-ab59-9c9ab6854b23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4079da906c9d4b799fc63d1ebda8b450)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:52.607797 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c40d05-03b7-446a-ab59-9c9ab6854b23 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:52.666174 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-f1c40d05-03b7-446a-ab59-9c9ab6854b23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4079da906c9d4b799fc63d1ebda8b450', 'request_id': 'req-f1c40d05-03b7-446a-ab59-9c9ab6854b23'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:52.673190 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-f1c40d05-03b7-446a-ab59-9c9ab6854b23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4079da906c9d4b799fc63d1ebda8b450', 'request_id': 'req-f1c40d05-03b7-446a-ab59-9c9ab6854b23'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:52.679676 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:52.679676 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-f1c40d05-03b7-446a-ab59-9c9ab6854b23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4079da906c9d4b799fc63d1ebda8b450', 'request_id': 'req-f1c40d05-03b7-446a-ab59-9c9ab6854b23'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:52.693320 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-f1c40d05-03b7-446a-ab59-9c9ab6854b23 admin admin] The token cache is being invalidate because project 4079da906c9d4b799fc63d1ebda8b450 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:52:52.693712 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-f1c40d05-03b7-446a-ab59-9c9ab6854b23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:52.694413 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-f1c40d05-03b7-446a-ab59-9c9ab6854b23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:52.695951 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1360/2726] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:52:52 2022] DELETE /identity/v3/projects/4079da906c9d4b799fc63d1ebda8b450 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:52:52.701864 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a9f67d-76f1-488c-a1d0-ccd9f157c6fc None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:52.702144 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a9f67d-76f1-488c-a1d0-ccd9f157c6fc None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:52.702411 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a9f67d-76f1-488c-a1d0-ccd9f157c6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:52.722805 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-12a9f67d-76f1-488c-a1d0-ccd9f157c6fc None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:52.724013 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-12a9f67d-76f1-488c-a1d0-ccd9f157c6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:52.788624 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1367/2727] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:52:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:52:52.796663 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753353ec-a2cc-46b6-acde-2f197405e17a None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:52.796950 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753353ec-a2cc-46b6-acde-2f197405e17a None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:52.797231 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753353ec-a2cc-46b6-acde-2f197405e17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:52.819013 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-753353ec-a2cc-46b6-acde-2f197405e17a None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:52.820622 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-753353ec-a2cc-46b6-acde-2f197405e17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:52.829829 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1361/2728] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:52:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:52:52.834454 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a9f67d-76f1-488c-a1d0-ccd9f157c6fc None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:52.847302 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a9f67d-76f1-488c-a1d0-ccd9f157c6fc None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:52.852533 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f32cde-f84e-459e-b036-fdd48713af03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:52.853284 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f32cde-f84e-459e-b036-fdd48713af03 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:52.853543 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f32cde-f84e-459e-b036-fdd48713af03 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:52.854196 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f32cde-f84e-459e-b036-fdd48713af03 admin admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:52.854923 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f32cde-f84e-459e-b036-fdd48713af03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:52:52.855625 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f32cde-f84e-459e-b036-fdd48713af03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:52.859044 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f32cde-f84e-459e-b036-fdd48713af03 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:52.873710 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1368/2729] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Aug 29 22:52:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:52:52.878011 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753353ec-a2cc-46b6-acde-2f197405e17a None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:52.888041 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753353ec-a2cc-46b6-acde-2f197405e17a None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:52.894205 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b22931-19cd-41da-89e3-7df48b40af56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:52.894828 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b22931-19cd-41da-89e3-7df48b40af56 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:52.895108 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b22931-19cd-41da-89e3-7df48b40af56 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:52.895378 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b22931-19cd-41da-89e3-7df48b40af56 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:52.896006 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b22931-19cd-41da-89e3-7df48b40af56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:52.897950 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b22931-19cd-41da-89e3-7df48b40af56 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:52.929118 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1362/2730] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:52:52 2022] POST /identity/v3/projects => generated 363 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:52:52.933633 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f32cde-f84e-459e-b036-fdd48713af03 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:52.943644 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f32cde-f84e-459e-b036-fdd48713af03 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:52.965165 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:53.005998 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76748d9-055f-4317-a77f-1b8aaa2bdf17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:53.006611 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76748d9-055f-4317-a77f-1b8aaa2bdf17 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:53.006888 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76748d9-055f-4317-a77f-1b8aaa2bdf17 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:53.007159 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76748d9-055f-4317-a77f-1b8aaa2bdf17 admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:53.007801 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76748d9-055f-4317-a77f-1b8aaa2bdf17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:53.009757 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76748d9-055f-4317-a77f-1b8aaa2bdf17 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:53.033022 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1369/2731] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:52:52 2022] POST /identity/v3/users => generated 282 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:52:53.037544 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b22931-19cd-41da-89e3-7df48b40af56 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:53.047911 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b22931-19cd-41da-89e3-7df48b40af56 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:53.052549 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2555afc-69fe-4a8c-a5a5-fb7b80149317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:53.053155 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2555afc-69fe-4a8c-a5a5-fb7b80149317 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:53.053469 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2555afc-69fe-4a8c-a5a5-fb7b80149317 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:53.053745 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2555afc-69fe-4a8c-a5a5-fb7b80149317 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:53.054378 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2555afc-69fe-4a8c-a5a5-fb7b80149317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:53.055967 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2555afc-69fe-4a8c-a5a5-fb7b80149317 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:53.066901 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1363/2732] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:52:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:52:53.071084 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76748d9-055f-4317-a77f-1b8aaa2bdf17 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:53.082920 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76748d9-055f-4317-a77f-1b8aaa2bdf17 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:53.088623 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9802c1e3-a2ca-4a27-8de8-ea39411af845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:53.090082 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802c1e3-a2ca-4a27-8de8-ea39411af845 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:53.090372 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802c1e3-a2ca-4a27-8de8-ea39411af845 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:53.090641 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802c1e3-a2ca-4a27-8de8-ea39411af845 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:53.091364 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9802c1e3-a2ca-4a27-8de8-ea39411af845 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:53.093152 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9802c1e3-a2ca-4a27-8de8-ea39411af845 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:53.107438 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1370/2733] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:52:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:52:53.108393 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2555afc-69fe-4a8c-a5a5-fb7b80149317 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:53.118677 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2555afc-69fe-4a8c-a5a5-fb7b80149317 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:53.124534 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f42904b-45bd-4d7e-8d32-c20b1f6fa2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:53.125165 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f42904b-45bd-4d7e-8d32-c20b1f6fa2cb admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:53.125475 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f42904b-45bd-4d7e-8d32-c20b1f6fa2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:53.125752 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f42904b-45bd-4d7e-8d32-c20b1f6fa2cb admin admin] PATH_INFO: `/v3/projects/443b766e29ce4cc6a79da082b0f3c70a/users/7dd7900e3f844f36a616d30af45cf1ee/roles/0c67797d444d4c929b2ccab47c468848` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:53.144890 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f42904b-45bd-4d7e-8d32-c20b1f6fa2cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=443b766e29ce4cc6a79da082b0f3c70a, user_id=7dd7900e3f844f36a616d30af45cf1ee, role_id=0c67797d444d4c929b2ccab47c468848)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:53.147570 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f42904b-45bd-4d7e-8d32-c20b1f6fa2cb admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:53.166236 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1364/2734] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:52:53 2022] PUT /identity/v3/projects/443b766e29ce4cc6a79da082b0f3c70a/users/7dd7900e3f844f36a616d30af45cf1ee/roles/0c67797d444d4c929b2ccab47c468848 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:52:53.177630 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79555335-8473-459e-aae7-517569fa8501 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:53.177919 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79555335-8473-459e-aae7-517569fa8501 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:53.178196 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79555335-8473-459e-aae7-517569fa8501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:53.208452 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-79555335-8473-459e-aae7-517569fa8501 None None] MFA Rules not processed for user `7dd7900e3f844f36a616d30af45cf1ee`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:53.209715 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-79555335-8473-459e-aae7-517569fa8501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:53.277792 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1371/2735] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:52:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:52:53.282549 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f42904b-45bd-4d7e-8d32-c20b1f6fa2cb admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:53.350706 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f42904b-45bd-4d7e-8d32-c20b1f6fa2cb admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:53.356087 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f33933-bb39-433b-a588-bc57b86134a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:53.357049 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f33933-bb39-433b-a588-bc57b86134a0 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:53.357574 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f33933-bb39-433b-a588-bc57b86134a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:53.357854 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f33933-bb39-433b-a588-bc57b86134a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:53.358631 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f33933-bb39-433b-a588-bc57b86134a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:53.361882 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f33933-bb39-433b-a588-bc57b86134a0 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:53.391629 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1365/2736] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:52:53 2022] POST /identity/v3/projects => generated 365 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:52:53.395509 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79555335-8473-459e-aae7-517569fa8501 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:53.406586 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79555335-8473-459e-aae7-517569fa8501 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:53.464899 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ff8e9b-b69c-4cf4-a8be-9b67a5aadca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:53.465537 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff8e9b-b69c-4cf4-a8be-9b67a5aadca3 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:53.465814 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff8e9b-b69c-4cf4-a8be-9b67a5aadca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:53.466082 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff8e9b-b69c-4cf4-a8be-9b67a5aadca3 admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:53.466716 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ff8e9b-b69c-4cf4-a8be-9b67a5aadca3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:53.468624 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ff8e9b-b69c-4cf4-a8be-9b67a5aadca3 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:53.490940 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1372/2737] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:52:53 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:52:53.495744 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f33933-bb39-433b-a588-bc57b86134a0 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:53.506074 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f33933-bb39-433b-a588-bc57b86134a0 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:53.510774 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13c8713-d1aa-481e-91d4-8576eeabce00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:53.511411 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c8713-d1aa-481e-91d4-8576eeabce00 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:53.511708 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c8713-d1aa-481e-91d4-8576eeabce00 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:53.512001 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c8713-d1aa-481e-91d4-8576eeabce00 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:53.512633 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13c8713-d1aa-481e-91d4-8576eeabce00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:53.514390 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13c8713-d1aa-481e-91d4-8576eeabce00 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:53.526438 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1366/2738] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:52:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:52:53.531017 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ff8e9b-b69c-4cf4-a8be-9b67a5aadca3 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:53.541043 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ff8e9b-b69c-4cf4-a8be-9b67a5aadca3 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:53.546360 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7042de26-9d96-4247-8027-e1b1ba5f0231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:53.547001 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7042de26-9d96-4247-8027-e1b1ba5f0231 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:53.547284 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7042de26-9d96-4247-8027-e1b1ba5f0231 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:53.547559 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7042de26-9d96-4247-8027-e1b1ba5f0231 admin admin] PATH_INFO: `/v3/projects/ebb9f9e9010545d7a9f955f953952bc5/users/755af1a7d16c4a2bb2c66e9ea92892a3/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:53.563827 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7042de26-9d96-4247-8027-e1b1ba5f0231 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebb9f9e9010545d7a9f955f953952bc5, user_id=755af1a7d16c4a2bb2c66e9ea92892a3, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:53.566552 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7042de26-9d96-4247-8027-e1b1ba5f0231 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:53.574927 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:53.581472 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1373/2739] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:52:53 2022] PUT /identity/v3/projects/ebb9f9e9010545d7a9f955f953952bc5/users/755af1a7d16c4a2bb2c66e9ea92892a3/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:52:53.585439 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13c8713-d1aa-481e-91d4-8576eeabce00 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:53.595926 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13c8713-d1aa-481e-91d4-8576eeabce00 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:53.644956 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:53.655893 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de89201-a4a3-409e-943f-2aa0bd10a6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:53.656758 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de89201-a4a3-409e-943f-2aa0bd10a6e6 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:53.657046 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de89201-a4a3-409e-943f-2aa0bd10a6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:53.657526 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de89201-a4a3-409e-943f-2aa0bd10a6e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:53.658353 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de89201-a4a3-409e-943f-2aa0bd10a6e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:53.660197 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de89201-a4a3-409e-943f-2aa0bd10a6e6 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:53.671228 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1367/2740] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:52:53 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:52:53.675348 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7042de26-9d96-4247-8027-e1b1ba5f0231 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:53.687493 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7042de26-9d96-4247-8027-e1b1ba5f0231 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:53.692475 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e7af22-07db-4de3-bc9d-e1ba17a0dbf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:53.693344 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7af22-07db-4de3-bc9d-e1ba17a0dbf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:53.693660 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7af22-07db-4de3-bc9d-e1ba17a0dbf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:53.693937 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7af22-07db-4de3-bc9d-e1ba17a0dbf8 admin admin] PATH_INFO: `/v3/projects/ebb9f9e9010545d7a9f955f953952bc5/users/755af1a7d16c4a2bb2c66e9ea92892a3/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:53.696129 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e7af22-07db-4de3-bc9d-e1ba17a0dbf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebb9f9e9010545d7a9f955f953952bc5, user_id=755af1a7d16c4a2bb2c66e9ea92892a3, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:53.698979 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e7af22-07db-4de3-bc9d-e1ba17a0dbf8 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:53.710307 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1374/2741] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:52:53 2022] PUT /identity/v3/projects/ebb9f9e9010545d7a9f955f953952bc5/users/755af1a7d16c4a2bb2c66e9ea92892a3/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:52:53.722594 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b613ab-61af-40c0-b9ee-9b10c58b15e0 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:53.722887 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b613ab-61af-40c0-b9ee-9b10c58b15e0 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:53.723158 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b613ab-61af-40c0-b9ee-9b10c58b15e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:53.753472 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-96b613ab-61af-40c0-b9ee-9b10c58b15e0 None None] MFA Rules not processed for user `755af1a7d16c4a2bb2c66e9ea92892a3`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:53.755288 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-96b613ab-61af-40c0-b9ee-9b10c58b15e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:53.843023 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1368/2742] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:52:53 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:52:53.850575 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e7af22-07db-4de3-bc9d-e1ba17a0dbf8 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:53.852456 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-45e7af22-07db-4de3-bc9d-e1ba17a0dbf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:53.862342 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b613ab-61af-40c0-b9ee-9b10c58b15e0 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:53.863819 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-96b613ab-61af-40c0-b9ee-9b10c58b15e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:53.921829 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e7af22-07db-4de3-bc9d-e1ba17a0dbf8 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:53.925541 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a96fe-e1ff-4b96-9776-d6908387fc94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:53.926151 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a96fe-e1ff-4b96-9776-d6908387fc94 service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:53.926425 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a96fe-e1ff-4b96-9776-d6908387fc94 service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:53.926691 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a96fe-e1ff-4b96-9776-d6908387fc94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:53.935528 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b613ab-61af-40c0-b9ee-9b10c58b15e0 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:53.936586 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504a96fe-e1ff-4b96-9776-d6908387fc94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:53.938049 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504a96fe-e1ff-4b96-9776-d6908387fc94 service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:53.940189 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b288b9-4266-4786-a55d-a9c01c7601a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:53.940809 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b288b9-4266-4786-a55d-a9c01c7601a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:53.941084 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b288b9-4266-4786-a55d-a9c01c7601a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:53.941375 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b288b9-4266-4786-a55d-a9c01c7601a0 admin admin] PATH_INFO: `/v3/users/c65b9b6c38eb48ff9addba47690aa985` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:53.943260 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b288b9-4266-4786-a55d-a9c01c7601a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c65b9b6c38eb48ff9addba47690aa985)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:53.945392 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b288b9-4266-4786-a55d-a9c01c7601a0 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:53.949465 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1375/2743] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:52:53 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:52:54.006100 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-e2b288b9-4266-4786-a55d-a9c01c7601a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c65b9b6c38eb48ff9addba47690aa985'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:54.014077 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-e2b288b9-4266-4786-a55d-a9c01c7601a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c65b9b6c38eb48ff9addba47690aa985'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:54.015033 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-e2b288b9-4266-4786-a55d-a9c01c7601a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c65b9b6c38eb48ff9addba47690aa985'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:54.031702 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-e2b288b9-4266-4786-a55d-a9c01c7601a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c65b9b6c38eb48ff9addba47690aa985'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:54.034398 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:54.042317 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-e2b288b9-4266-4786-a55d-a9c01c7601a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c65b9b6c38eb48ff9addba47690aa985'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:54.048701 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a96fe-e1ff-4b96-9776-d6908387fc94 service cinder] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:54.051503 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1369/2744] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:52:53 2022] DELETE /identity/v3/users/c65b9b6c38eb48ff9addba47690aa985 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:52:54.055924 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39967b9d-91f9-4541-8063-2941fe0a6694 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:54.056209 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39967b9d-91f9-4541-8063-2941fe0a6694 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:54.056819 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39967b9d-91f9-4541-8063-2941fe0a6694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:54.058418 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a96fe-e1ff-4b96-9776-d6908387fc94 service cinder] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:54.076299 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-39967b9d-91f9-4541-8063-2941fe0a6694 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:54.077590 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-39967b9d-91f9-4541-8063-2941fe0a6694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:54.112660 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e2b0ab-3e9e-4aaa-9cd3-0c213ecb3d0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:54.113293 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e2b0ab-3e9e-4aaa-9cd3-0c213ecb3d0e service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:54.113605 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e2b0ab-3e9e-4aaa-9cd3-0c213ecb3d0e service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:54.113885 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e2b0ab-3e9e-4aaa-9cd3-0c213ecb3d0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:54.116486 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-92e2b0ab-3e9e-4aaa-9cd3-0c213ecb3d0e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:54.143699 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1370/2745] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:52:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:52:54.155274 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39967b9d-91f9-4541-8063-2941fe0a6694 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:54.157769 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-39967b9d-91f9-4541-8063-2941fe0a6694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:54.200445 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e2b0ab-3e9e-4aaa-9cd3-0c213ecb3d0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:54.201946 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e2b0ab-3e9e-4aaa-9cd3-0c213ecb3d0e service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:54.214320 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1376/2746] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:52:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:52:54.223180 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39967b9d-91f9-4541-8063-2941fe0a6694 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:54.227690 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93087e8a-9ced-493d-9ccf-2f6634a5e0a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:54.228296 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93087e8a-9ced-493d-9ccf-2f6634a5e0a9 service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:54.228552 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93087e8a-9ced-493d-9ccf-2f6634a5e0a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:54.228821 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93087e8a-9ced-493d-9ccf-2f6634a5e0a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:54.242691 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93087e8a-9ced-493d-9ccf-2f6634a5e0a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:54.244225 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93087e8a-9ced-493d-9ccf-2f6634a5e0a9 service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:54.254872 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1371/2747] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:52:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:52:54.544207 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e2b0ab-3e9e-4aaa-9cd3-0c213ecb3d0e service cinder] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:54.545810 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-92e2b0ab-3e9e-4aaa-9cd3-0c213ecb3d0e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:54.560585 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e2b0ab-3e9e-4aaa-9cd3-0c213ecb3d0e service cinder] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:54.565926 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8991d74-4eaf-4c5a-abcf-d9ca98133bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:54.566576 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8991d74-4eaf-4c5a-abcf-d9ca98133bf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:54.566858 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8991d74-4eaf-4c5a-abcf-d9ca98133bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:54.567407 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8991d74-4eaf-4c5a-abcf-d9ca98133bf8 admin admin] PATH_INFO: `/v3/projects/8bd2001590924dd9ba6d2d394f5fc9ea` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:54.568644 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8991d74-4eaf-4c5a-abcf-d9ca98133bf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bd2001590924dd9ba6d2d394f5fc9ea)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:54.578329 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8991d74-4eaf-4c5a-abcf-d9ca98133bf8 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:54.640625 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:54.649228 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-d8991d74-4eaf-4c5a-abcf-d9ca98133bf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bd2001590924dd9ba6d2d394f5fc9ea', 'request_id': 'req-d8991d74-4eaf-4c5a-abcf-d9ca98133bf8'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:54.656793 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-d8991d74-4eaf-4c5a-abcf-d9ca98133bf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bd2001590924dd9ba6d2d394f5fc9ea', 'request_id': 'req-d8991d74-4eaf-4c5a-abcf-d9ca98133bf8'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:54.662645 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-d8991d74-4eaf-4c5a-abcf-d9ca98133bf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bd2001590924dd9ba6d2d394f5fc9ea', 'request_id': 'req-d8991d74-4eaf-4c5a-abcf-d9ca98133bf8'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:54.678910 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-d8991d74-4eaf-4c5a-abcf-d9ca98133bf8 admin admin] The token cache is being invalidate because project 8bd2001590924dd9ba6d2d394f5fc9ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:52:54.679151 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-d8991d74-4eaf-4c5a-abcf-d9ca98133bf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:54.679835 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-d8991d74-4eaf-4c5a-abcf-d9ca98133bf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:54.681382 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1377/2748] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:52:54 2022] DELETE /identity/v3/projects/8bd2001590924dd9ba6d2d394f5fc9ea => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:52:54.685587 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93087e8a-9ced-493d-9ccf-2f6634a5e0a9 service neutron] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:54.695726 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93087e8a-9ced-493d-9ccf-2f6634a5e0a9 service neutron] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:54.754534 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeaaac2-3a58-4670-a082-356fb68fe7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:54.755172 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeaaac2-3a58-4670-a082-356fb68fe7cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:54.755454 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeaaac2-3a58-4670-a082-356fb68fe7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:54.755729 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeaaac2-3a58-4670-a082-356fb68fe7cb admin admin] PATH_INFO: `/v3/users/94c78dab3221417c88c59a5feb17a868` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:54.756858 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeaaac2-3a58-4670-a082-356fb68fe7cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=94c78dab3221417c88c59a5feb17a868)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:54.758825 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeaaac2-3a58-4670-a082-356fb68fe7cb admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:54.815040 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:DELETE=6,keystone:SELECT=94 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:54.825251 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-fbeaaac2-3a58-4670-a082-356fb68fe7cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94c78dab3221417c88c59a5feb17a868'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:54.833243 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-fbeaaac2-3a58-4670-a082-356fb68fe7cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94c78dab3221417c88c59a5feb17a868'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:54.834039 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-fbeaaac2-3a58-4670-a082-356fb68fe7cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94c78dab3221417c88c59a5feb17a868'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:54.846725 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-fbeaaac2-3a58-4670-a082-356fb68fe7cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94c78dab3221417c88c59a5feb17a868'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:54.854862 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-fbeaaac2-3a58-4670-a082-356fb68fe7cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94c78dab3221417c88c59a5feb17a868'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:54.860962 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1372/2749] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:52:54 2022] DELETE /identity/v3/users/94c78dab3221417c88c59a5feb17a868 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:52:55.149421 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8991d74-4eaf-4c5a-abcf-d9ca98133bf8 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:55.150867 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-d8991d74-4eaf-4c5a-abcf-d9ca98133bf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:55.171421 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8991d74-4eaf-4c5a-abcf-d9ca98133bf8 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:55.236376 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa43d37a-0b62-4d3f-b3a5-f753a1bf8490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:55.237037 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa43d37a-0b62-4d3f-b3a5-f753a1bf8490 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:55.237612 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa43d37a-0b62-4d3f-b3a5-f753a1bf8490 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:55.237807 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa43d37a-0b62-4d3f-b3a5-f753a1bf8490 admin admin] PATH_INFO: `/v3/projects/aefa392cb6be4436b6120a1fb517e419` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:55.238951 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa43d37a-0b62-4d3f-b3a5-f753a1bf8490 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aefa392cb6be4436b6120a1fb517e419)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:55.240943 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa43d37a-0b62-4d3f-b3a5-f753a1bf8490 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:55.290565 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-aa43d37a-0b62-4d3f-b3a5-f753a1bf8490 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aefa392cb6be4436b6120a1fb517e419', 'request_id': 'req-aa43d37a-0b62-4d3f-b3a5-f753a1bf8490'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:55.297455 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-aa43d37a-0b62-4d3f-b3a5-f753a1bf8490 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aefa392cb6be4436b6120a1fb517e419', 'request_id': 'req-aa43d37a-0b62-4d3f-b3a5-f753a1bf8490'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:55.308081 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-aa43d37a-0b62-4d3f-b3a5-f753a1bf8490 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aefa392cb6be4436b6120a1fb517e419', 'request_id': 'req-aa43d37a-0b62-4d3f-b3a5-f753a1bf8490'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:55.321253 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-aa43d37a-0b62-4d3f-b3a5-f753a1bf8490 admin admin] The token cache is being invalidate because project aefa392cb6be4436b6120a1fb517e419 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:52:55.321578 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-aa43d37a-0b62-4d3f-b3a5-f753a1bf8490 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:55.322207 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-aa43d37a-0b62-4d3f-b3a5-f753a1bf8490 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:55.324797 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1378/2750] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:52:55 2022] DELETE /identity/v3/projects/aefa392cb6be4436b6120a1fb517e419 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:52:55.329693 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50f9f2a-4bb0-463c-99cd-16ef1b4960ce None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:55.330196 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50f9f2a-4bb0-463c-99cd-16ef1b4960ce None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:55.330297 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50f9f2a-4bb0-463c-99cd-16ef1b4960ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:55.351231 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-d50f9f2a-4bb0-463c-99cd-16ef1b4960ce None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:55.352440 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-d50f9f2a-4bb0-463c-99cd-16ef1b4960ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:55.421127 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1373/2751] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:52:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:52:55.486877 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a343e2-257b-4a20-a3b4-5252c4ed6584 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:55.487188 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a343e2-257b-4a20-a3b4-5252c4ed6584 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:55.487464 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a343e2-257b-4a20-a3b4-5252c4ed6584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:55.508008 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-82a343e2-257b-4a20-a3b4-5252c4ed6584 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:55.509231 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-82a343e2-257b-4a20-a3b4-5252c4ed6584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:55.522011 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1379/2752] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:52:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:52:55.526646 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50f9f2a-4bb0-463c-99cd-16ef1b4960ce None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:55.536780 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50f9f2a-4bb0-463c-99cd-16ef1b4960ce None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:55.542432 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5988c6d3-eb24-43eb-9f01-465d040360c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:55.543180 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5988c6d3-eb24-43eb-9f01-465d040360c4 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:55.543550 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5988c6d3-eb24-43eb-9f01-465d040360c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:55.544010 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5988c6d3-eb24-43eb-9f01-465d040360c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:55.544774 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5988c6d3-eb24-43eb-9f01-465d040360c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:52:55.545093 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5988c6d3-eb24-43eb-9f01-465d040360c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:55.546754 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5988c6d3-eb24-43eb-9f01-465d040360c4 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:55.560141 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1374/2753] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Aug 29 22:52:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:52:55.564504 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a343e2-257b-4a20-a3b4-5252c4ed6584 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:55.576415 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a343e2-257b-4a20-a3b4-5252c4ed6584 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:55.581965 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73b812e-3875-4ec0-9058-0949f504cbc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:55.582584 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b812e-3875-4ec0-9058-0949f504cbc4 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:55.582867 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b812e-3875-4ec0-9058-0949f504cbc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:55.583208 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b812e-3875-4ec0-9058-0949f504cbc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:55.583788 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73b812e-3875-4ec0-9058-0949f504cbc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:55.585739 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73b812e-3875-4ec0-9058-0949f504cbc4 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:55.620777 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1380/2754] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:52:55 2022] POST /identity/v3/projects => generated 359 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:52:55.622423 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5988c6d3-eb24-43eb-9f01-465d040360c4 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:55.632941 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5988c6d3-eb24-43eb-9f01-465d040360c4 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:55.710604 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd1564-ecac-4b65-9cdf-3248af087d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:55.711231 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd1564-ecac-4b65-9cdf-3248af087d4f admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:55.711498 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd1564-ecac-4b65-9cdf-3248af087d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:55.711850 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd1564-ecac-4b65-9cdf-3248af087d4f admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:55.712538 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dd1564-ecac-4b65-9cdf-3248af087d4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:55.715675 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dd1564-ecac-4b65-9cdf-3248af087d4f admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:55.741368 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1375/2755] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:52:55 2022] POST /identity/v3/users => generated 280 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:52:55.743991 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73b812e-3875-4ec0-9058-0949f504cbc4 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:55.756368 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73b812e-3875-4ec0-9058-0949f504cbc4 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:55.762123 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc679eda-a251-4a7d-8904-a8f38492774a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:55.762735 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc679eda-a251-4a7d-8904-a8f38492774a admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:55.763011 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc679eda-a251-4a7d-8904-a8f38492774a admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:55.763282 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc679eda-a251-4a7d-8904-a8f38492774a admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:55.764179 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc679eda-a251-4a7d-8904-a8f38492774a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:55.765859 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc679eda-a251-4a7d-8904-a8f38492774a admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:55.778280 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1381/2756] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:52:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:52:55.782545 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd1564-ecac-4b65-9cdf-3248af087d4f admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:55.797624 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd1564-ecac-4b65-9cdf-3248af087d4f admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:55.803580 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603ea777-0e80-49fb-860a-61397b4756b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:55.804271 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ea777-0e80-49fb-860a-61397b4756b6 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:55.804741 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ea777-0e80-49fb-860a-61397b4756b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:55.805163 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ea777-0e80-49fb-860a-61397b4756b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:55.806008 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603ea777-0e80-49fb-860a-61397b4756b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:55.808449 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603ea777-0e80-49fb-860a-61397b4756b6 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:55.822264 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1376/2757] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:52:55 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:52:55.827030 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc679eda-a251-4a7d-8904-a8f38492774a admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:55.838449 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc679eda-a251-4a7d-8904-a8f38492774a admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:55.844361 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6429f7e9-ab81-49d2-8f32-18e3301f2044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:55.845033 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429f7e9-ab81-49d2-8f32-18e3301f2044 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:55.845312 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429f7e9-ab81-49d2-8f32-18e3301f2044 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:55.845643 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429f7e9-ab81-49d2-8f32-18e3301f2044 admin admin] PATH_INFO: `/v3/projects/f29512ee6a0c4a9cabedc3fb1697e47c/users/630ff67670794fd39bd8736ffdf397a3/roles/0c67797d444d4c929b2ccab47c468848` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:55.858203 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:55.861840 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6429f7e9-ab81-49d2-8f32-18e3301f2044 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f29512ee6a0c4a9cabedc3fb1697e47c, user_id=630ff67670794fd39bd8736ffdf397a3, role_id=0c67797d444d4c929b2ccab47c468848)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:55.864955 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6429f7e9-ab81-49d2-8f32-18e3301f2044 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:55.879519 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1382/2758] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:52:55 2022] PUT /identity/v3/projects/f29512ee6a0c4a9cabedc3fb1697e47c/users/630ff67670794fd39bd8736ffdf397a3/roles/0c67797d444d4c929b2ccab47c468848 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:52:55.892164 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391a95d-4913-4672-a6aa-036574a4da1c None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:55.892446 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391a95d-4913-4672-a6aa-036574a4da1c None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:55.892725 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391a95d-4913-4672-a6aa-036574a4da1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:55.921760 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-b391a95d-4913-4672-a6aa-036574a4da1c None None] MFA Rules not processed for user `630ff67670794fd39bd8736ffdf397a3`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:55.923051 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-b391a95d-4913-4672-a6aa-036574a4da1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:55.933132 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:55.992515 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1377/2759] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:52:55 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:52:56.028901 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6429f7e9-ab81-49d2-8f32-18e3301f2044 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:56.030894 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-6429f7e9-ab81-49d2-8f32-18e3301f2044 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:56.090758 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6429f7e9-ab81-49d2-8f32-18e3301f2044 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:56.095637 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020b2fba-f651-44e0-960c-c12349556900 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:56.096553 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b2fba-f651-44e0-960c-c12349556900 service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:56.096831 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b2fba-f651-44e0-960c-c12349556900 service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:56.097105 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b2fba-f651-44e0-960c-c12349556900 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:56.106453 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020b2fba-f651-44e0-960c-c12349556900 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:56.107884 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020b2fba-f651-44e0-960c-c12349556900 service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:56.116906 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1383/2760] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:52:56 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:52:56.133348 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b391a95d-4913-4672-a6aa-036574a4da1c None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:56.201471 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b391a95d-4913-4672-a6aa-036574a4da1c None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:56.206184 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e3c3b-0953-461b-886d-5510fadc2233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:56.206854 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e3c3b-0953-461b-886d-5510fadc2233 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:56.207140 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e3c3b-0953-461b-886d-5510fadc2233 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:56.207416 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e3c3b-0953-461b-886d-5510fadc2233 admin admin] PATH_INFO: `/v3/users/630ff67670794fd39bd8736ffdf397a3` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:56.208644 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572e3c3b-0953-461b-886d-5510fadc2233 admin admin] RBAC: Authorizing `identity:delete_user(user_id=630ff67670794fd39bd8736ffdf397a3)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:56.210668 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572e3c3b-0953-461b-886d-5510fadc2233 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:56.261940 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-572e3c3b-0953-461b-886d-5510fadc2233 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '630ff67670794fd39bd8736ffdf397a3'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:56.270163 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-572e3c3b-0953-461b-886d-5510fadc2233 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '630ff67670794fd39bd8736ffdf397a3'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:56.270968 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-572e3c3b-0953-461b-886d-5510fadc2233 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '630ff67670794fd39bd8736ffdf397a3'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:56.284174 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-572e3c3b-0953-461b-886d-5510fadc2233 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '630ff67670794fd39bd8736ffdf397a3'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:56.294005 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-572e3c3b-0953-461b-886d-5510fadc2233 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '630ff67670794fd39bd8736ffdf397a3'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:56.313675 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1378/2761] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:52:56 2022] DELETE /identity/v3/users/630ff67670794fd39bd8736ffdf397a3 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:52:56.314337 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62516925-6d51-455b-bb3b-2e3baf244883 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:56.314337 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62516925-6d51-455b-bb3b-2e3baf244883 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:56.314337 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62516925-6d51-455b-bb3b-2e3baf244883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:56.331723 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-62516925-6d51-455b-bb3b-2e3baf244883 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:56.333051 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-62516925-6d51-455b-bb3b-2e3baf244883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:56.399801 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1384/2762] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:52:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:52:56.410163 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e3c3b-0953-461b-886d-5510fadc2233 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:56.411606 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-572e3c3b-0953-461b-886d-5510fadc2233 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:56.447717 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:56.473466 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e3c3b-0953-461b-886d-5510fadc2233 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:56.477158 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d51980-ad0b-4eba-9e44-267a9868f026 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:56.477799 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d51980-ad0b-4eba-9e44-267a9868f026 service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:56.478084 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d51980-ad0b-4eba-9e44-267a9868f026 service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:56.478358 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d51980-ad0b-4eba-9e44-267a9868f026 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:56.487742 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d51980-ad0b-4eba-9e44-267a9868f026 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:56.490823 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d51980-ad0b-4eba-9e44-267a9868f026 service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:56.501602 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1379/2763] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:52:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:52:56.784282 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62516925-6d51-455b-bb3b-2e3baf244883 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:56.785785 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-62516925-6d51-455b-bb3b-2e3baf244883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:56.800875 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62516925-6d51-455b-bb3b-2e3baf244883 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:56.808423 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1d3b65-8787-470e-9bf8-2354b04ae1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:56.809146 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d3b65-8787-470e-9bf8-2354b04ae1a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:56.809603 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d3b65-8787-470e-9bf8-2354b04ae1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:56.809954 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d3b65-8787-470e-9bf8-2354b04ae1a1 admin admin] PATH_INFO: `/v3/projects/f29512ee6a0c4a9cabedc3fb1697e47c` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:56.811221 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1d3b65-8787-470e-9bf8-2354b04ae1a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f29512ee6a0c4a9cabedc3fb1697e47c)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:56.813590 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1d3b65-8787-470e-9bf8-2354b04ae1a1 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:56.866950 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-ab1d3b65-8787-470e-9bf8-2354b04ae1a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f29512ee6a0c4a9cabedc3fb1697e47c', 'request_id': 'req-ab1d3b65-8787-470e-9bf8-2354b04ae1a1'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:56.876142 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-ab1d3b65-8787-470e-9bf8-2354b04ae1a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f29512ee6a0c4a9cabedc3fb1697e47c', 'request_id': 'req-ab1d3b65-8787-470e-9bf8-2354b04ae1a1'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:56.882164 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-ab1d3b65-8787-470e-9bf8-2354b04ae1a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f29512ee6a0c4a9cabedc3fb1697e47c', 'request_id': 'req-ab1d3b65-8787-470e-9bf8-2354b04ae1a1'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:56.899556 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-ab1d3b65-8787-470e-9bf8-2354b04ae1a1 admin admin] The token cache is being invalidate because project f29512ee6a0c4a9cabedc3fb1697e47c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:52:56.899916 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-ab1d3b65-8787-470e-9bf8-2354b04ae1a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:56.900878 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-ab1d3b65-8787-470e-9bf8-2354b04ae1a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:52:56.903011 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1385/2764] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:52:56 2022] DELETE /identity/v3/projects/f29512ee6a0c4a9cabedc3fb1697e47c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:52:56.908324 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c4e93c-f455-49e7-95e1-db55fc65ceb8 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:56.908675 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c4e93c-f455-49e7-95e1-db55fc65ceb8 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:56.909184 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c4e93c-f455-49e7-95e1-db55fc65ceb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:56.930951 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-94c4e93c-f455-49e7-95e1-db55fc65ceb8 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:56.932208 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-94c4e93c-f455-49e7-95e1-db55fc65ceb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:57.003299 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1380/2765] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:52:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:52:57.010727 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f111c78-49ae-4ba9-8dc2-57946553a50d None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:57.011030 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f111c78-49ae-4ba9-8dc2-57946553a50d None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:57.011651 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f111c78-49ae-4ba9-8dc2-57946553a50d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:57.035033 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-9f111c78-49ae-4ba9-8dc2-57946553a50d None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:57.036175 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-9f111c78-49ae-4ba9-8dc2-57946553a50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:57.046231 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1386/2766] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:52:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:52:57.050414 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c4e93c-f455-49e7-95e1-db55fc65ceb8 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:57.062593 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c4e93c-f455-49e7-95e1-db55fc65ceb8 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:57.068054 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f8b963-6a56-43b2-be3a-fe35e61faca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:57.068549 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8b963-6a56-43b2-be3a-fe35e61faca2 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:57.068825 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8b963-6a56-43b2-be3a-fe35e61faca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:57.069101 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8b963-6a56-43b2-be3a-fe35e61faca2 admin admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:57.069837 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f8b963-6a56-43b2-be3a-fe35e61faca2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:52:57.070139 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f8b963-6a56-43b2-be3a-fe35e61faca2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:57.071744 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f8b963-6a56-43b2-be3a-fe35e61faca2 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:57.086093 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1381/2767] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Aug 29 22:52:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:52:57.091424 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f111c78-49ae-4ba9-8dc2-57946553a50d None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:57.101636 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f111c78-49ae-4ba9-8dc2-57946553a50d None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:57.107457 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bd9e50-58a3-4e68-8de3-69c9d663cd4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:57.108077 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd9e50-58a3-4e68-8de3-69c9d663cd4d admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:57.108356 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd9e50-58a3-4e68-8de3-69c9d663cd4d admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:57.108628 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd9e50-58a3-4e68-8de3-69c9d663cd4d admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:57.109275 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bd9e50-58a3-4e68-8de3-69c9d663cd4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:57.111243 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bd9e50-58a3-4e68-8de3-69c9d663cd4d admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:57.122433 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:57.149052 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1387/2768] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:52:57 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:52:57.156278 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f8b963-6a56-43b2-be3a-fe35e61faca2 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:57.169537 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f8b963-6a56-43b2-be3a-fe35e61faca2 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:57.235019 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb71f9d3-bf29-4958-a9ff-1087678851dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:57.235776 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71f9d3-bf29-4958-a9ff-1087678851dd admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:57.236156 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71f9d3-bf29-4958-a9ff-1087678851dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:57.236530 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71f9d3-bf29-4958-a9ff-1087678851dd admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:57.237292 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb71f9d3-bf29-4958-a9ff-1087678851dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:57.239351 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb71f9d3-bf29-4958-a9ff-1087678851dd admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:57.266183 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1382/2769] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:52:57 2022] POST /identity/v3/users => generated 287 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:52:57.267439 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bd9e50-58a3-4e68-8de3-69c9d663cd4d admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:57.283462 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bd9e50-58a3-4e68-8de3-69c9d663cd4d admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:57.288828 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08012d61-3058-4f31-84a1-d1473327189c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:57.293541 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08012d61-3058-4f31-84a1-d1473327189c admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:57.293916 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08012d61-3058-4f31-84a1-d1473327189c admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:57.294315 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08012d61-3058-4f31-84a1-d1473327189c admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:57.294997 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08012d61-3058-4f31-84a1-d1473327189c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:57.296850 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08012d61-3058-4f31-84a1-d1473327189c admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:57.309553 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1388/2770] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:52:57.313754 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb71f9d3-bf29-4958-a9ff-1087678851dd admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:57.327285 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb71f9d3-bf29-4958-a9ff-1087678851dd admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:57.333982 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce264ce-1d0a-4eda-99ae-94646cab7e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:57.334703 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce264ce-1d0a-4eda-99ae-94646cab7e0b admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:57.335061 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce264ce-1d0a-4eda-99ae-94646cab7e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:57.335401 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce264ce-1d0a-4eda-99ae-94646cab7e0b admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:57.336110 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce264ce-1d0a-4eda-99ae-94646cab7e0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:57.337905 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce264ce-1d0a-4eda-99ae-94646cab7e0b admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:57.350980 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1383/2771] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:52:57.355528 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08012d61-3058-4f31-84a1-d1473327189c admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:57.367935 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08012d61-3058-4f31-84a1-d1473327189c admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:57.377297 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d924af83-6650-4bbb-aa6a-112da4efe5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:57.378335 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924af83-6650-4bbb-aa6a-112da4efe5ac admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:57.378764 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924af83-6650-4bbb-aa6a-112da4efe5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:57.379502 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924af83-6650-4bbb-aa6a-112da4efe5ac admin admin] PATH_INFO: `/v3/projects/5ad93c70244f4a1baf4434279720bed0/users/b82d7165ce614d8784f6897ca07ae6e3/roles/0c67797d444d4c929b2ccab47c468848` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:57.396182 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d924af83-6650-4bbb-aa6a-112da4efe5ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ad93c70244f4a1baf4434279720bed0, user_id=b82d7165ce614d8784f6897ca07ae6e3, role_id=0c67797d444d4c929b2ccab47c468848)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:57.399007 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d924af83-6650-4bbb-aa6a-112da4efe5ac admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:57.413846 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1389/2772] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:52:57 2022] PUT /identity/v3/projects/5ad93c70244f4a1baf4434279720bed0/users/b82d7165ce614d8784f6897ca07ae6e3/roles/0c67797d444d4c929b2ccab47c468848 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:52:57.419471 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea8c3d7-47e7-4e3f-a88c-4895c44949bc None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:57.420273 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea8c3d7-47e7-4e3f-a88c-4895c44949bc None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:57.420756 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea8c3d7-47e7-4e3f-a88c-4895c44949bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:57.446286 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-eea8c3d7-47e7-4e3f-a88c-4895c44949bc None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:57.447732 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-eea8c3d7-47e7-4e3f-a88c-4895c44949bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:57.486127 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:57.516544 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1384/2773] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:52:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:52:57.529354 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d924af83-6650-4bbb-aa6a-112da4efe5ac admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:57.531334 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-d924af83-6650-4bbb-aa6a-112da4efe5ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:57.597737 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d924af83-6650-4bbb-aa6a-112da4efe5ac admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:57.602361 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919947bc-2a36-4fca-8a25-768ad1107fb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:57.602980 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919947bc-2a36-4fca-8a25-768ad1107fb8 service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:57.603265 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919947bc-2a36-4fca-8a25-768ad1107fb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:57.603543 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919947bc-2a36-4fca-8a25-768ad1107fb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:57.615172 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919947bc-2a36-4fca-8a25-768ad1107fb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:57.616636 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919947bc-2a36-4fca-8a25-768ad1107fb8 service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:57.627496 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1390/2774] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:52:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:52:58.316718 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92920ab0-09ab-4e96-a09e-1d9992407ee1 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:58.317060 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92920ab0-09ab-4e96-a09e-1d9992407ee1 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:58.317358 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92920ab0-09ab-4e96-a09e-1d9992407ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:58.348093 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-92920ab0-09ab-4e96-a09e-1d9992407ee1 None None] MFA Rules not processed for user `b82d7165ce614d8784f6897ca07ae6e3`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:58.349306 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-92920ab0-09ab-4e96-a09e-1d9992407ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:58.427788 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1385/2775] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:52:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:52:58.439461 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919947bc-2a36-4fca-8a25-768ad1107fb8 service neutron] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:52:58.440999 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-919947bc-2a36-4fca-8a25-768ad1107fb8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:58.506424 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919947bc-2a36-4fca-8a25-768ad1107fb8 service neutron] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:52:58.510211 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e3655e-cdf6-470c-87ef-c54969495f2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:52:58.511384 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3655e-cdf6-470c-87ef-c54969495f2a service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:58.511670 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3655e-cdf6-470c-87ef-c54969495f2a service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:58.511936 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3655e-cdf6-470c-87ef-c54969495f2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:58.521748 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e3655e-cdf6-470c-87ef-c54969495f2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:52:58.523185 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e3655e-cdf6-470c-87ef-c54969495f2a service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:52:58.533117 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1391/2776] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:52:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:52:59.910089 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a6bd55-10ac-4a50-9a5e-381bdfdb2454 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:52:59.910622 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a6bd55-10ac-4a50-9a5e-381bdfdb2454 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:52:59.910738 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a6bd55-10ac-4a50-9a5e-381bdfdb2454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:52:59.931186 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-01a6bd55-10ac-4a50-9a5e-381bdfdb2454 None None] MFA Rules not processed for user `b82d7165ce614d8784f6897ca07ae6e3`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:52:59.932424 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-01a6bd55-10ac-4a50-9a5e-381bdfdb2454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:52:59.939815 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1386/2777] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:52:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:53:00.187313 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e3655e-cdf6-470c-87ef-c54969495f2a service cinder] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:00.197564 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e3655e-cdf6-470c-87ef-c54969495f2a service cinder] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:00.203022 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6fa59c-dae9-4186-878e-d928395a5878 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:00.203666 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6fa59c-dae9-4186-878e-d928395a5878 service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:00.204034 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6fa59c-dae9-4186-878e-d928395a5878 service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:00.204374 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6fa59c-dae9-4186-878e-d928395a5878 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:00.206516 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-fd6fa59c-dae9-4186-878e-d928395a5878 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:00.218027 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6fa59c-dae9-4186-878e-d928395a5878 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:00.219737 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6fa59c-dae9-4186-878e-d928395a5878 service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:00.229656 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1392/2778] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:53:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:53:00.362683 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a6bd55-10ac-4a50-9a5e-381bdfdb2454 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:00.364183 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-01a6bd55-10ac-4a50-9a5e-381bdfdb2454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:00.380784 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a6bd55-10ac-4a50-9a5e-381bdfdb2454 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:00.385087 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd9a962-4860-46aa-b3b6-a1ae931cc510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:00.385736 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9a962-4860-46aa-b3b6-a1ae931cc510 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:00.386013 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9a962-4860-46aa-b3b6-a1ae931cc510 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:00.386283 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9a962-4860-46aa-b3b6-a1ae931cc510 admin admin] PATH_INFO: `/v3/users/7dd7900e3f844f36a616d30af45cf1ee` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:00.388162 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd9a962-4860-46aa-b3b6-a1ae931cc510 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dd7900e3f844f36a616d30af45cf1ee)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:00.390110 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd9a962-4860-46aa-b3b6-a1ae931cc510 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:00.444890 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-2dd9a962-4860-46aa-b3b6-a1ae931cc510 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dd7900e3f844f36a616d30af45cf1ee'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:53:00.453183 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-2dd9a962-4860-46aa-b3b6-a1ae931cc510 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dd7900e3f844f36a616d30af45cf1ee'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:53:00.453903 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-2dd9a962-4860-46aa-b3b6-a1ae931cc510 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dd7900e3f844f36a616d30af45cf1ee'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:53:00.467348 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-2dd9a962-4860-46aa-b3b6-a1ae931cc510 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dd7900e3f844f36a616d30af45cf1ee'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:53:00.475094 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-2dd9a962-4860-46aa-b3b6-a1ae931cc510 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dd7900e3f844f36a616d30af45cf1ee'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:53:00.482215 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1387/2779] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:53:00 2022] DELETE /identity/v3/users/7dd7900e3f844f36a616d30af45cf1ee => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:53:00.486770 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb380f2-553f-4859-b075-99a3957caead None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:00.487473 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb380f2-553f-4859-b075-99a3957caead None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:00.487822 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb380f2-553f-4859-b075-99a3957caead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:00.515792 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-5bb380f2-553f-4859-b075-99a3957caead None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:53:00.517128 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-5bb380f2-553f-4859-b075-99a3957caead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:00.570961 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:53:00.591935 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1393/2780] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:53:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:53:00.602419 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd9a962-4860-46aa-b3b6-a1ae931cc510 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:00.604173 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-2dd9a962-4860-46aa-b3b6-a1ae931cc510 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:00.659561 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:53:00.694623 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd9a962-4860-46aa-b3b6-a1ae931cc510 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:00.698547 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b59220f-3d01-4429-a666-bc8360572af0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:00.699344 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59220f-3d01-4429-a666-bc8360572af0 service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:00.699683 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59220f-3d01-4429-a666-bc8360572af0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:00.699959 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59220f-3d01-4429-a666-bc8360572af0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:00.715737 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b59220f-3d01-4429-a666-bc8360572af0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:00.717893 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b59220f-3d01-4429-a666-bc8360572af0 service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:00.730861 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1388/2781] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:53:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:53:01.042273 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb380f2-553f-4859-b075-99a3957caead None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:01.045237 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-5bb380f2-553f-4859-b075-99a3957caead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:01.058864 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb380f2-553f-4859-b075-99a3957caead None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:01.064469 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c1385c-bf7b-40f2-95e5-1b62ecd6a295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:01.065107 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1385c-bf7b-40f2-95e5-1b62ecd6a295 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:01.065418 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1385c-bf7b-40f2-95e5-1b62ecd6a295 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:01.065699 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1385c-bf7b-40f2-95e5-1b62ecd6a295 admin admin] PATH_INFO: `/v3/projects/443b766e29ce4cc6a79da082b0f3c70a` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:01.066832 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c1385c-bf7b-40f2-95e5-1b62ecd6a295 admin admin] RBAC: Authorizing `identity:delete_project(project_id=443b766e29ce4cc6a79da082b0f3c70a)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:01.068796 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c1385c-bf7b-40f2-95e5-1b62ecd6a295 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:01.121535 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-a6c1385c-bf7b-40f2-95e5-1b62ecd6a295 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '443b766e29ce4cc6a79da082b0f3c70a', 'request_id': 'req-a6c1385c-bf7b-40f2-95e5-1b62ecd6a295'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:53:01.128483 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-a6c1385c-bf7b-40f2-95e5-1b62ecd6a295 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '443b766e29ce4cc6a79da082b0f3c70a', 'request_id': 'req-a6c1385c-bf7b-40f2-95e5-1b62ecd6a295'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:53:01.134497 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-a6c1385c-bf7b-40f2-95e5-1b62ecd6a295 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '443b766e29ce4cc6a79da082b0f3c70a', 'request_id': 'req-a6c1385c-bf7b-40f2-95e5-1b62ecd6a295'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:53:01.148439 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-a6c1385c-bf7b-40f2-95e5-1b62ecd6a295 admin admin] The token cache is being invalidate because project 443b766e29ce4cc6a79da082b0f3c70a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:53:01.148664 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-a6c1385c-bf7b-40f2-95e5-1b62ecd6a295 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:53:01.149282 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-a6c1385c-bf7b-40f2-95e5-1b62ecd6a295 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:53:01.150944 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1394/2782] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:53:01 2022] DELETE /identity/v3/projects/443b766e29ce4cc6a79da082b0f3c70a => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:53:01.156060 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b59220f-3d01-4429-a666-bc8360572af0 service neutron] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:01.170304 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b59220f-3d01-4429-a666-bc8360572af0 service neutron] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:01.236264 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8399b8ca-4cb5-42e0-923a-16aca8fd220b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:01.236911 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8399b8ca-4cb5-42e0-923a-16aca8fd220b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:01.237200 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8399b8ca-4cb5-42e0-923a-16aca8fd220b admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:01.237514 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8399b8ca-4cb5-42e0-923a-16aca8fd220b admin admin] PATH_INFO: `/v3/users/755af1a7d16c4a2bb2c66e9ea92892a3` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:01.238681 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8399b8ca-4cb5-42e0-923a-16aca8fd220b admin admin] RBAC: Authorizing `identity:delete_user(user_id=755af1a7d16c4a2bb2c66e9ea92892a3)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:01.240636 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8399b8ca-4cb5-42e0-923a-16aca8fd220b admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:01.298040 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-8399b8ca-4cb5-42e0-923a-16aca8fd220b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '755af1a7d16c4a2bb2c66e9ea92892a3'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:53:01.304969 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-8399b8ca-4cb5-42e0-923a-16aca8fd220b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '755af1a7d16c4a2bb2c66e9ea92892a3'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:53:01.305732 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-8399b8ca-4cb5-42e0-923a-16aca8fd220b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '755af1a7d16c4a2bb2c66e9ea92892a3'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:53:01.318975 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-8399b8ca-4cb5-42e0-923a-16aca8fd220b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '755af1a7d16c4a2bb2c66e9ea92892a3'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:53:01.328099 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-8399b8ca-4cb5-42e0-923a-16aca8fd220b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '755af1a7d16c4a2bb2c66e9ea92892a3'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:53:01.334406 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1389/2783] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:53:01 2022] DELETE /identity/v3/users/755af1a7d16c4a2bb2c66e9ea92892a3 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:53:01.620213 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c1385c-bf7b-40f2-95e5-1b62ecd6a295 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:01.620213 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-a6c1385c-bf7b-40f2-95e5-1b62ecd6a295 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:01.636160 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c1385c-bf7b-40f2-95e5-1b62ecd6a295 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:01.705725 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecd61f5-0ace-48c5-ae83-1f0fd410584c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:01.706345 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd61f5-0ace-48c5-ae83-1f0fd410584c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:01.706622 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd61f5-0ace-48c5-ae83-1f0fd410584c admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:01.707119 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd61f5-0ace-48c5-ae83-1f0fd410584c admin admin] PATH_INFO: `/v3/projects/ebb9f9e9010545d7a9f955f953952bc5` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:01.708976 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecd61f5-0ace-48c5-ae83-1f0fd410584c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebb9f9e9010545d7a9f955f953952bc5)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:01.711122 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecd61f5-0ace-48c5-ae83-1f0fd410584c admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:01.774723 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-9ecd61f5-0ace-48c5-ae83-1f0fd410584c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebb9f9e9010545d7a9f955f953952bc5', 'request_id': 'req-9ecd61f5-0ace-48c5-ae83-1f0fd410584c'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:53:01.783549 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-9ecd61f5-0ace-48c5-ae83-1f0fd410584c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebb9f9e9010545d7a9f955f953952bc5', 'request_id': 'req-9ecd61f5-0ace-48c5-ae83-1f0fd410584c'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:53:01.789670 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-9ecd61f5-0ace-48c5-ae83-1f0fd410584c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebb9f9e9010545d7a9f955f953952bc5', 'request_id': 'req-9ecd61f5-0ace-48c5-ae83-1f0fd410584c'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:53:01.817428 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:53:01.822214 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-9ecd61f5-0ace-48c5-ae83-1f0fd410584c admin admin] The token cache is being invalidate because project ebb9f9e9010545d7a9f955f953952bc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:53:01.822885 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-9ecd61f5-0ace-48c5-ae83-1f0fd410584c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:53:01.823679 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-9ecd61f5-0ace-48c5-ae83-1f0fd410584c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:53:01.829721 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1395/2784] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:53:01 2022] DELETE /identity/v3/projects/ebb9f9e9010545d7a9f955f953952bc5 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:53:01.831581 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e01cf-aadc-48f1-acbd-6b96e6756d7a None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:01.832786 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e01cf-aadc-48f1-acbd-6b96e6756d7a None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:01.833975 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e01cf-aadc-48f1-acbd-6b96e6756d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:01.854820 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-9c6e01cf-aadc-48f1-acbd-6b96e6756d7a None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:53:01.856741 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-9c6e01cf-aadc-48f1-acbd-6b96e6756d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:01.914761 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:53:01.927948 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1390/2785] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:53:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:53:01.936600 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56736db-c3d7-4096-ad94-f9487904c54b None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:01.936937 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56736db-c3d7-4096-ad94-f9487904c54b None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:01.937216 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56736db-c3d7-4096-ad94-f9487904c54b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:01.958133 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-c56736db-c3d7-4096-ad94-f9487904c54b None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:53:01.959281 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-c56736db-c3d7-4096-ad94-f9487904c54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:01.968305 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1396/2786] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:53:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:53:01.972264 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e01cf-aadc-48f1-acbd-6b96e6756d7a None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:01.982496 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e01cf-aadc-48f1-acbd-6b96e6756d7a None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:01.987620 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f286e669-d31a-4a48-8aa1-0a97af267f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:01.988266 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286e669-d31a-4a48-8aa1-0a97af267f92 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:01.988585 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286e669-d31a-4a48-8aa1-0a97af267f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:01.988870 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286e669-d31a-4a48-8aa1-0a97af267f92 admin admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:01.989684 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f286e669-d31a-4a48-8aa1-0a97af267f92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:53:01.990524 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f286e669-d31a-4a48-8aa1-0a97af267f92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:01.992146 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f286e669-d31a-4a48-8aa1-0a97af267f92 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:02.007259 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1391/2787] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Aug 29 22:53:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:53:02.010027 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56736db-c3d7-4096-ad94-f9487904c54b None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:02.020558 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56736db-c3d7-4096-ad94-f9487904c54b None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:02.025279 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b5d721-39f9-4cef-be09-6ad02c4d2c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:02.025908 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b5d721-39f9-4cef-be09-6ad02c4d2c94 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:02.026188 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b5d721-39f9-4cef-be09-6ad02c4d2c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:02.026457 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b5d721-39f9-4cef-be09-6ad02c4d2c94 admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:02.027558 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b5d721-39f9-4cef-be09-6ad02c4d2c94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:02.029515 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b5d721-39f9-4cef-be09-6ad02c4d2c94 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:02.070992 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1397/2788] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:53:02 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:53:02.076003 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f286e669-d31a-4a48-8aa1-0a97af267f92 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:02.090621 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f286e669-d31a-4a48-8aa1-0a97af267f92 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:02.164124 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802fe269-d7a4-4d7a-b9f7-5db0fbe89108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:02.164861 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802fe269-d7a4-4d7a-b9f7-5db0fbe89108 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:02.165116 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802fe269-d7a4-4d7a-b9f7-5db0fbe89108 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:02.165419 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802fe269-d7a4-4d7a-b9f7-5db0fbe89108 admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:02.166155 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802fe269-d7a4-4d7a-b9f7-5db0fbe89108 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:02.168383 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802fe269-d7a4-4d7a-b9f7-5db0fbe89108 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:02.191214 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1392/2789] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:53:02 2022] POST /identity/v3/users => generated 287 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:53:02.195469 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b5d721-39f9-4cef-be09-6ad02c4d2c94 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:02.207330 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b5d721-39f9-4cef-be09-6ad02c4d2c94 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:02.212217 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41b0b11-f780-4583-b767-d52a7275c967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:02.212766 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b0b11-f780-4583-b767-d52a7275c967 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:02.213050 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b0b11-f780-4583-b767-d52a7275c967 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:02.213343 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b0b11-f780-4583-b767-d52a7275c967 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:02.213998 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41b0b11-f780-4583-b767-d52a7275c967 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:02.215729 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41b0b11-f780-4583-b767-d52a7275c967 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:02.228919 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1398/2790] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:53:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:53:02.230296 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802fe269-d7a4-4d7a-b9f7-5db0fbe89108 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:02.241760 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802fe269-d7a4-4d7a-b9f7-5db0fbe89108 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:02.247134 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17de5464-0161-4c09-91c1-4b444b42f001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:02.247747 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de5464-0161-4c09-91c1-4b444b42f001 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:02.248029 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de5464-0161-4c09-91c1-4b444b42f001 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:02.248304 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de5464-0161-4c09-91c1-4b444b42f001 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:02.248959 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17de5464-0161-4c09-91c1-4b444b42f001 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:02.250590 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17de5464-0161-4c09-91c1-4b444b42f001 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:02.262874 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1393/2791] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:53:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:53:02.267947 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41b0b11-f780-4583-b767-d52a7275c967 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:02.283535 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41b0b11-f780-4583-b767-d52a7275c967 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:02.290291 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edf023b-0c7c-4fb7-93ea-4b4cd9ef67c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:02.291447 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf023b-0c7c-4fb7-93ea-4b4cd9ef67c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:02.291961 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf023b-0c7c-4fb7-93ea-4b4cd9ef67c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:02.292377 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf023b-0c7c-4fb7-93ea-4b4cd9ef67c3 admin admin] PATH_INFO: `/v3/projects/21c76894c3254340aaff6b2b1c026724/users/71f3d135ceab4cf9a45da00b4b2ae752/roles/0c67797d444d4c929b2ccab47c468848` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:02.315527 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edf023b-0c7c-4fb7-93ea-4b4cd9ef67c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21c76894c3254340aaff6b2b1c026724, user_id=71f3d135ceab4cf9a45da00b4b2ae752, role_id=0c67797d444d4c929b2ccab47c468848)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:02.318368 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edf023b-0c7c-4fb7-93ea-4b4cd9ef67c3 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:02.332023 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1399/2792] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:53:02 2022] PUT /identity/v3/projects/21c76894c3254340aaff6b2b1c026724/users/71f3d135ceab4cf9a45da00b4b2ae752/roles/0c67797d444d4c929b2ccab47c468848 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:53:02.343383 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23438633-cef7-4363-abeb-21af16dcd318 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:02.343697 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23438633-cef7-4363-abeb-21af16dcd318 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:02.343991 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23438633-cef7-4363-abeb-21af16dcd318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:02.373488 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-23438633-cef7-4363-abeb-21af16dcd318 None None] MFA Rules not processed for user `71f3d135ceab4cf9a45da00b4b2ae752`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:53:02.374724 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-23438633-cef7-4363-abeb-21af16dcd318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:02.443662 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1394/2793] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:53:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:53:02.454928 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edf023b-0c7c-4fb7-93ea-4b4cd9ef67c3 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:02.456716 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-5edf023b-0c7c-4fb7-93ea-4b4cd9ef67c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:02.520977 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edf023b-0c7c-4fb7-93ea-4b4cd9ef67c3 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:02.524699 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a793172-f525-45b0-9612-9b39ec259280 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:02.525308 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a793172-f525-45b0-9612-9b39ec259280 service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:02.525637 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a793172-f525-45b0-9612-9b39ec259280 service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:02.525914 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a793172-f525-45b0-9612-9b39ec259280 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:02.535637 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a793172-f525-45b0-9612-9b39ec259280 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:02.537478 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a793172-f525-45b0-9612-9b39ec259280 service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:02.548282 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1400/2794] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:53:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:53:02.571541 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23438633-cef7-4363-abeb-21af16dcd318 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:02.632232 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:53:02.648690 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23438633-cef7-4363-abeb-21af16dcd318 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:02.654684 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33d762c-72c0-4bdb-bb7b-238f837a6152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:02.655846 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d762c-72c0-4bdb-bb7b-238f837a6152 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:02.656200 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d762c-72c0-4bdb-bb7b-238f837a6152 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:02.656541 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d762c-72c0-4bdb-bb7b-238f837a6152 admin admin] PATH_INFO: `/v3/users/71f3d135ceab4cf9a45da00b4b2ae752` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:02.657827 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33d762c-72c0-4bdb-bb7b-238f837a6152 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71f3d135ceab4cf9a45da00b4b2ae752)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:02.660195 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33d762c-72c0-4bdb-bb7b-238f837a6152 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:02.711802 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-c33d762c-72c0-4bdb-bb7b-238f837a6152 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71f3d135ceab4cf9a45da00b4b2ae752'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:53:02.719903 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-c33d762c-72c0-4bdb-bb7b-238f837a6152 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71f3d135ceab4cf9a45da00b4b2ae752'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:53:02.720635 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-c33d762c-72c0-4bdb-bb7b-238f837a6152 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71f3d135ceab4cf9a45da00b4b2ae752'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:53:02.734724 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-c33d762c-72c0-4bdb-bb7b-238f837a6152 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71f3d135ceab4cf9a45da00b4b2ae752'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:53:02.742924 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-c33d762c-72c0-4bdb-bb7b-238f837a6152 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71f3d135ceab4cf9a45da00b4b2ae752'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:53:02.749188 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1395/2795] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:53:02 2022] DELETE /identity/v3/users/71f3d135ceab4cf9a45da00b4b2ae752 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:53:02.753749 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d1ea4-2571-458b-b716-073becf9fb1b None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:02.754609 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d1ea4-2571-458b-b716-073becf9fb1b None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:02.754891 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d1ea4-2571-458b-b716-073becf9fb1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:02.774405 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-9c1d1ea4-2571-458b-b716-073becf9fb1b None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:53:02.775637 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-9c1d1ea4-2571-458b-b716-073becf9fb1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:02.847163 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1401/2796] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:53:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:53:02.860084 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33d762c-72c0-4bdb-bb7b-238f837a6152 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:02.861582 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-c33d762c-72c0-4bdb-bb7b-238f837a6152 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:02.941089 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33d762c-72c0-4bdb-bb7b-238f837a6152 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:02.945101 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f77c00-253d-4575-bf25-36179a460407 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:02.945764 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f77c00-253d-4575-bf25-36179a460407 service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:02.946039 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f77c00-253d-4575-bf25-36179a460407 service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:02.946305 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f77c00-253d-4575-bf25-36179a460407 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:02.958687 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f77c00-253d-4575-bf25-36179a460407 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:02.960081 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f77c00-253d-4575-bf25-36179a460407 service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:02.974067 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1396/2797] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:53:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:53:03.276592 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d1ea4-2571-458b-b716-073becf9fb1b None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:03.278205 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-9c1d1ea4-2571-458b-b716-073becf9fb1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:03.291783 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d1ea4-2571-458b-b716-073becf9fb1b None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:03.297688 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e46094-b394-4415-9cea-36f267b73f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:03.298452 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e46094-b394-4415-9cea-36f267b73f72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:03.298870 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e46094-b394-4415-9cea-36f267b73f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:03.299157 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e46094-b394-4415-9cea-36f267b73f72 admin admin] PATH_INFO: `/v3/projects/21c76894c3254340aaff6b2b1c026724` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:03.300715 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e46094-b394-4415-9cea-36f267b73f72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21c76894c3254340aaff6b2b1c026724)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:03.302916 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e46094-b394-4415-9cea-36f267b73f72 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:03.345215 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:53:03.357150 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-d7e46094-b394-4415-9cea-36f267b73f72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21c76894c3254340aaff6b2b1c026724', 'request_id': 'req-d7e46094-b394-4415-9cea-36f267b73f72'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:53:03.364220 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-d7e46094-b394-4415-9cea-36f267b73f72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21c76894c3254340aaff6b2b1c026724', 'request_id': 'req-d7e46094-b394-4415-9cea-36f267b73f72'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:53:03.370145 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-d7e46094-b394-4415-9cea-36f267b73f72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21c76894c3254340aaff6b2b1c026724', 'request_id': 'req-d7e46094-b394-4415-9cea-36f267b73f72'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:53:03.384882 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-d7e46094-b394-4415-9cea-36f267b73f72 admin admin] The token cache is being invalidate because project 21c76894c3254340aaff6b2b1c026724 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:53:03.385232 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-d7e46094-b394-4415-9cea-36f267b73f72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:53:03.385822 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-d7e46094-b394-4415-9cea-36f267b73f72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:53:03.387451 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1402/2798] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:53:03 2022] DELETE /identity/v3/projects/21c76894c3254340aaff6b2b1c026724 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:53:03.392340 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0844959-017b-4138-abad-bcc435c47ade None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:03.392846 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0844959-017b-4138-abad-bcc435c47ade None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:03.392968 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0844959-017b-4138-abad-bcc435c47ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:03.413688 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-b0844959-017b-4138-abad-bcc435c47ade None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:53:03.414916 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-b0844959-017b-4138-abad-bcc435c47ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:03.479328 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1397/2799] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:53:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:53:03.488952 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2b14f-d59f-4f5a-b47b-9d452b866127 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:03.489267 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2b14f-d59f-4f5a-b47b-9d452b866127 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:03.489580 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2b14f-d59f-4f5a-b47b-9d452b866127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:03.510281 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-6dc2b14f-d59f-4f5a-b47b-9d452b866127 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:53:03.512044 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-6dc2b14f-d59f-4f5a-b47b-9d452b866127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:03.520558 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1403/2800] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:53:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:53:03.524702 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0844959-017b-4138-abad-bcc435c47ade None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:03.536157 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0844959-017b-4138-abad-bcc435c47ade None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:03.540944 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5136eb-0cdb-4033-a250-7a775833116f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:03.541701 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5136eb-0cdb-4033-a250-7a775833116f admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:03.541985 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5136eb-0cdb-4033-a250-7a775833116f admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:03.542258 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5136eb-0cdb-4033-a250-7a775833116f admin admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:03.543060 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5136eb-0cdb-4033-a250-7a775833116f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:53:03.543367 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5136eb-0cdb-4033-a250-7a775833116f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:03.545005 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5136eb-0cdb-4033-a250-7a775833116f admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:03.556988 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1398/2801] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Aug 29 22:53:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:53:03.562252 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc2b14f-d59f-4f5a-b47b-9d452b866127 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:03.571827 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc2b14f-d59f-4f5a-b47b-9d452b866127 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:03.577971 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e628d3a6-b4f6-41c8-acde-c302f3185333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:03.578602 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e628d3a6-b4f6-41c8-acde-c302f3185333 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:03.578875 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e628d3a6-b4f6-41c8-acde-c302f3185333 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:03.579162 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e628d3a6-b4f6-41c8-acde-c302f3185333 admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:03.579806 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e628d3a6-b4f6-41c8-acde-c302f3185333 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:03.581769 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e628d3a6-b4f6-41c8-acde-c302f3185333 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:03.609282 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1404/2802] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:53:03 2022] POST /identity/v3/projects => generated 397 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:53:03.613545 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5136eb-0cdb-4033-a250-7a775833116f admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:03.618755 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:53:03.626286 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5136eb-0cdb-4033-a250-7a775833116f admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:03.685725 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e09989-ad37-4295-8230-e3807dbb8818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:03.686344 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e09989-ad37-4295-8230-e3807dbb8818 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:03.686627 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e09989-ad37-4295-8230-e3807dbb8818 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:03.686907 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e09989-ad37-4295-8230-e3807dbb8818 admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:03.687682 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e09989-ad37-4295-8230-e3807dbb8818 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:03.689634 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e09989-ad37-4295-8230-e3807dbb8818 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:03.712806 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1399/2803] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:53:03 2022] POST /identity/v3/users => generated 299 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:53:03.726480 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e628d3a6-b4f6-41c8-acde-c302f3185333 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:03.727938 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e628d3a6-b4f6-41c8-acde-c302f3185333 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:03.733006 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d54e79f-d2df-4097-9fa3-8dc052ea05df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:03.733642 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d54e79f-d2df-4097-9fa3-8dc052ea05df admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:03.733916 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d54e79f-d2df-4097-9fa3-8dc052ea05df admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:03.734184 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d54e79f-d2df-4097-9fa3-8dc052ea05df admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:03.734829 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d54e79f-d2df-4097-9fa3-8dc052ea05df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:03.736480 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d54e79f-d2df-4097-9fa3-8dc052ea05df admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:03.747341 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1405/2804] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:53:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:53:03.751493 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e09989-ad37-4295-8230-e3807dbb8818 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:03.762965 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e09989-ad37-4295-8230-e3807dbb8818 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:03.767637 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a372070-e42b-428d-8f07-0c0da6ed2cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:03.768243 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a372070-e42b-428d-8f07-0c0da6ed2cb0 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:03.768625 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a372070-e42b-428d-8f07-0c0da6ed2cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:03.768914 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a372070-e42b-428d-8f07-0c0da6ed2cb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:03.769590 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a372070-e42b-428d-8f07-0c0da6ed2cb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:03.771247 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a372070-e42b-428d-8f07-0c0da6ed2cb0 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:03.782420 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1400/2805] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:53:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:53:03.786541 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d54e79f-d2df-4097-9fa3-8dc052ea05df admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:03.797677 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d54e79f-d2df-4097-9fa3-8dc052ea05df admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:03.802312 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a655a-cce9-4fb5-a4f4-57e09f763665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:03.802957 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a655a-cce9-4fb5-a4f4-57e09f763665 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:03.803231 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a655a-cce9-4fb5-a4f4-57e09f763665 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:03.803508 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a655a-cce9-4fb5-a4f4-57e09f763665 admin admin] PATH_INFO: `/v3/projects/057ab65d4b0649c28cb47edfb0349fb7/users/9818b511a9544ed49029d6f950f0954c/roles/0c67797d444d4c929b2ccab47c468848` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:03.819360 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77a655a-cce9-4fb5-a4f4-57e09f763665 admin admin] RBAC: Authorizing `identity:create_grant(project_id=057ab65d4b0649c28cb47edfb0349fb7, user_id=9818b511a9544ed49029d6f950f0954c, role_id=0c67797d444d4c929b2ccab47c468848)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:03.822132 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77a655a-cce9-4fb5-a4f4-57e09f763665 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:03.835995 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1406/2806] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:53:03 2022] PUT /identity/v3/projects/057ab65d4b0649c28cb47edfb0349fb7/users/9818b511a9544ed49029d6f950f0954c/roles/0c67797d444d4c929b2ccab47c468848 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:53:03.846593 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836845a-36bd-4765-8de7-a1be119e9460 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:03.846960 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836845a-36bd-4765-8de7-a1be119e9460 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:03.847308 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836845a-36bd-4765-8de7-a1be119e9460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:03.877205 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-2836845a-36bd-4765-8de7-a1be119e9460 None None] MFA Rules not processed for user `9818b511a9544ed49029d6f950f0954c`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:53:03.878475 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-2836845a-36bd-4765-8de7-a1be119e9460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:03.954573 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1401/2807] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:53:03 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:53:03.967704 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a655a-cce9-4fb5-a4f4-57e09f763665 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:03.969663 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-d77a655a-cce9-4fb5-a4f4-57e09f763665 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:04.037057 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a655a-cce9-4fb5-a4f4-57e09f763665 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:04.041573 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d64eda2-1888-4bbf-8c7c-13df0082b614 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:04.042190 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64eda2-1888-4bbf-8c7c-13df0082b614 service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:04.042469 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64eda2-1888-4bbf-8c7c-13df0082b614 service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:04.043310 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64eda2-1888-4bbf-8c7c-13df0082b614 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:04.053643 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d64eda2-1888-4bbf-8c7c-13df0082b614 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:04.055096 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d64eda2-1888-4bbf-8c7c-13df0082b614 service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:04.068789 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1407/2808] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:53:03 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:53:09.117533 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2836845a-36bd-4765-8de7-a1be119e9460 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:09.187503 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2836845a-36bd-4765-8de7-a1be119e9460 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:09.192153 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1cd8b6-e05b-45e5-8186-9e67d8724be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:09.192859 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1cd8b6-e05b-45e5-8186-9e67d8724be9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:09.193228 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1cd8b6-e05b-45e5-8186-9e67d8724be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:09.193516 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1cd8b6-e05b-45e5-8186-9e67d8724be9 admin admin] PATH_INFO: `/v3/users/9818b511a9544ed49029d6f950f0954c` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:09.194889 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1cd8b6-e05b-45e5-8186-9e67d8724be9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9818b511a9544ed49029d6f950f0954c)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:09.197313 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1cd8b6-e05b-45e5-8186-9e67d8724be9 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:09.215600 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:53:09.254516 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-1b1cd8b6-e05b-45e5-8186-9e67d8724be9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9818b511a9544ed49029d6f950f0954c'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:53:09.262218 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-1b1cd8b6-e05b-45e5-8186-9e67d8724be9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9818b511a9544ed49029d6f950f0954c'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:53:09.262938 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-1b1cd8b6-e05b-45e5-8186-9e67d8724be9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9818b511a9544ed49029d6f950f0954c'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:53:09.276413 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-1b1cd8b6-e05b-45e5-8186-9e67d8724be9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9818b511a9544ed49029d6f950f0954c'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:53:09.285423 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-1b1cd8b6-e05b-45e5-8186-9e67d8724be9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9818b511a9544ed49029d6f950f0954c'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:53:09.291552 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1402/2809] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:53:09 2022] DELETE /identity/v3/users/9818b511a9544ed49029d6f950f0954c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:53:09.296432 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc34554-c31a-403e-90df-57e33ef41927 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:09.296890 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc34554-c31a-403e-90df-57e33ef41927 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:09.297116 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc34554-c31a-403e-90df-57e33ef41927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:09.316598 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-ebc34554-c31a-403e-90df-57e33ef41927 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:53:09.317860 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-ebc34554-c31a-403e-90df-57e33ef41927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:09.379833 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1408/2810] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:53:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:53:09.390099 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1cd8b6-e05b-45e5-8186-9e67d8724be9 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:09.391514 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-1b1cd8b6-e05b-45e5-8186-9e67d8724be9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:09.455590 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1cd8b6-e05b-45e5-8186-9e67d8724be9 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:09.459366 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5b39c2-6ed8-470b-b245-6a8aa8d91172 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:09.459984 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b39c2-6ed8-470b-b245-6a8aa8d91172 service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:09.460268 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b39c2-6ed8-470b-b245-6a8aa8d91172 service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:09.460551 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b39c2-6ed8-470b-b245-6a8aa8d91172 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:09.470890 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5b39c2-6ed8-470b-b245-6a8aa8d91172 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:09.472324 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5b39c2-6ed8-470b-b245-6a8aa8d91172 service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:09.482649 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1403/2811] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:53:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:53:09.753986 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc34554-c31a-403e-90df-57e33ef41927 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:09.755425 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-ebc34554-c31a-403e-90df-57e33ef41927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:09.762947 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:53:09.770367 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc34554-c31a-403e-90df-57e33ef41927 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:09.777692 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b59c858-f074-400d-86cb-7a0aa1aae8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:09.778841 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59c858-f074-400d-86cb-7a0aa1aae8f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:09.778841 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59c858-f074-400d-86cb-7a0aa1aae8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:09.779116 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59c858-f074-400d-86cb-7a0aa1aae8f9 admin admin] PATH_INFO: `/v3/projects/057ab65d4b0649c28cb47edfb0349fb7` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:09.780270 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b59c858-f074-400d-86cb-7a0aa1aae8f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=057ab65d4b0649c28cb47edfb0349fb7)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:09.782458 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b59c858-f074-400d-86cb-7a0aa1aae8f9 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:09.831147 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-0b59c858-f074-400d-86cb-7a0aa1aae8f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '057ab65d4b0649c28cb47edfb0349fb7', 'request_id': 'req-0b59c858-f074-400d-86cb-7a0aa1aae8f9'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:53:09.837586 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-0b59c858-f074-400d-86cb-7a0aa1aae8f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '057ab65d4b0649c28cb47edfb0349fb7', 'request_id': 'req-0b59c858-f074-400d-86cb-7a0aa1aae8f9'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:53:09.844595 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-0b59c858-f074-400d-86cb-7a0aa1aae8f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '057ab65d4b0649c28cb47edfb0349fb7', 'request_id': 'req-0b59c858-f074-400d-86cb-7a0aa1aae8f9'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:53:09.856726 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-0b59c858-f074-400d-86cb-7a0aa1aae8f9 admin admin] The token cache is being invalidate because project 057ab65d4b0649c28cb47edfb0349fb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:53:09.857018 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-0b59c858-f074-400d-86cb-7a0aa1aae8f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:53:09.857657 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-0b59c858-f074-400d-86cb-7a0aa1aae8f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:53:09.859139 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1409/2812] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:53:09 2022] DELETE /identity/v3/projects/057ab65d4b0649c28cb47edfb0349fb7 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:53:09.864159 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e2a82-1d42-41a3-9d19-c06787745196 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:09.864451 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e2a82-1d42-41a3-9d19-c06787745196 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:09.864760 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e2a82-1d42-41a3-9d19-c06787745196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:09.884185 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-012e2a82-1d42-41a3-9d19-c06787745196 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:53:09.885436 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-012e2a82-1d42-41a3-9d19-c06787745196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:09.946008 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1404/2813] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:53:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:53:09.954284 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cfb6b0-4a42-4210-9d9e-7c7ae50e1369 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:09.954573 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cfb6b0-4a42-4210-9d9e-7c7ae50e1369 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:09.954852 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cfb6b0-4a42-4210-9d9e-7c7ae50e1369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:09.975506 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-f8cfb6b0-4a42-4210-9d9e-7c7ae50e1369 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:53:09.976732 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-f8cfb6b0-4a42-4210-9d9e-7c7ae50e1369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:09.985584 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1410/2814] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:53:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:53:09.989924 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012e2a82-1d42-41a3-9d19-c06787745196 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:10.002188 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012e2a82-1d42-41a3-9d19-c06787745196 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:10.006842 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2122b-bf59-43a6-b16c-b98c443d0f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:10.007453 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2122b-bf59-43a6-b16c-b98c443d0f65 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:10.007736 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2122b-bf59-43a6-b16c-b98c443d0f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:10.008038 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2122b-bf59-43a6-b16c-b98c443d0f65 admin admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:10.008767 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd2122b-bf59-43a6-b16c-b98c443d0f65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:53:10.008985 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd2122b-bf59-43a6-b16c-b98c443d0f65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:10.010600 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd2122b-bf59-43a6-b16c-b98c443d0f65 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:10.022642 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1405/2815] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Aug 29 22:53:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:53:10.027187 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cfb6b0-4a42-4210-9d9e-7c7ae50e1369 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:10.037525 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cfb6b0-4a42-4210-9d9e-7c7ae50e1369 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:10.042267 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41593505-a926-4a7c-9444-5b01d181a784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:10.043551 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41593505-a926-4a7c-9444-5b01d181a784 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:10.043834 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41593505-a926-4a7c-9444-5b01d181a784 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:10.044105 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41593505-a926-4a7c-9444-5b01d181a784 admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:10.044781 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41593505-a926-4a7c-9444-5b01d181a784 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:10.046739 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41593505-a926-4a7c-9444-5b01d181a784 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:10.080299 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1411/2816] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:53:10 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:53:10.081597 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2122b-bf59-43a6-b16c-b98c443d0f65 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:10.092767 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2122b-bf59-43a6-b16c-b98c443d0f65 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:10.126755 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:53:10.165508 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325bb08a-4c5c-42bf-85ef-20ada90e69a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:10.166176 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325bb08a-4c5c-42bf-85ef-20ada90e69a7 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:10.167306 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325bb08a-4c5c-42bf-85ef-20ada90e69a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:10.167926 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325bb08a-4c5c-42bf-85ef-20ada90e69a7 admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:10.168938 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325bb08a-4c5c-42bf-85ef-20ada90e69a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:10.171190 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325bb08a-4c5c-42bf-85ef-20ada90e69a7 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:10.195357 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1406/2817] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:53:10 2022] POST /identity/v3/users => generated 292 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:53:10.199886 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41593505-a926-4a7c-9444-5b01d181a784 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:10.212583 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41593505-a926-4a7c-9444-5b01d181a784 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:10.218306 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166b4795-422f-464d-9977-0f84923a1550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:10.219063 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b4795-422f-464d-9977-0f84923a1550 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:10.219443 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b4795-422f-464d-9977-0f84923a1550 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:10.219762 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b4795-422f-464d-9977-0f84923a1550 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:10.220537 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166b4795-422f-464d-9977-0f84923a1550 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:10.222465 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166b4795-422f-464d-9977-0f84923a1550 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:10.234267 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1412/2818] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:53:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:53:10.239234 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325bb08a-4c5c-42bf-85ef-20ada90e69a7 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:10.250742 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325bb08a-4c5c-42bf-85ef-20ada90e69a7 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:10.256004 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f6b53-3976-4296-ade0-c726a2d64c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:10.256700 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f6b53-3976-4296-ade0-c726a2d64c06 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:10.257025 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f6b53-3976-4296-ade0-c726a2d64c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:10.257464 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f6b53-3976-4296-ade0-c726a2d64c06 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:10.258240 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147f6b53-3976-4296-ade0-c726a2d64c06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:10.259989 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147f6b53-3976-4296-ade0-c726a2d64c06 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:10.279144 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1407/2819] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:53:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:53:10.282765 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166b4795-422f-464d-9977-0f84923a1550 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:10.293771 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166b4795-422f-464d-9977-0f84923a1550 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:10.300799 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4405f3c1-ad70-475b-93c2-363d4753ceac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:10.301758 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405f3c1-ad70-475b-93c2-363d4753ceac admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:10.302130 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405f3c1-ad70-475b-93c2-363d4753ceac admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:10.302408 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405f3c1-ad70-475b-93c2-363d4753ceac admin admin] PATH_INFO: `/v3/projects/45a76b747d25436581faddec6a442a27/users/b85a9c2ea6214ba592f4677d94dcc0ca/roles/0c67797d444d4c929b2ccab47c468848` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:10.319444 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4405f3c1-ad70-475b-93c2-363d4753ceac admin admin] RBAC: Authorizing `identity:create_grant(project_id=45a76b747d25436581faddec6a442a27, user_id=b85a9c2ea6214ba592f4677d94dcc0ca, role_id=0c67797d444d4c929b2ccab47c468848)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:10.322176 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4405f3c1-ad70-475b-93c2-363d4753ceac admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:10.337461 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1413/2820] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:53:10 2022] PUT /identity/v3/projects/45a76b747d25436581faddec6a442a27/users/b85a9c2ea6214ba592f4677d94dcc0ca/roles/0c67797d444d4c929b2ccab47c468848 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:53:10.342654 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae8003a-971d-4188-b307-e02905514c6b None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:10.342935 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae8003a-971d-4188-b307-e02905514c6b None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:10.343209 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae8003a-971d-4188-b307-e02905514c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:10.363306 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-5ae8003a-971d-4188-b307-e02905514c6b None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:53:10.364531 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-5ae8003a-971d-4188-b307-e02905514c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:10.433066 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1408/2821] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:53:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:53:10.443575 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4405f3c1-ad70-475b-93c2-363d4753ceac admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:10.445341 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-4405f3c1-ad70-475b-93c2-363d4753ceac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:10.510183 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4405f3c1-ad70-475b-93c2-363d4753ceac admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:10.514205 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c679cb5d-0664-45db-947d-22f2ff07a818 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:10.514814 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c679cb5d-0664-45db-947d-22f2ff07a818 service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:10.515119 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c679cb5d-0664-45db-947d-22f2ff07a818 service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:10.515344 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c679cb5d-0664-45db-947d-22f2ff07a818 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:10.525472 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c679cb5d-0664-45db-947d-22f2ff07a818 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:10.527586 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c679cb5d-0664-45db-947d-22f2ff07a818 service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:10.537881 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1414/2822] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:53:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:53:13.377863 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd261b-99e5-415a-a713-73b75cc8d60c None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:13.378422 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd261b-99e5-415a-a713-73b75cc8d60c None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:13.378422 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd261b-99e5-415a-a713-73b75cc8d60c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:13.400616 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-7edd261b-99e5-415a-a713-73b75cc8d60c None None] MFA Rules not processed for user `b82d7165ce614d8784f6897ca07ae6e3`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:53:13.401967 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-7edd261b-99e5-415a-a713-73b75cc8d60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:13.497698 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1409/2823] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:53:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:53:13.646161 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c679cb5d-0664-45db-947d-22f2ff07a818 service neutron] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:13.647678 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-c679cb5d-0664-45db-947d-22f2ff07a818 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:13.663406 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c679cb5d-0664-45db-947d-22f2ff07a818 service neutron] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:13.669375 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33adfff7-f6af-4931-9438-b444b912977b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:13.670102 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33adfff7-f6af-4931-9438-b444b912977b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:13.670449 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33adfff7-f6af-4931-9438-b444b912977b admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:13.670793 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33adfff7-f6af-4931-9438-b444b912977b admin admin] PATH_INFO: `/v3/users/32c45e38db8a472ab8b0aea274e49c21` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:13.672002 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33adfff7-f6af-4931-9438-b444b912977b admin admin] RBAC: Authorizing `identity:delete_user(user_id=32c45e38db8a472ab8b0aea274e49c21)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:13.674213 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33adfff7-f6af-4931-9438-b444b912977b admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:13.698867 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:53:13.738788 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-33adfff7-f6af-4931-9438-b444b912977b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32c45e38db8a472ab8b0aea274e49c21'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:53:13.748836 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-33adfff7-f6af-4931-9438-b444b912977b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32c45e38db8a472ab8b0aea274e49c21'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:53:13.750282 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-33adfff7-f6af-4931-9438-b444b912977b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32c45e38db8a472ab8b0aea274e49c21'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:53:13.762068 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-33adfff7-f6af-4931-9438-b444b912977b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32c45e38db8a472ab8b0aea274e49c21'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:53:13.763435 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-33adfff7-f6af-4931-9438-b444b912977b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32c45e38db8a472ab8b0aea274e49c21'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:53:13.789524 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1415/2824] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:53:13 2022] DELETE /identity/v3/users/32c45e38db8a472ab8b0aea274e49c21 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:53:13.799271 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887c0fb-43fd-4046-a858-157b4f841fbc None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:13.799701 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887c0fb-43fd-4046-a858-157b4f841fbc None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:13.800080 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887c0fb-43fd-4046-a858-157b4f841fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:13.822676 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-c887c0fb-43fd-4046-a858-157b4f841fbc None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:53:13.825783 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-c887c0fb-43fd-4046-a858-157b4f841fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:13.883500 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:53:13.907229 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1410/2825] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:53:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:53:13.920505 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33adfff7-f6af-4931-9438-b444b912977b admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:13.922196 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-33adfff7-f6af-4931-9438-b444b912977b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:14.055423 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33adfff7-f6af-4931-9438-b444b912977b admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:14.060715 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93becb69-e6bc-4902-92d2-52ba9f9b665f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:14.061364 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93becb69-e6bc-4902-92d2-52ba9f9b665f service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:14.061700 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93becb69-e6bc-4902-92d2-52ba9f9b665f service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:14.061910 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93becb69-e6bc-4902-92d2-52ba9f9b665f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:14.073585 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93becb69-e6bc-4902-92d2-52ba9f9b665f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:14.075390 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93becb69-e6bc-4902-92d2-52ba9f9b665f service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:14.086833 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1416/2826] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:53:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:53:14.877193 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c887c0fb-43fd-4046-a858-157b4f841fbc None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:14.882243 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-c887c0fb-43fd-4046-a858-157b4f841fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:14.928806 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c887c0fb-43fd-4046-a858-157b4f841fbc None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:14.958743 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92326749-a532-40b1-9b53-5ce0d79d00f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:14.959426 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92326749-a532-40b1-9b53-5ce0d79d00f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:14.961310 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92326749-a532-40b1-9b53-5ce0d79d00f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:14.961639 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92326749-a532-40b1-9b53-5ce0d79d00f3 admin admin] PATH_INFO: `/v3/projects/644a79a84cdb443286c58323b1c0ff50` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:14.966049 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92326749-a532-40b1-9b53-5ce0d79d00f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=644a79a84cdb443286c58323b1c0ff50)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:14.973281 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92326749-a532-40b1-9b53-5ce0d79d00f3 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:15.076305 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-92326749-a532-40b1-9b53-5ce0d79d00f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '644a79a84cdb443286c58323b1c0ff50', 'request_id': 'req-92326749-a532-40b1-9b53-5ce0d79d00f3'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:53:15.084144 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-92326749-a532-40b1-9b53-5ce0d79d00f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '644a79a84cdb443286c58323b1c0ff50', 'request_id': 'req-92326749-a532-40b1-9b53-5ce0d79d00f3'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:53:15.091876 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-92326749-a532-40b1-9b53-5ce0d79d00f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '644a79a84cdb443286c58323b1c0ff50', 'request_id': 'req-92326749-a532-40b1-9b53-5ce0d79d00f3'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:53:15.108551 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-92326749-a532-40b1-9b53-5ce0d79d00f3 admin admin] The token cache is being invalidate because project 644a79a84cdb443286c58323b1c0ff50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:53:15.108852 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-92326749-a532-40b1-9b53-5ce0d79d00f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:53:15.109545 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-92326749-a532-40b1-9b53-5ce0d79d00f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:53:15.111731 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1411/2827] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:53:14 2022] DELETE /identity/v3/projects/644a79a84cdb443286c58323b1c0ff50 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:53:15.116514 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c49024d-f294-46b3-97db-8dd14c2b6922 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:15.117017 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c49024d-f294-46b3-97db-8dd14c2b6922 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:15.117234 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c49024d-f294-46b3-97db-8dd14c2b6922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:15.146283 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-1c49024d-f294-46b3-97db-8dd14c2b6922 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:53:15.148495 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-1c49024d-f294-46b3-97db-8dd14c2b6922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:15.251312 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1417/2828] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:53:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:53:15.260916 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccad31a-0681-4850-b5ad-a239053b5926 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:15.261930 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccad31a-0681-4850-b5ad-a239053b5926 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:15.262343 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccad31a-0681-4850-b5ad-a239053b5926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:15.305141 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-dccad31a-0681-4850-b5ad-a239053b5926 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:53:15.306438 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-dccad31a-0681-4850-b5ad-a239053b5926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:15.321980 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1412/2829] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:53:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:53:15.322681 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c49024d-f294-46b3-97db-8dd14c2b6922 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:15.335665 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c49024d-f294-46b3-97db-8dd14c2b6922 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:15.344030 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a7ed16-5ccc-4063-b83c-8994362ea615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:15.344679 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7ed16-5ccc-4063-b83c-8994362ea615 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:15.344961 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7ed16-5ccc-4063-b83c-8994362ea615 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:15.345235 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7ed16-5ccc-4063-b83c-8994362ea615 admin admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:15.345934 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a7ed16-5ccc-4063-b83c-8994362ea615 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:53:15.346265 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a7ed16-5ccc-4063-b83c-8994362ea615 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:15.347951 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a7ed16-5ccc-4063-b83c-8994362ea615 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:15.367757 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1418/2830] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Aug 29 22:53:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 22:53:15.372642 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccad31a-0681-4850-b5ad-a239053b5926 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:15.383742 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccad31a-0681-4850-b5ad-a239053b5926 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:15.391834 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2767afb7-1490-4684-943d-9ef38243aca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:15.392480 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767afb7-1490-4684-943d-9ef38243aca6 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:15.392760 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767afb7-1490-4684-943d-9ef38243aca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:15.393041 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767afb7-1490-4684-943d-9ef38243aca6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:15.393742 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2767afb7-1490-4684-943d-9ef38243aca6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:15.396633 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2767afb7-1490-4684-943d-9ef38243aca6 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:15.439881 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1413/2831] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:53:15 2022] POST /identity/v3/projects => generated 383 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:53:15.444375 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a7ed16-5ccc-4063-b83c-8994362ea615 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:15.464131 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a7ed16-5ccc-4063-b83c-8994362ea615 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:15.502212 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:53:15.551002 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c458c658-2ec7-4f17-9308-934584772c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:15.551641 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458c658-2ec7-4f17-9308-934584772c0a admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:15.552221 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458c658-2ec7-4f17-9308-934584772c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:15.552221 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458c658-2ec7-4f17-9308-934584772c0a admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:15.552821 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c458c658-2ec7-4f17-9308-934584772c0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:15.554948 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c458c658-2ec7-4f17-9308-934584772c0a admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:15.585351 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1419/2832] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:53:15 2022] POST /identity/v3/users => generated 292 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:53:15.590505 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2767afb7-1490-4684-943d-9ef38243aca6 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:15.602594 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2767afb7-1490-4684-943d-9ef38243aca6 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:15.608558 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32b7989-06ea-4981-ba6e-522e23b19a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:15.609322 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b7989-06ea-4981-ba6e-522e23b19a25 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:15.609748 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b7989-06ea-4981-ba6e-522e23b19a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:15.610084 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b7989-06ea-4981-ba6e-522e23b19a25 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:15.610856 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32b7989-06ea-4981-ba6e-522e23b19a25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:15.612587 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32b7989-06ea-4981-ba6e-522e23b19a25 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:15.628241 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c458c658-2ec7-4f17-9308-934584772c0a admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:15.628690 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1414/2833] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:53:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:53:15.638756 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c458c658-2ec7-4f17-9308-934584772c0a admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:15.647286 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49332701-d00b-4fe4-b7cf-f5287ebe26da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:15.647905 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49332701-d00b-4fe4-b7cf-f5287ebe26da admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:15.648181 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49332701-d00b-4fe4-b7cf-f5287ebe26da admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:15.648450 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49332701-d00b-4fe4-b7cf-f5287ebe26da admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:15.649100 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49332701-d00b-4fe4-b7cf-f5287ebe26da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:15.650784 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49332701-d00b-4fe4-b7cf-f5287ebe26da admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:15.654574 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a961d-3f56-4a9f-ae92-f4628a64d56a None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:15.654948 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a961d-3f56-4a9f-ae92-f4628a64d56a None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:15.655326 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a961d-3f56-4a9f-ae92-f4628a64d56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:15.663328 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1420/2834] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:53:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:53:15.667243 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49332701-d00b-4fe4-b7cf-f5287ebe26da admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:15.679887 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49332701-d00b-4fe4-b7cf-f5287ebe26da admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:15.684765 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95ec88a-019e-4907-a774-9846eac49894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:15.685643 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ec88a-019e-4907-a774-9846eac49894 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:15.685936 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ec88a-019e-4907-a774-9846eac49894 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:15.686189 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ec88a-019e-4907-a774-9846eac49894 admin admin] PATH_INFO: `/v3/projects/1d1a46654ecd4493bc3b20bd4531c74b/users/867eedc8b4ba4cea9b309befd39fe097/roles/0c67797d444d4c929b2ccab47c468848` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:15.695254 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-064a961d-3f56-4a9f-ae92-f4628a64d56a None None] MFA Rules not processed for user `b85a9c2ea6214ba592f4677d94dcc0ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:53:15.696828 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-064a961d-3f56-4a9f-ae92-f4628a64d56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:15.709593 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95ec88a-019e-4907-a774-9846eac49894 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d1a46654ecd4493bc3b20bd4531c74b, user_id=867eedc8b4ba4cea9b309befd39fe097, role_id=0c67797d444d4c929b2ccab47c468848)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:15.712473 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95ec88a-019e-4907-a774-9846eac49894 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:15.732844 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1421/2835] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:53:15 2022] PUT /identity/v3/projects/1d1a46654ecd4493bc3b20bd4531c74b/users/867eedc8b4ba4cea9b309befd39fe097/roles/0c67797d444d4c929b2ccab47c468848 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:53:15.737795 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93fe89-680d-4815-be9f-ba874efa8e00 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:15.738384 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93fe89-680d-4815-be9f-ba874efa8e00 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:15.738986 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93fe89-680d-4815-be9f-ba874efa8e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:15.770898 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-5b93fe89-680d-4815-be9f-ba874efa8e00 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:53:15.772348 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-5b93fe89-680d-4815-be9f-ba874efa8e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:15.845379 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1415/2836] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:53:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:53:15.847210 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064a961d-3f56-4a9f-ae92-f4628a64d56a None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:15.848945 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-064a961d-3f56-4a9f-ae92-f4628a64d56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:15.855577 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1422/2837] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:53:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:53:15.875432 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b93fe89-680d-4815-be9f-ba874efa8e00 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:15.878589 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-5b93fe89-680d-4815-be9f-ba874efa8e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:15.896826 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064a961d-3f56-4a9f-ae92-f4628a64d56a None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:15.903812 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca59d25b-65ed-4344-9308-b0d6d095be5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:15.904743 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca59d25b-65ed-4344-9308-b0d6d095be5e admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:15.905139 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca59d25b-65ed-4344-9308-b0d6d095be5e admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:15.907409 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca59d25b-65ed-4344-9308-b0d6d095be5e admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:15.908329 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca59d25b-65ed-4344-9308-b0d6d095be5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:15.910944 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca59d25b-65ed-4344-9308-b0d6d095be5e admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:15.932563 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:53:15.964397 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1416/2838] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:53:15 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:53:15.970547 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca59d25b-65ed-4344-9308-b0d6d095be5e admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:16.007247 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b93fe89-680d-4815-be9f-ba874efa8e00 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:16.081097 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:53:16.084056 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca59d25b-65ed-4344-9308-b0d6d095be5e admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:16.095575 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e376af-dfb2-471c-acd3-6074097ab62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:16.096127 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e376af-dfb2-471c-acd3-6074097ab62e admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:16.096407 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e376af-dfb2-471c-acd3-6074097ab62e admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:16.096680 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e376af-dfb2-471c-acd3-6074097ab62e admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:16.098610 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e376af-dfb2-471c-acd3-6074097ab62e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:16.101426 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e376af-dfb2-471c-acd3-6074097ab62e admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:16.103227 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bb1621-0e5f-40d3-b229-964d80c0a77b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:16.104046 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bb1621-0e5f-40d3-b229-964d80c0a77b service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:16.104446 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bb1621-0e5f-40d3-b229-964d80c0a77b service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:16.105939 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bb1621-0e5f-40d3-b229-964d80c0a77b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:16.118696 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bb1621-0e5f-40d3-b229-964d80c0a77b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:16.121780 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bb1621-0e5f-40d3-b229-964d80c0a77b service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:16.139982 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1417/2839] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:53:15 2022] POST /identity/v3/users => generated 299 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:53:16.140654 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e376af-dfb2-471c-acd3-6074097ab62e admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:16.154904 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e376af-dfb2-471c-acd3-6074097ab62e admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:16.157799 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1423/2840] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:53:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:53:16.175186 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d950cef-6a25-41b1-a97b-b12cedefaab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:16.175824 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d950cef-6a25-41b1-a97b-b12cedefaab5 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:16.176096 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d950cef-6a25-41b1-a97b-b12cedefaab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:16.176368 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d950cef-6a25-41b1-a97b-b12cedefaab5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:16.177217 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d950cef-6a25-41b1-a97b-b12cedefaab5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:16.179416 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d950cef-6a25-41b1-a97b-b12cedefaab5 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:16.193970 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1418/2841] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:53:16 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:53:16.199383 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bb1621-0e5f-40d3-b229-964d80c0a77b service neutron] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:16.215177 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bb1621-0e5f-40d3-b229-964d80c0a77b service neutron] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:16.230102 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7679fc7-6304-4fff-87ba-f84d8421758f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:16.230942 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7679fc7-6304-4fff-87ba-f84d8421758f admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:16.231319 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7679fc7-6304-4fff-87ba-f84d8421758f admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:16.231852 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7679fc7-6304-4fff-87ba-f84d8421758f admin admin] PATH_INFO: `/v3/projects/21c93015487a42418e2a86ac10129fac/users/877e1c1c464a4b4d87b7ef485a0c7a17/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:16.266932 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7679fc7-6304-4fff-87ba-f84d8421758f admin admin] RBAC: Authorizing `identity:create_grant(project_id=21c93015487a42418e2a86ac10129fac, user_id=877e1c1c464a4b4d87b7ef485a0c7a17, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:16.271434 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7679fc7-6304-4fff-87ba-f84d8421758f admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:16.301532 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1424/2842] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:53:16 2022] PUT /identity/v3/projects/21c93015487a42418e2a86ac10129fac/users/877e1c1c464a4b4d87b7ef485a0c7a17/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:53:16.310243 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d950cef-6a25-41b1-a97b-b12cedefaab5 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:16.323689 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d950cef-6a25-41b1-a97b-b12cedefaab5 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:16.415878 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be5b50a-184a-4104-b488-4450ad435ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:16.416629 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be5b50a-184a-4104-b488-4450ad435ab5 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:16.417010 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be5b50a-184a-4104-b488-4450ad435ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:16.418175 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be5b50a-184a-4104-b488-4450ad435ab5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:16.418939 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be5b50a-184a-4104-b488-4450ad435ab5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:16.420914 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be5b50a-184a-4104-b488-4450ad435ab5 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:16.434637 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1419/2843] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:53:16 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:53:16.438704 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7679fc7-6304-4fff-87ba-f84d8421758f admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:16.452945 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7679fc7-6304-4fff-87ba-f84d8421758f admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:16.460663 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce5b6af-a9b5-454f-a2bc-8e3497093e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:16.461499 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5b6af-a9b5-454f-a2bc-8e3497093e5e admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:16.461660 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5b6af-a9b5-454f-a2bc-8e3497093e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:16.461897 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5b6af-a9b5-454f-a2bc-8e3497093e5e admin admin] PATH_INFO: `/v3/projects/21c93015487a42418e2a86ac10129fac/users/877e1c1c464a4b4d87b7ef485a0c7a17/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:16.465516 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce5b6af-a9b5-454f-a2bc-8e3497093e5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=21c93015487a42418e2a86ac10129fac, user_id=877e1c1c464a4b4d87b7ef485a0c7a17, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:16.470306 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce5b6af-a9b5-454f-a2bc-8e3497093e5e admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:16.492594 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1425/2844] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:53:16 2022] PUT /identity/v3/projects/21c93015487a42418e2a86ac10129fac/users/877e1c1c464a4b4d87b7ef485a0c7a17/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:53:16.979738 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e7fce2-e409-4323-8552-6853a985a773 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:16.981033 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e7fce2-e409-4323-8552-6853a985a773 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:16.981210 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e7fce2-e409-4323-8552-6853a985a773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:17.015934 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-21e7fce2-e409-4323-8552-6853a985a773 None None] MFA Rules not processed for user `867eedc8b4ba4cea9b309befd39fe097`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:53:17.019017 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-21e7fce2-e409-4323-8552-6853a985a773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:17.109567 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:53:17.118077 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1420/2845] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:53:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:53:17.135077 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce5b6af-a9b5-454f-a2bc-8e3497093e5e admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:17.139472 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-0ce5b6af-a9b5-454f-a2bc-8e3497093e5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:17.243868 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce5b6af-a9b5-454f-a2bc-8e3497093e5e admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:17.249035 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e63085-9f86-4224-86e0-200792060c9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:17.249191 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e63085-9f86-4224-86e0-200792060c9c service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:17.249445 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e63085-9f86-4224-86e0-200792060c9c service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:17.249687 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e63085-9f86-4224-86e0-200792060c9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:17.259670 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e63085-9f86-4224-86e0-200792060c9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:17.261147 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e63085-9f86-4224-86e0-200792060c9c service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:17.282500 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1426/2846] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:53:17 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:53:18.826708 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5630be1-fa97-4210-ae6c-1d7c93264bdf None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:18.827311 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5630be1-fa97-4210-ae6c-1d7c93264bdf None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:18.827311 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5630be1-fa97-4210-ae6c-1d7c93264bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:18.850814 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-c5630be1-fa97-4210-ae6c-1d7c93264bdf None None] MFA Rules not processed for user `867eedc8b4ba4cea9b309befd39fe097`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:53:18.852164 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-c5630be1-fa97-4210-ae6c-1d7c93264bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:18.860553 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1421/2847] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:53:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:53:23.738648 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f6f57b-24bb-4fe2-a1c6-f4d923221fdf None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:23.739194 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f6f57b-24bb-4fe2-a1c6-f4d923221fdf None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:23.739194 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f6f57b-24bb-4fe2-a1c6-f4d923221fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:23.779980 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-74f6f57b-24bb-4fe2-a1c6-f4d923221fdf None None] MFA Rules not processed for user `877e1c1c464a4b4d87b7ef485a0c7a17`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:53:23.781502 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-74f6f57b-24bb-4fe2-a1c6-f4d923221fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:23.929711 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:53:23.952406 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1427/2848] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:53:23 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:53:23.963628 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5630be1-fa97-4210-ae6c-1d7c93264bdf None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:23.965488 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-c5630be1-fa97-4210-ae6c-1d7c93264bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:24.110494 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5630be1-fa97-4210-ae6c-1d7c93264bdf None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:24.114343 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05de5838-b440-4727-8fce-865b308deee9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5c4e692fd714354b96bd3ef4fcecdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:24.115026 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de5838-b440-4727-8fce-865b308deee9 service glance] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:24.115309 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de5838-b440-4727-8fce-865b308deee9 service glance] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:24.115582 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de5838-b440-4727-8fce-865b308deee9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:24.194037 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05de5838-b440-4727-8fce-865b308deee9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:24.202613 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05de5838-b440-4727-8fce-865b308deee9 service glance] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:24.236110 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1422/2849] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:53:23 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:53:24.400847 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84633a7d-ef75-4255-ae2f-22d5954e33dd None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:24.402228 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84633a7d-ef75-4255-ae2f-22d5954e33dd None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:24.402648 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84633a7d-ef75-4255-ae2f-22d5954e33dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:24.426988 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-84633a7d-ef75-4255-ae2f-22d5954e33dd None None] MFA Rules not processed for user `e49a4666712746d098ace9e1cb0bf07c`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:53:24.428328 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-84633a7d-ef75-4255-ae2f-22d5954e33dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:24.513860 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1428/2850] 10.222.0.47 () {58 vars in 1009 bytes} [Mon Aug 29 22:53:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:53:24.568631 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05de5838-b440-4727-8fce-865b308deee9 service glance] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:24.570147 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-05de5838-b440-4727-8fce-865b308deee9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:24.674162 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05de5838-b440-4727-8fce-865b308deee9 service glance] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:24.679272 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d351f064-a68b-41aa-a4c3-1f988ba742fa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '388d8dea2edf4fb888d42ca878c1434d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:24.680079 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351f064-a68b-41aa-a4c3-1f988ba742fa service swift] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:24.680421 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351f064-a68b-41aa-a4c3-1f988ba742fa service swift] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:24.680780 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351f064-a68b-41aa-a4c3-1f988ba742fa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:24.689467 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d351f064-a68b-41aa-a4c3-1f988ba742fa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:24.691080 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d351f064-a68b-41aa-a4c3-1f988ba742fa service swift] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:24.699282 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1423/2851] 10.222.0.47 () {60 vars in 1384 bytes} [Mon Aug 29 22:53:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 22:53:30.337980 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed6a0b-a8e7-4ea5-8b57-9296ddcb58f3 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:30.338510 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed6a0b-a8e7-4ea5-8b57-9296ddcb58f3 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:30.338606 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed6a0b-a8e7-4ea5-8b57-9296ddcb58f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:30.379245 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-6eed6a0b-a8e7-4ea5-8b57-9296ddcb58f3 None None] MFA Rules not processed for user `e49a4666712746d098ace9e1cb0bf07c`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:53:30.380827 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-6eed6a0b-a8e7-4ea5-8b57-9296ddcb58f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:30.389799 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1429/2852] 10.222.0.47 () {58 vars in 1009 bytes} [Mon Aug 29 22:53:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:53:30.405184 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d351f064-a68b-41aa-a4c3-1f988ba742fa service swift] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:30.419561 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d351f064-a68b-41aa-a4c3-1f988ba742fa service swift] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:30.427031 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc1f6e-6c54-41f5-ba73-812bcf7a4da4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '388d8dea2edf4fb888d42ca878c1434d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:30.428135 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc1f6e-6c54-41f5-ba73-812bcf7a4da4 service swift] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:30.428566 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc1f6e-6c54-41f5-ba73-812bcf7a4da4 service swift] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:30.429002 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc1f6e-6c54-41f5-ba73-812bcf7a4da4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:30.435950 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:53:30.438635 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cc1f6e-6c54-41f5-ba73-812bcf7a4da4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:30.440636 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cc1f6e-6c54-41f5-ba73-812bcf7a4da4 service swift] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:30.450257 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1424/2853] 10.222.0.47 () {60 vars in 1384 bytes} [Mon Aug 29 22:53:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 22:53:35.244452 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b5784-74f6-40e1-9692-017c64450472 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:35.244887 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b5784-74f6-40e1-9692-017c64450472 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:35.244982 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b5784-74f6-40e1-9692-017c64450472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:35.282257 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-da5b5784-74f6-40e1-9692-017c64450472 None None] MFA Rules not processed for user `b85a9c2ea6214ba592f4677d94dcc0ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:53:35.283983 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-da5b5784-74f6-40e1-9692-017c64450472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:35.295932 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1430/2854] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:53:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:53:36.882405 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc1f6e-6c54-41f5-ba73-812bcf7a4da4 service swift] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:36.885398 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-24cc1f6e-6c54-41f5-ba73-812bcf7a4da4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:37.030863 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc1f6e-6c54-41f5-ba73-812bcf7a4da4 service swift] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:37.038114 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3742fc51-a846-4f36-94b5-a59aedd80adc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296cbef772104e078971ba93aa2e022c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:37.039213 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742fc51-a846-4f36-94b5-a59aedd80adc service placement] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:37.039704 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742fc51-a846-4f36-94b5-a59aedd80adc service placement] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:37.040186 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742fc51-a846-4f36-94b5-a59aedd80adc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:37.042990 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-3742fc51-a846-4f36-94b5-a59aedd80adc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:37.057609 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3742fc51-a846-4f36-94b5-a59aedd80adc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:37.060374 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3742fc51-a846-4f36-94b5-a59aedd80adc service placement] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:37.073970 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1425/2855] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:53:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:53:45.273850 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=39 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:53:47.067125 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=43 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:53:50.940603 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61806bef-57fd-4e43-828d-5b8eed65f30a None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:50.941122 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61806bef-57fd-4e43-828d-5b8eed65f30a None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:50.941122 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61806bef-57fd-4e43-828d-5b8eed65f30a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:50.962820 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-61806bef-57fd-4e43-828d-5b8eed65f30a None None] MFA Rules not processed for user `e49a4666712746d098ace9e1cb0bf07c`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:53:50.964157 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-61806bef-57fd-4e43-828d-5b8eed65f30a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:50.972494 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1431/2856] 10.222.0.47 () {58 vars in 1009 bytes} [Mon Aug 29 22:53:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:53:50.989728 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3742fc51-a846-4f36-94b5-a59aedd80adc service placement] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:51.006510 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3742fc51-a846-4f36-94b5-a59aedd80adc service placement] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:51.012307 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885ef87-5c69-4f03-bd60-a78d13f5577e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '388d8dea2edf4fb888d42ca878c1434d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:51.012998 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885ef87-5c69-4f03-bd60-a78d13f5577e service swift] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:51.013390 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885ef87-5c69-4f03-bd60-a78d13f5577e service swift] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:51.013655 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885ef87-5c69-4f03-bd60-a78d13f5577e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:51.022978 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7885ef87-5c69-4f03-bd60-a78d13f5577e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:51.024751 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7885ef87-5c69-4f03-bd60-a78d13f5577e service swift] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:51.034753 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1426/2857] 10.222.0.47 () {60 vars in 1384 bytes} [Mon Aug 29 22:53:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 22:53:53.029461 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921545bd-fb1c-4b16-b2ce-f31af3798523 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:53.030074 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921545bd-fb1c-4b16-b2ce-f31af3798523 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:53.030328 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921545bd-fb1c-4b16-b2ce-f31af3798523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:53.054179 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-921545bd-fb1c-4b16-b2ce-f31af3798523 None None] MFA Rules not processed for user `e49a4666712746d098ace9e1cb0bf07c`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:53:53.055571 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-921545bd-fb1c-4b16-b2ce-f31af3798523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:53.065743 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1432/2858] 10.222.0.47 () {58 vars in 967 bytes} [Mon Aug 29 22:53:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:53:53.089739 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885ef87-5c69-4f03-bd60-a78d13f5577e service swift] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:53.104132 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885ef87-5c69-4f03-bd60-a78d13f5577e service swift] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:53.110098 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c08719a-32a7-4e70-b119-b1eebb9cbd9a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '388d8dea2edf4fb888d42ca878c1434d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:53.110716 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08719a-32a7-4e70-b119-b1eebb9cbd9a service swift] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:53.110996 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08719a-32a7-4e70-b119-b1eebb9cbd9a service swift] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:53.111272 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08719a-32a7-4e70-b119-b1eebb9cbd9a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:53.121755 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c08719a-32a7-4e70-b119-b1eebb9cbd9a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:53.124020 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c08719a-32a7-4e70-b119-b1eebb9cbd9a service swift] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:53.133632 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1427/2859] 10.222.0.47 () {60 vars in 1384 bytes} [Mon Aug 29 22:53:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 22:53:55.456322 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921545bd-fb1c-4b16-b2ce-f31af3798523 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:55.457977 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-921545bd-fb1c-4b16-b2ce-f31af3798523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:55.626620 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921545bd-fb1c-4b16-b2ce-f31af3798523 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:55.633548 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d162b48-1530-40d9-867c-a894af30cb32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:55.634318 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d162b48-1530-40d9-867c-a894af30cb32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:55.637380 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d162b48-1530-40d9-867c-a894af30cb32 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:55.637380 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d162b48-1530-40d9-867c-a894af30cb32 admin admin] PATH_INFO: `/v3/users/b82d7165ce614d8784f6897ca07ae6e3` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:55.637380 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d162b48-1530-40d9-867c-a894af30cb32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b82d7165ce614d8784f6897ca07ae6e3)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:55.639789 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d162b48-1530-40d9-867c-a894af30cb32 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:55.692694 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-5d162b48-1530-40d9-867c-a894af30cb32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b82d7165ce614d8784f6897ca07ae6e3'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:53:55.700848 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-5d162b48-1530-40d9-867c-a894af30cb32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b82d7165ce614d8784f6897ca07ae6e3'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:53:55.701632 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-5d162b48-1530-40d9-867c-a894af30cb32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b82d7165ce614d8784f6897ca07ae6e3'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:53:55.721637 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-5d162b48-1530-40d9-867c-a894af30cb32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b82d7165ce614d8784f6897ca07ae6e3'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:53:55.722426 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-5d162b48-1530-40d9-867c-a894af30cb32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b82d7165ce614d8784f6897ca07ae6e3'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:53:55.749619 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1433/2860] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:53:55 2022] DELETE /identity/v3/users/b82d7165ce614d8784f6897ca07ae6e3 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:53:55.944427 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c08719a-32a7-4e70-b119-b1eebb9cbd9a service swift] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:55.963089 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c08719a-32a7-4e70-b119-b1eebb9cbd9a service swift] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:56.035177 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ca4712-3b51-45db-94a0-56bfda082563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:56.035816 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca4712-3b51-45db-94a0-56bfda082563 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:56.036090 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca4712-3b51-45db-94a0-56bfda082563 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:56.036359 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca4712-3b51-45db-94a0-56bfda082563 admin admin] PATH_INFO: `/v3/projects/5ad93c70244f4a1baf4434279720bed0` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:56.037517 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ca4712-3b51-45db-94a0-56bfda082563 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ad93c70244f4a1baf4434279720bed0)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:56.039546 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ca4712-3b51-45db-94a0-56bfda082563 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:56.099468 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-11ca4712-3b51-45db-94a0-56bfda082563 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ad93c70244f4a1baf4434279720bed0', 'request_id': 'req-11ca4712-3b51-45db-94a0-56bfda082563'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:53:56.107805 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-11ca4712-3b51-45db-94a0-56bfda082563 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ad93c70244f4a1baf4434279720bed0', 'request_id': 'req-11ca4712-3b51-45db-94a0-56bfda082563'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:53:56.116387 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-11ca4712-3b51-45db-94a0-56bfda082563 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ad93c70244f4a1baf4434279720bed0', 'request_id': 'req-11ca4712-3b51-45db-94a0-56bfda082563'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:53:56.130990 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-11ca4712-3b51-45db-94a0-56bfda082563 admin admin] The token cache is being invalidate because project 5ad93c70244f4a1baf4434279720bed0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:53:56.131427 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-11ca4712-3b51-45db-94a0-56bfda082563 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:53:56.132132 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-11ca4712-3b51-45db-94a0-56bfda082563 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:53:56.133678 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1428/2861] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:53:55 2022] DELETE /identity/v3/projects/5ad93c70244f4a1baf4434279720bed0 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:53:56.139132 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9016623a-c628-44bb-af59-f5084757ea84 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:56.139420 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9016623a-c628-44bb-af59-f5084757ea84 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:56.139696 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9016623a-c628-44bb-af59-f5084757ea84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:56.209157 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:53:56.213218 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-9016623a-c628-44bb-af59-f5084757ea84 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:53:56.215623 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-9016623a-c628-44bb-af59-f5084757ea84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:56.301638 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1434/2862] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:53:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:53:56.311655 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee293e-1c76-45ce-80bc-37269f18ec76 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:56.312135 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee293e-1c76-45ce-80bc-37269f18ec76 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:56.312627 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee293e-1c76-45ce-80bc-37269f18ec76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:56.361653 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-87ee293e-1c76-45ce-80bc-37269f18ec76 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:53:56.364456 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-87ee293e-1c76-45ce-80bc-37269f18ec76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:56.374696 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1429/2863] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:53:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:53:56.379004 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9016623a-c628-44bb-af59-f5084757ea84 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:56.395270 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9016623a-c628-44bb-af59-f5084757ea84 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:56.400438 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de030c-0406-442a-8408-1642258474a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:56.401305 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de030c-0406-442a-8408-1642258474a7 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:56.401632 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de030c-0406-442a-8408-1642258474a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:56.401976 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de030c-0406-442a-8408-1642258474a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:56.402659 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66de030c-0406-442a-8408-1642258474a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:53:56.402994 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66de030c-0406-442a-8408-1642258474a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:56.404638 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66de030c-0406-442a-8408-1642258474a7 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:56.425197 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1435/2864] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Aug 29 22:53:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:53:56.429541 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ee293e-1c76-45ce-80bc-37269f18ec76 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:56.439780 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ee293e-1c76-45ce-80bc-37269f18ec76 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:56.444428 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fef7e9-d874-4023-90c2-e8d336bc3aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:56.445033 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fef7e9-d874-4023-90c2-e8d336bc3aa8 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:56.445321 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fef7e9-d874-4023-90c2-e8d336bc3aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:56.445629 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fef7e9-d874-4023-90c2-e8d336bc3aa8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:56.446261 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fef7e9-d874-4023-90c2-e8d336bc3aa8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:56.448167 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fef7e9-d874-4023-90c2-e8d336bc3aa8 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:56.485167 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1430/2865] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:53:56 2022] POST /identity/v3/projects => generated 389 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:53:56.486388 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de030c-0406-442a-8408-1642258474a7 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:56.498477 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de030c-0406-442a-8408-1642258474a7 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:56.559416 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bbb275-5077-4a6c-8e5c-324ad4de9e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:56.560162 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bbb275-5077-4a6c-8e5c-324ad4de9e00 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:56.560437 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bbb275-5077-4a6c-8e5c-324ad4de9e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:56.560702 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bbb275-5077-4a6c-8e5c-324ad4de9e00 admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:56.561400 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bbb275-5077-4a6c-8e5c-324ad4de9e00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:56.563354 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bbb275-5077-4a6c-8e5c-324ad4de9e00 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:56.587672 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1436/2866] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:53:56 2022] POST /identity/v3/users => generated 295 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:53:56.592202 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fef7e9-d874-4023-90c2-e8d336bc3aa8 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:56.603377 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fef7e9-d874-4023-90c2-e8d336bc3aa8 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:56.608801 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79585e7c-e941-4ab5-86cb-c03bda329b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:56.609458 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79585e7c-e941-4ab5-86cb-c03bda329b44 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:56.609746 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79585e7c-e941-4ab5-86cb-c03bda329b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:56.610261 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79585e7c-e941-4ab5-86cb-c03bda329b44 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:56.610907 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79585e7c-e941-4ab5-86cb-c03bda329b44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:56.612514 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79585e7c-e941-4ab5-86cb-c03bda329b44 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:56.629288 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1431/2867] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:53:56 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:53:56.629532 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bbb275-5077-4a6c-8e5c-324ad4de9e00 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:56.647868 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bbb275-5077-4a6c-8e5c-324ad4de9e00 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:56.659465 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f101b412-a50e-4f62-8bff-246483229b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:56.660293 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101b412-a50e-4f62-8bff-246483229b78 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:56.660743 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101b412-a50e-4f62-8bff-246483229b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:56.661197 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101b412-a50e-4f62-8bff-246483229b78 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:56.662058 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f101b412-a50e-4f62-8bff-246483229b78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:56.663915 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f101b412-a50e-4f62-8bff-246483229b78 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:56.677361 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1437/2868] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:53:56 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:53:56.681259 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79585e7c-e941-4ab5-86cb-c03bda329b44 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:56.693500 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79585e7c-e941-4ab5-86cb-c03bda329b44 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:56.698425 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3993693-88f6-48a0-af0f-607c5278ef19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:56.699261 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3993693-88f6-48a0-af0f-607c5278ef19 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:56.699610 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3993693-88f6-48a0-af0f-607c5278ef19 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:56.699972 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3993693-88f6-48a0-af0f-607c5278ef19 admin admin] PATH_INFO: `/v3/projects/f8cc299acc3842bbb253a80145965eed/users/a6d452b51c00406ca8d1c975577be41b/roles/0c67797d444d4c929b2ccab47c468848` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:56.731392 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3993693-88f6-48a0-af0f-607c5278ef19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8cc299acc3842bbb253a80145965eed, user_id=a6d452b51c00406ca8d1c975577be41b, role_id=0c67797d444d4c929b2ccab47c468848)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:56.739969 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3993693-88f6-48a0-af0f-607c5278ef19 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:56.752540 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:53:56.772278 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1432/2869] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:53:56 2022] PUT /identity/v3/projects/f8cc299acc3842bbb253a80145965eed/users/a6d452b51c00406ca8d1c975577be41b/roles/0c67797d444d4c929b2ccab47c468848 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:53:56.773895 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f8253-e9ee-42ae-b5ad-26882a6127fe None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:56.774187 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f8253-e9ee-42ae-b5ad-26882a6127fe None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:56.774456 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f8253-e9ee-42ae-b5ad-26882a6127fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:56.814653 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-473f8253-e9ee-42ae-b5ad-26882a6127fe None None] MFA Rules not processed for user `a6d452b51c00406ca8d1c975577be41b`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:53:56.815914 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-473f8253-e9ee-42ae-b5ad-26882a6127fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:56.901177 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1438/2870] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:53:56 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:53:56.912542 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3993693-88f6-48a0-af0f-607c5278ef19 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:53:56.914975 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-c3993693-88f6-48a0-af0f-607c5278ef19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:53:57.015595 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3993693-88f6-48a0-af0f-607c5278ef19 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:53:57.019894 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22af6c3-8d77-43c2-83b4-77f8b804c697 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a05d7ad37e4547bada8aabc0fcb64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:53:57.020559 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22af6c3-8d77-43c2-83b4-77f8b804c697 service cinder] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:53:57.020877 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22af6c3-8d77-43c2-83b4-77f8b804c697 service cinder] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:53:57.021149 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22af6c3-8d77-43c2-83b4-77f8b804c697 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:53:57.032891 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22af6c3-8d77-43c2-83b4-77f8b804c697 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:53:57.034398 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22af6c3-8d77-43c2-83b4-77f8b804c697 service cinder] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:53:57.044563 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1433/2871] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:53:56 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:54:02.353904 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd56b1f-ee4c-41b1-a06b-37572ef4240c None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:54:02.354438 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd56b1f-ee4c-41b1-a06b-37572ef4240c None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:54:02.354562 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd56b1f-ee4c-41b1-a06b-37572ef4240c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:54:02.362741 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:54:02.381352 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-4bd56b1f-ee4c-41b1-a06b-37572ef4240c None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:54:02.383261 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-4bd56b1f-ee4c-41b1-a06b-37572ef4240c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:54:02.453858 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1439/2872] 10.222.0.18 () {58 vars in 1016 bytes} [Mon Aug 29 22:54:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:54:02.468203 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22af6c3-8d77-43c2-83b4-77f8b804c697 service cinder] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:54:02.469688 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-e22af6c3-8d77-43c2-83b4-77f8b804c697 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:54:02.596948 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22af6c3-8d77-43c2-83b4-77f8b804c697 service cinder] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:54:02.605705 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51dbf35-6245-44ea-b701-6270c2350815 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35441c061e514b1b9341e7694ec2c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:54:02.605705 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51dbf35-6245-44ea-b701-6270c2350815 service nova] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:54:02.605705 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51dbf35-6245-44ea-b701-6270c2350815 service nova] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:54:02.605705 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51dbf35-6245-44ea-b701-6270c2350815 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:54:02.615014 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51dbf35-6245-44ea-b701-6270c2350815 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:54:02.616588 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51dbf35-6245-44ea-b701-6270c2350815 service nova] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:54:02.628579 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1434/2873] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:54:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:54:05.455650 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97baf689-de10-4f12-aa5c-7979e56bba82 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:54:05.456092 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97baf689-de10-4f12-aa5c-7979e56bba82 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:54:05.456327 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97baf689-de10-4f12-aa5c-7979e56bba82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:54:05.476019 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-97baf689-de10-4f12-aa5c-7979e56bba82 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:54:05.477151 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-97baf689-de10-4f12-aa5c-7979e56bba82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:54:05.485120 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1440/2874] 10.222.0.18 () {58 vars in 1016 bytes} [Mon Aug 29 22:54:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:54:05.502581 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51dbf35-6245-44ea-b701-6270c2350815 service nova] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:54:05.504177 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-e51dbf35-6245-44ea-b701-6270c2350815 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:54:05.521714 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51dbf35-6245-44ea-b701-6270c2350815 service nova] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:54:05.527519 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbb5b25-e083-4a0e-b47e-b8a268697f00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35441c061e514b1b9341e7694ec2c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:54:05.528123 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb5b25-e083-4a0e-b47e-b8a268697f00 service nova] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:54:05.528398 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb5b25-e083-4a0e-b47e-b8a268697f00 service nova] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:54:05.528669 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb5b25-e083-4a0e-b47e-b8a268697f00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:54:05.537453 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbb5b25-e083-4a0e-b47e-b8a268697f00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:54:05.539020 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbb5b25-e083-4a0e-b47e-b8a268697f00 service nova] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:54:05.548580 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1435/2875] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:54:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:54:07.296928 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97baf689-de10-4f12-aa5c-7979e56bba82 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:54:07.307055 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97baf689-de10-4f12-aa5c-7979e56bba82 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:54:07.312869 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ff648-16ab-421d-9308-0d457b53069d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:54:07.313531 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ff648-16ab-421d-9308-0d457b53069d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:54:07.313809 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ff648-16ab-421d-9308-0d457b53069d admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:54:07.314077 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ff648-16ab-421d-9308-0d457b53069d admin admin] PATH_INFO: `/v3/users/a6d452b51c00406ca8d1c975577be41b` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:54:07.315202 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32ff648-16ab-421d-9308-0d457b53069d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6d452b51c00406ca8d1c975577be41b)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:54:07.317312 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32ff648-16ab-421d-9308-0d457b53069d admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:54:07.379440 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-e32ff648-16ab-421d-9308-0d457b53069d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6d452b51c00406ca8d1c975577be41b'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:54:07.386100 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-e32ff648-16ab-421d-9308-0d457b53069d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6d452b51c00406ca8d1c975577be41b'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:54:07.386929 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-e32ff648-16ab-421d-9308-0d457b53069d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6d452b51c00406ca8d1c975577be41b'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:54:07.394851 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-e32ff648-16ab-421d-9308-0d457b53069d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6d452b51c00406ca8d1c975577be41b'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:54:07.395516 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-e32ff648-16ab-421d-9308-0d457b53069d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6d452b51c00406ca8d1c975577be41b'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:54:07.413263 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1441/2876] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:54:07 2022] DELETE /identity/v3/users/a6d452b51c00406ca8d1c975577be41b => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:54:07.418568 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4e4e0-e2f2-4f7e-bd8f-2bb58f420b45 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:54:07.419268 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4e4e0-e2f2-4f7e-bd8f-2bb58f420b45 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:54:07.419268 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4e4e0-e2f2-4f7e-bd8f-2bb58f420b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:54:07.438685 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-d7c4e4e0-e2f2-4f7e-bd8f-2bb58f420b45 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:54:07.439909 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-d7c4e4e0-e2f2-4f7e-bd8f-2bb58f420b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:54:07.469101 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:54:07.499691 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1436/2877] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:54:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:54:07.509436 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ff648-16ab-421d-9308-0d457b53069d admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:54:07.510864 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-e32ff648-16ab-421d-9308-0d457b53069d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:54:07.590031 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:54:07.593074 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ff648-16ab-421d-9308-0d457b53069d admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:54:07.598220 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66afbe8-8687-48e2-b784-776dda7cfd88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:54:07.598996 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66afbe8-8687-48e2-b784-776dda7cfd88 service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:54:07.599468 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66afbe8-8687-48e2-b784-776dda7cfd88 service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:54:07.599917 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66afbe8-8687-48e2-b784-776dda7cfd88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:54:07.610140 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66afbe8-8687-48e2-b784-776dda7cfd88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:54:07.611592 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66afbe8-8687-48e2-b784-776dda7cfd88 service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:54:07.621218 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1442/2878] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:54:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:54:07.899027 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c4e4e0-e2f2-4f7e-bd8f-2bb58f420b45 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:54:07.900571 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-d7c4e4e0-e2f2-4f7e-bd8f-2bb58f420b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:54:07.916377 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c4e4e0-e2f2-4f7e-bd8f-2bb58f420b45 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:54:07.923106 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a363d67-b648-4d9e-869f-5cd2e8787bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:54:07.923980 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a363d67-b648-4d9e-869f-5cd2e8787bd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:54:07.924298 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a363d67-b648-4d9e-869f-5cd2e8787bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:54:07.924780 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a363d67-b648-4d9e-869f-5cd2e8787bd2 admin admin] PATH_INFO: `/v3/projects/f8cc299acc3842bbb253a80145965eed` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:54:07.926042 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a363d67-b648-4d9e-869f-5cd2e8787bd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8cc299acc3842bbb253a80145965eed)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:54:07.927986 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a363d67-b648-4d9e-869f-5cd2e8787bd2 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:54:07.975912 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-6a363d67-b648-4d9e-869f-5cd2e8787bd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8cc299acc3842bbb253a80145965eed', 'request_id': 'req-6a363d67-b648-4d9e-869f-5cd2e8787bd2'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:54:07.982727 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-6a363d67-b648-4d9e-869f-5cd2e8787bd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8cc299acc3842bbb253a80145965eed', 'request_id': 'req-6a363d67-b648-4d9e-869f-5cd2e8787bd2'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:54:07.988256 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-6a363d67-b648-4d9e-869f-5cd2e8787bd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8cc299acc3842bbb253a80145965eed', 'request_id': 'req-6a363d67-b648-4d9e-869f-5cd2e8787bd2'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:54:08.001577 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-6a363d67-b648-4d9e-869f-5cd2e8787bd2 admin admin] The token cache is being invalidate because project f8cc299acc3842bbb253a80145965eed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:54:08.001867 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-6a363d67-b648-4d9e-869f-5cd2e8787bd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:54:08.002492 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-6a363d67-b648-4d9e-869f-5cd2e8787bd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:54:08.004026 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1437/2879] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:54:07 2022] DELETE /identity/v3/projects/f8cc299acc3842bbb253a80145965eed => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:54:08.717092 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df6443-8ca3-4a56-bd70-e69cd2626af8 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:54:08.717706 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df6443-8ca3-4a56-bd70-e69cd2626af8 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:54:08.717955 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df6443-8ca3-4a56-bd70-e69cd2626af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:54:08.739343 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-46df6443-8ca3-4a56-bd70-e69cd2626af8 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:54:08.745741 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-46df6443-8ca3-4a56-bd70-e69cd2626af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:54:08.809811 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1443/2880] 10.222.0.18 () {58 vars in 1016 bytes} [Mon Aug 29 22:54:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:54:08.827576 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a363d67-b648-4d9e-869f-5cd2e8787bd2 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:54:08.829031 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-6a363d67-b648-4d9e-869f-5cd2e8787bd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:54:08.906772 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a363d67-b648-4d9e-869f-5cd2e8787bd2 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:54:08.912522 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a73f09b-65e5-4234-bf43-0478365b1d08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35441c061e514b1b9341e7694ec2c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:54:08.913131 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a73f09b-65e5-4234-bf43-0478365b1d08 service nova] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:54:08.913433 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a73f09b-65e5-4234-bf43-0478365b1d08 service nova] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:54:08.913703 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a73f09b-65e5-4234-bf43-0478365b1d08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:54:08.921857 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a73f09b-65e5-4234-bf43-0478365b1d08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:54:08.923476 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a73f09b-65e5-4234-bf43-0478365b1d08 service nova] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:54:08.933796 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1438/2881] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:54:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:54:11.161767 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46df6443-8ca3-4a56-bd70-e69cd2626af8 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:54:11.163708 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-46df6443-8ca3-4a56-bd70-e69cd2626af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:54:11.226195 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46df6443-8ca3-4a56-bd70-e69cd2626af8 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:54:11.230186 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f419ae-ab7c-4256-9f73-a32839f09ead service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:54:11.231322 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f419ae-ab7c-4256-9f73-a32839f09ead service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:54:11.231601 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f419ae-ab7c-4256-9f73-a32839f09ead service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:54:11.231877 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f419ae-ab7c-4256-9f73-a32839f09ead service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:54:11.234145 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-78f419ae-ab7c-4256-9f73-a32839f09ead service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:54:11.297876 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f419ae-ab7c-4256-9f73-a32839f09ead service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:54:11.299326 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f419ae-ab7c-4256-9f73-a32839f09ead service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:54:11.309649 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1444/2882] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:54:11 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:54:11.782426 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c02d3-0fd3-41ff-960b-f84b5ba4adf3 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:54:11.782880 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c02d3-0fd3-41ff-960b-f84b5ba4adf3 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:54:11.783006 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c02d3-0fd3-41ff-960b-f84b5ba4adf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:54:11.806040 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-118c02d3-0fd3-41ff-960b-f84b5ba4adf3 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:54:11.807296 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-118c02d3-0fd3-41ff-960b-f84b5ba4adf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:54:11.818837 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1439/2883] 10.222.0.18 () {58 vars in 1016 bytes} [Mon Aug 29 22:54:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:54:11.834096 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f419ae-ab7c-4256-9f73-a32839f09ead service neutron] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:54:11.847249 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f419ae-ab7c-4256-9f73-a32839f09ead service neutron] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:54:11.853807 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e66bf5-3ac4-45c2-868f-3060460166ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35441c061e514b1b9341e7694ec2c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:54:11.854427 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e66bf5-3ac4-45c2-868f-3060460166ef service nova] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:54:11.854706 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e66bf5-3ac4-45c2-868f-3060460166ef service nova] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:54:11.854978 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e66bf5-3ac4-45c2-868f-3060460166ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:54:11.864126 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e66bf5-3ac4-45c2-868f-3060460166ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:54:11.865751 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e66bf5-3ac4-45c2-868f-3060460166ef service nova] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:54:11.875649 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1445/2884] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:54:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:54:15.216043 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9a4d2-3ffc-422c-a112-875e1fc11114 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:54:15.216621 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9a4d2-3ffc-422c-a112-875e1fc11114 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:54:15.216621 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9a4d2-3ffc-422c-a112-875e1fc11114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:54:15.238739 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-4fc9a4d2-3ffc-422c-a112-875e1fc11114 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:54:15.240369 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-4fc9a4d2-3ffc-422c-a112-875e1fc11114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:54:15.250313 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1440/2885] 10.222.0.18 () {58 vars in 1016 bytes} [Mon Aug 29 22:54:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:54:15.266207 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e66bf5-3ac4-45c2-868f-3060460166ef service nova] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:54:15.268368 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-94e66bf5-3ac4-45c2-868f-3060460166ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:54:15.284112 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e66bf5-3ac4-45c2-868f-3060460166ef service nova] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:54:15.290568 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4931cd1-cd1c-4f50-9394-39e2f72f7fc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35441c061e514b1b9341e7694ec2c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:54:15.291344 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4931cd1-cd1c-4f50-9394-39e2f72f7fc8 service nova] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:54:15.291436 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4931cd1-cd1c-4f50-9394-39e2f72f7fc8 service nova] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:54:15.291812 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4931cd1-cd1c-4f50-9394-39e2f72f7fc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:54:15.301640 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4931cd1-cd1c-4f50-9394-39e2f72f7fc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:54:15.303708 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4931cd1-cd1c-4f50-9394-39e2f72f7fc8 service nova] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:54:15.316132 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1446/2886] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:54:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:54:18.353713 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb9aa40-4adb-4578-be3a-8e22e1fcb407 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:54:18.354179 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb9aa40-4adb-4578-be3a-8e22e1fcb407 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:54:18.354297 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb9aa40-4adb-4578-be3a-8e22e1fcb407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:54:18.374135 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-ecb9aa40-4adb-4578-be3a-8e22e1fcb407 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:54:18.375361 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-ecb9aa40-4adb-4578-be3a-8e22e1fcb407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:54:18.383183 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1441/2887] 10.222.0.18 () {58 vars in 1016 bytes} [Mon Aug 29 22:54:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:54:18.398434 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4931cd1-cd1c-4f50-9394-39e2f72f7fc8 service nova] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:54:18.410111 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4931cd1-cd1c-4f50-9394-39e2f72f7fc8 service nova] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:54:18.415530 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca17000b-bbfb-42dc-8b4a-680fc9eaf74b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35441c061e514b1b9341e7694ec2c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:54:18.416139 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17000b-bbfb-42dc-8b4a-680fc9eaf74b service nova] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:54:18.416416 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17000b-bbfb-42dc-8b4a-680fc9eaf74b service nova] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:54:18.416686 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17000b-bbfb-42dc-8b4a-680fc9eaf74b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:54:18.425362 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca17000b-bbfb-42dc-8b4a-680fc9eaf74b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:54:18.426927 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca17000b-bbfb-42dc-8b4a-680fc9eaf74b service nova] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:54:18.436919 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1447/2888] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:54:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:54:28.368331 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=81,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:54:28.432062 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:54:32.609482 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4877a69-c80a-4f19-9216-fcb24e1ace63 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:54:32.609990 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4877a69-c80a-4f19-9216-fcb24e1ace63 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:54:32.610088 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4877a69-c80a-4f19-9216-fcb24e1ace63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:54:32.629677 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-c4877a69-c80a-4f19-9216-fcb24e1ace63 None None] MFA Rules not processed for user `867eedc8b4ba4cea9b309befd39fe097`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:54:32.630889 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-c4877a69-c80a-4f19-9216-fcb24e1ace63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:54:32.685238 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1442/2889] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:54:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:54:42.678643 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=25 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:54:45.293869 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5812d29-7a12-4e6f-9e68-7164365639db None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:54:45.294474 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5812d29-7a12-4e6f-9e68-7164365639db None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:54:45.294474 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5812d29-7a12-4e6f-9e68-7164365639db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:54:45.315099 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-f5812d29-7a12-4e6f-9e68-7164365639db None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:54:45.316331 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-f5812d29-7a12-4e6f-9e68-7164365639db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:54:45.324534 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1448/2890] 10.222.0.18 () {58 vars in 1016 bytes} [Mon Aug 29 22:54:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:54:45.342311 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4877a69-c80a-4f19-9216-fcb24e1ace63 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:54:45.355280 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4877a69-c80a-4f19-9216-fcb24e1ace63 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:54:45.361532 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae245846-2ce4-4c10-a79a-4c2d6f269af3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35441c061e514b1b9341e7694ec2c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:54:45.362138 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae245846-2ce4-4c10-a79a-4c2d6f269af3 service nova] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:54:45.362420 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae245846-2ce4-4c10-a79a-4c2d6f269af3 service nova] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:54:45.362692 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae245846-2ce4-4c10-a79a-4c2d6f269af3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:54:45.370943 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae245846-2ce4-4c10-a79a-4c2d6f269af3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:54:45.372527 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae245846-2ce4-4c10-a79a-4c2d6f269af3 service nova] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:54:45.382795 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1443/2891] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:54:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:54:48.611155 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324fb583-c011-4266-afad-2cd632a04cd6 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:54:48.611762 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324fb583-c011-4266-afad-2cd632a04cd6 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:54:48.611762 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324fb583-c011-4266-afad-2cd632a04cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:54:48.632082 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-324fb583-c011-4266-afad-2cd632a04cd6 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:54:48.633299 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-324fb583-c011-4266-afad-2cd632a04cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:54:48.641511 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1449/2892] 10.222.0.18 () {58 vars in 1016 bytes} [Mon Aug 29 22:54:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:54:48.655953 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae245846-2ce4-4c10-a79a-4c2d6f269af3 service nova] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:54:48.667661 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae245846-2ce4-4c10-a79a-4c2d6f269af3 service nova] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:54:48.674276 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f314acc7-742c-4643-8be2-72016e03c349 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35441c061e514b1b9341e7694ec2c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:54:48.674873 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314acc7-742c-4643-8be2-72016e03c349 service nova] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:54:48.675155 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314acc7-742c-4643-8be2-72016e03c349 service nova] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:54:48.675442 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314acc7-742c-4643-8be2-72016e03c349 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:54:48.683718 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f314acc7-742c-4643-8be2-72016e03c349 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:54:48.685294 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f314acc7-742c-4643-8be2-72016e03c349 service nova] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:54:48.695061 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1444/2893] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:54:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:54:51.688360 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653495bb-c20c-4404-b2ad-8b8b85f08c27 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:54:51.689190 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653495bb-c20c-4404-b2ad-8b8b85f08c27 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:54:51.689190 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653495bb-c20c-4404-b2ad-8b8b85f08c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:54:51.708897 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-653495bb-c20c-4404-b2ad-8b8b85f08c27 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:54:51.710209 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-653495bb-c20c-4404-b2ad-8b8b85f08c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:54:51.718675 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1450/2894] 10.222.0.18 () {58 vars in 1016 bytes} [Mon Aug 29 22:54:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:54:51.736247 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f314acc7-742c-4643-8be2-72016e03c349 service nova] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:54:51.747922 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f314acc7-742c-4643-8be2-72016e03c349 service nova] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:54:51.753453 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1994e3d-104a-4c21-9728-bd73bed37fe4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35441c061e514b1b9341e7694ec2c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:54:51.754052 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1994e3d-104a-4c21-9728-bd73bed37fe4 service nova] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:54:51.754333 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1994e3d-104a-4c21-9728-bd73bed37fe4 service nova] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:54:51.754608 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1994e3d-104a-4c21-9728-bd73bed37fe4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:54:51.762625 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1994e3d-104a-4c21-9728-bd73bed37fe4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:54:51.764187 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1994e3d-104a-4c21-9728-bd73bed37fe4 service nova] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:54:51.774315 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1445/2895] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:54:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:54:54.848678 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99cec4-7d63-4bba-86e0-c243ffeefb8f None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:54:54.849237 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99cec4-7d63-4bba-86e0-c243ffeefb8f None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:54:54.849237 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99cec4-7d63-4bba-86e0-c243ffeefb8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:54:54.871579 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-0f99cec4-7d63-4bba-86e0-c243ffeefb8f None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:54:54.872789 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-0f99cec4-7d63-4bba-86e0-c243ffeefb8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:54:54.881867 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1451/2896] 10.222.0.18 () {58 vars in 1016 bytes} [Mon Aug 29 22:54:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:54:54.900463 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1994e3d-104a-4c21-9728-bd73bed37fe4 service nova] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:54:54.913945 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1994e3d-104a-4c21-9728-bd73bed37fe4 service nova] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:54:54.919855 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8f307f-0b94-4e22-94d1-304187bce454 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35441c061e514b1b9341e7694ec2c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:54:54.920465 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f307f-0b94-4e22-94d1-304187bce454 service nova] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:54:54.920746 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f307f-0b94-4e22-94d1-304187bce454 service nova] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:54:54.921609 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f307f-0b94-4e22-94d1-304187bce454 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:54:54.930497 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8f307f-0b94-4e22-94d1-304187bce454 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:54:54.932073 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8f307f-0b94-4e22-94d1-304187bce454 service nova] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:54:54.942624 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1446/2897] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:54:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:54:58.027944 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bbceac-4cc0-440b-9dff-fda7d994a48b None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:54:58.028485 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bbceac-4cc0-440b-9dff-fda7d994a48b None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:54:58.028485 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bbceac-4cc0-440b-9dff-fda7d994a48b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:54:58.049151 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-d9bbceac-4cc0-440b-9dff-fda7d994a48b None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:54:58.050405 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-d9bbceac-4cc0-440b-9dff-fda7d994a48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:54:58.059479 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1452/2898] 10.222.0.18 () {58 vars in 1016 bytes} [Mon Aug 29 22:54:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:54:58.084964 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8f307f-0b94-4e22-94d1-304187bce454 service nova] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:54:58.097998 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8f307f-0b94-4e22-94d1-304187bce454 service nova] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:54:58.103630 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf315b-c653-401a-8fff-ff70cee8a0d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35441c061e514b1b9341e7694ec2c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:54:58.104228 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf315b-c653-401a-8fff-ff70cee8a0d9 service nova] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:54:58.104507 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf315b-c653-401a-8fff-ff70cee8a0d9 service nova] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:54:58.104781 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf315b-c653-401a-8fff-ff70cee8a0d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:54:58.113744 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccf315b-c653-401a-8fff-ff70cee8a0d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:54:58.115312 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccf315b-c653-401a-8fff-ff70cee8a0d9 service nova] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:54:58.125383 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1447/2899] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:54:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:55:08.043639 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=15 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:55:08.120525 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=30 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:55:26.087587 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bbceac-4cc0-440b-9dff-fda7d994a48b None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:55:26.089166 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-d9bbceac-4cc0-440b-9dff-fda7d994a48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:55:26.102429 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bbceac-4cc0-440b-9dff-fda7d994a48b None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:55:26.107620 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62147a5a-9deb-4a18-826b-fbe5871e40e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:55:26.108355 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62147a5a-9deb-4a18-826b-fbe5871e40e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:55:26.108664 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62147a5a-9deb-4a18-826b-fbe5871e40e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:55:26.108935 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62147a5a-9deb-4a18-826b-fbe5871e40e0 admin admin] PATH_INFO: `/v3/users/867eedc8b4ba4cea9b309befd39fe097` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:55:26.110174 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62147a5a-9deb-4a18-826b-fbe5871e40e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=867eedc8b4ba4cea9b309befd39fe097)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:55:26.112112 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62147a5a-9deb-4a18-826b-fbe5871e40e0 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:55:26.161177 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-62147a5a-9deb-4a18-826b-fbe5871e40e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '867eedc8b4ba4cea9b309befd39fe097'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:55:26.168333 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-62147a5a-9deb-4a18-826b-fbe5871e40e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '867eedc8b4ba4cea9b309befd39fe097'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:55:26.169231 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-62147a5a-9deb-4a18-826b-fbe5871e40e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '867eedc8b4ba4cea9b309befd39fe097'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:55:26.177167 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-62147a5a-9deb-4a18-826b-fbe5871e40e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '867eedc8b4ba4cea9b309befd39fe097'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:55:26.177796 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-62147a5a-9deb-4a18-826b-fbe5871e40e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '867eedc8b4ba4cea9b309befd39fe097'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:55:26.195113 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1453/2900] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:55:26 2022] DELETE /identity/v3/users/867eedc8b4ba4cea9b309befd39fe097 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:55:26.371731 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf315b-c653-401a-8fff-ff70cee8a0d9 service nova] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:55:26.382254 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf315b-c653-401a-8fff-ff70cee8a0d9 service nova] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:55:26.440768 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0bd73d-d42f-4467-b1b4-6b886ef28aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:55:26.441412 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0bd73d-d42f-4467-b1b4-6b886ef28aaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:55:26.441775 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0bd73d-d42f-4467-b1b4-6b886ef28aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:55:26.442199 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0bd73d-d42f-4467-b1b4-6b886ef28aaf admin admin] PATH_INFO: `/v3/projects/1d1a46654ecd4493bc3b20bd4531c74b` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:55:26.443280 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0bd73d-d42f-4467-b1b4-6b886ef28aaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d1a46654ecd4493bc3b20bd4531c74b)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:55:26.445196 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0bd73d-d42f-4467-b1b4-6b886ef28aaf admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:55:26.493030 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-0d0bd73d-d42f-4467-b1b4-6b886ef28aaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d1a46654ecd4493bc3b20bd4531c74b', 'request_id': 'req-0d0bd73d-d42f-4467-b1b4-6b886ef28aaf'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:55:26.499113 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-0d0bd73d-d42f-4467-b1b4-6b886ef28aaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d1a46654ecd4493bc3b20bd4531c74b', 'request_id': 'req-0d0bd73d-d42f-4467-b1b4-6b886ef28aaf'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:55:26.505318 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-0d0bd73d-d42f-4467-b1b4-6b886ef28aaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d1a46654ecd4493bc3b20bd4531c74b', 'request_id': 'req-0d0bd73d-d42f-4467-b1b4-6b886ef28aaf'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:55:26.517743 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-0d0bd73d-d42f-4467-b1b4-6b886ef28aaf admin admin] The token cache is being invalidate because project 1d1a46654ecd4493bc3b20bd4531c74b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:55:26.518037 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-0d0bd73d-d42f-4467-b1b4-6b886ef28aaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:55:26.518671 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-0d0bd73d-d42f-4467-b1b4-6b886ef28aaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:55:26.524383 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1448/2901] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:55:26 2022] DELETE /identity/v3/projects/1d1a46654ecd4493bc3b20bd4531c74b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:55:26.526131 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c4f0f-282e-4629-90fe-2df01dd3fbd2 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:55:26.526416 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c4f0f-282e-4629-90fe-2df01dd3fbd2 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:55:26.526718 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c4f0f-282e-4629-90fe-2df01dd3fbd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:55:26.546399 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-cb8c4f0f-282e-4629-90fe-2df01dd3fbd2 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:55:26.547604 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-cb8c4f0f-282e-4629-90fe-2df01dd3fbd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:55:26.606116 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1454/2902] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:55:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:55:26.614105 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009d9731-9254-4dbc-a825-898ee0ec4a73 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:55:26.614394 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009d9731-9254-4dbc-a825-898ee0ec4a73 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:55:26.614671 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009d9731-9254-4dbc-a825-898ee0ec4a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:55:26.635723 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-009d9731-9254-4dbc-a825-898ee0ec4a73 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:55:26.636937 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-009d9731-9254-4dbc-a825-898ee0ec4a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:55:26.645373 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1449/2903] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:55:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:55:26.649811 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8c4f0f-282e-4629-90fe-2df01dd3fbd2 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:55:26.659824 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8c4f0f-282e-4629-90fe-2df01dd3fbd2 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:55:26.665018 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f830f72-41ed-4da7-ac24-1fa1e7501cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:55:26.665643 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f830f72-41ed-4da7-ac24-1fa1e7501cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:55:26.665945 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f830f72-41ed-4da7-ac24-1fa1e7501cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:55:26.666212 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f830f72-41ed-4da7-ac24-1fa1e7501cf1 admin admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:55:26.666849 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f830f72-41ed-4da7-ac24-1fa1e7501cf1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:55:26.667145 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f830f72-41ed-4da7-ac24-1fa1e7501cf1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:55:26.668727 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f830f72-41ed-4da7-ac24-1fa1e7501cf1 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:55:26.680841 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1455/2904] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Aug 29 22:55:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:55:26.686531 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009d9731-9254-4dbc-a825-898ee0ec4a73 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:55:26.696051 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009d9731-9254-4dbc-a825-898ee0ec4a73 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:55:26.700690 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbbaf73-66a0-4412-a858-791050a53ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:55:26.701288 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbbaf73-66a0-4412-a858-791050a53ba9 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:55:26.701598 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbbaf73-66a0-4412-a858-791050a53ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:55:26.701873 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbbaf73-66a0-4412-a858-791050a53ba9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:55:26.702517 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbbaf73-66a0-4412-a858-791050a53ba9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:55:26.704425 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbbaf73-66a0-4412-a858-791050a53ba9 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:55:26.741756 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1450/2905] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:55:26 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:55:26.745930 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f830f72-41ed-4da7-ac24-1fa1e7501cf1 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:55:26.756749 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f830f72-41ed-4da7-ac24-1fa1e7501cf1 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:55:26.812227 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428136ef-f7b6-47ef-9140-b818cfbe2ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:55:26.812823 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428136ef-f7b6-47ef-9140-b818cfbe2ee9 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:55:26.813100 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428136ef-f7b6-47ef-9140-b818cfbe2ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:55:26.813391 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428136ef-f7b6-47ef-9140-b818cfbe2ee9 admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:55:26.814020 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428136ef-f7b6-47ef-9140-b818cfbe2ee9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:55:26.815931 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428136ef-f7b6-47ef-9140-b818cfbe2ee9 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:55:26.824002 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:55:26.843654 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1456/2906] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:55:26 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:55:26.844796 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbbaf73-66a0-4412-a858-791050a53ba9 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:55:26.855615 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbbaf73-66a0-4412-a858-791050a53ba9 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:55:26.860328 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346ef60b-7474-455d-9e20-95caa8e33a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:55:26.860929 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ef60b-7474-455d-9e20-95caa8e33a00 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:55:26.861213 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ef60b-7474-455d-9e20-95caa8e33a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:55:26.861519 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ef60b-7474-455d-9e20-95caa8e33a00 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:55:26.862166 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346ef60b-7474-455d-9e20-95caa8e33a00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:55:26.864363 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346ef60b-7474-455d-9e20-95caa8e33a00 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:55:26.874205 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1451/2907] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:55:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:55:26.878067 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428136ef-f7b6-47ef-9140-b818cfbe2ee9 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:55:26.888150 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428136ef-f7b6-47ef-9140-b818cfbe2ee9 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:55:26.893141 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74b66e8-40c2-487d-8e48-d39aa5bf919d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:55:26.893679 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b66e8-40c2-487d-8e48-d39aa5bf919d admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:55:26.894008 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b66e8-40c2-487d-8e48-d39aa5bf919d admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:55:26.894300 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b66e8-40c2-487d-8e48-d39aa5bf919d admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:55:26.896430 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74b66e8-40c2-487d-8e48-d39aa5bf919d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:55:26.897223 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74b66e8-40c2-487d-8e48-d39aa5bf919d admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:55:26.908188 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1457/2908] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:55:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:55:26.913031 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346ef60b-7474-455d-9e20-95caa8e33a00 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:55:26.922978 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346ef60b-7474-455d-9e20-95caa8e33a00 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:55:26.927632 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83431f58-c097-4963-869b-a806728a8213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:55:26.928278 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83431f58-c097-4963-869b-a806728a8213 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:55:26.928575 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83431f58-c097-4963-869b-a806728a8213 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:55:26.928830 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83431f58-c097-4963-869b-a806728a8213 admin admin] PATH_INFO: `/v3/projects/16f40d4c73cc4c22adee3f0d589a452d/users/e3f7118e9a0747e39ad3d1dafd18b1f9/roles/0c67797d444d4c929b2ccab47c468848` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:55:26.943487 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83431f58-c097-4963-869b-a806728a8213 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16f40d4c73cc4c22adee3f0d589a452d, user_id=e3f7118e9a0747e39ad3d1dafd18b1f9, role_id=0c67797d444d4c929b2ccab47c468848)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:55:26.946293 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83431f58-c097-4963-869b-a806728a8213 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:55:26.959702 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1452/2909] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:55:26 2022] PUT /identity/v3/projects/16f40d4c73cc4c22adee3f0d589a452d/users/e3f7118e9a0747e39ad3d1dafd18b1f9/roles/0c67797d444d4c929b2ccab47c468848 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:55:26.964879 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc022d-a905-4eef-9e43-4b048d25db54 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:55:26.965170 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc022d-a905-4eef-9e43-4b048d25db54 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:55:26.965491 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc022d-a905-4eef-9e43-4b048d25db54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:55:26.984941 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-93dc022d-a905-4eef-9e43-4b048d25db54 None None] MFA Rules not processed for user `2844206a473948fca3069da17e9f5996`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:55:26.986186 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-93dc022d-a905-4eef-9e43-4b048d25db54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:55:27.046708 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1458/2910] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:55:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:55:27.056390 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83431f58-c097-4963-869b-a806728a8213 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:55:27.058244 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-83431f58-c097-4963-869b-a806728a8213 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:55:27.078173 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:55:27.118262 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83431f58-c097-4963-869b-a806728a8213 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:55:27.121944 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4036b69-5b31-47d0-9c61-f8d9efe4157b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:55:27.122550 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4036b69-5b31-47d0-9c61-f8d9efe4157b service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:55:27.122832 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4036b69-5b31-47d0-9c61-f8d9efe4157b service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:55:27.123137 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4036b69-5b31-47d0-9c61-f8d9efe4157b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:55:27.131912 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4036b69-5b31-47d0-9c61-f8d9efe4157b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:55:27.133357 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4036b69-5b31-47d0-9c61-f8d9efe4157b service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:55:27.142701 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1453/2911] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:55:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:55:31.105553 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d08cb-e8f8-45c5-9bb5-04dc6b1e91e6 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:55:31.106107 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d08cb-e8f8-45c5-9bb5-04dc6b1e91e6 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:55:31.106107 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d08cb-e8f8-45c5-9bb5-04dc6b1e91e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:55:31.138080 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-1a0d08cb-e8f8-45c5-9bb5-04dc6b1e91e6 None None] MFA Rules not processed for user `e3f7118e9a0747e39ad3d1dafd18b1f9`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:55:31.139402 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-1a0d08cb-e8f8-45c5-9bb5-04dc6b1e91e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:55:31.216542 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1459/2912] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:55:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:55:31.221094 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4036b69-5b31-47d0-9c61-f8d9efe4157b service neutron] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:55:31.232077 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4036b69-5b31-47d0-9c61-f8d9efe4157b service neutron] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:55:31.236988 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07795ca-c381-4f2f-aa35-524a04e052e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:55:31.237713 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07795ca-c381-4f2f-aa35-524a04e052e4 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:55:31.238068 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07795ca-c381-4f2f-aa35-524a04e052e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:55:31.238498 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07795ca-c381-4f2f-aa35-524a04e052e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:55:31.239771 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07795ca-c381-4f2f-aa35-524a04e052e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:55:31.241940 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07795ca-c381-4f2f-aa35-524a04e052e4 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:55:31.272788 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1454/2913] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Aug 29 22:55:31 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:55:31.277087 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d08cb-e8f8-45c5-9bb5-04dc6b1e91e6 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:55:31.289711 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d08cb-e8f8-45c5-9bb5-04dc6b1e91e6 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:55:31.353353 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49985ea7-b0a7-472f-9435-b4a5b6c8679e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:55:31.354253 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49985ea7-b0a7-472f-9435-b4a5b6c8679e admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:55:31.354536 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49985ea7-b0a7-472f-9435-b4a5b6c8679e admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:55:31.354812 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49985ea7-b0a7-472f-9435-b4a5b6c8679e admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:55:31.355461 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49985ea7-b0a7-472f-9435-b4a5b6c8679e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:55:31.357453 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49985ea7-b0a7-472f-9435-b4a5b6c8679e admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:55:31.375152 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:55:31.384723 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1460/2914] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Aug 29 22:55:31 2022] POST /identity/v3/users => generated 292 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:55:31.387463 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07795ca-c381-4f2f-aa35-524a04e052e4 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:55:31.401490 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07795ca-c381-4f2f-aa35-524a04e052e4 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:55:31.411283 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed8ea78-806d-4829-a436-2e42aea3c349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:55:31.412101 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed8ea78-806d-4829-a436-2e42aea3c349 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:55:31.412386 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed8ea78-806d-4829-a436-2e42aea3c349 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:55:31.412696 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed8ea78-806d-4829-a436-2e42aea3c349 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:55:31.413500 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed8ea78-806d-4829-a436-2e42aea3c349 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:55:31.415131 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed8ea78-806d-4829-a436-2e42aea3c349 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:55:31.427684 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1455/2915] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:55:31.431657 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49985ea7-b0a7-472f-9435-b4a5b6c8679e admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:55:31.443936 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49985ea7-b0a7-472f-9435-b4a5b6c8679e admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:55:31.448738 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d7181-674f-441a-992e-25f1cc486cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:55:31.449499 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d7181-674f-441a-992e-25f1cc486cc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:55:31.449786 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d7181-674f-441a-992e-25f1cc486cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:55:31.450062 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d7181-674f-441a-992e-25f1cc486cc2 admin admin] PATH_INFO: `/v3/projects/bcc05271499e4f69a3046ff1c21531e3/users/f2630fe813fc403c97cd4332e77dd203/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:55:31.465621 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723d7181-674f-441a-992e-25f1cc486cc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcc05271499e4f69a3046ff1c21531e3, user_id=f2630fe813fc403c97cd4332e77dd203, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:55:31.468303 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723d7181-674f-441a-992e-25f1cc486cc2 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:55:31.481445 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1461/2916] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:55:31 2022] PUT /identity/v3/projects/bcc05271499e4f69a3046ff1c21531e3/users/f2630fe813fc403c97cd4332e77dd203/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:55:31.485373 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed8ea78-806d-4829-a436-2e42aea3c349 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:55:31.496520 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed8ea78-806d-4829-a436-2e42aea3c349 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:55:31.555924 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b240710-0453-4a02-a5fe-b284662d577c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:55:31.556545 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b240710-0453-4a02-a5fe-b284662d577c admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:55:31.556829 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b240710-0453-4a02-a5fe-b284662d577c admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:55:31.557104 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b240710-0453-4a02-a5fe-b284662d577c admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:55:31.557783 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b240710-0453-4a02-a5fe-b284662d577c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:55:31.559383 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b240710-0453-4a02-a5fe-b284662d577c admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:55:31.569989 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1456/2917] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Aug 29 22:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:55:31.574147 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d7181-674f-441a-992e-25f1cc486cc2 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:55:31.584803 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d7181-674f-441a-992e-25f1cc486cc2 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:55:31.589838 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7470cae3-ecb4-4662-b181-de427883f7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:55:31.590484 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470cae3-ecb4-4662-b181-de427883f7b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:55:31.590763 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470cae3-ecb4-4662-b181-de427883f7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:55:31.591038 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470cae3-ecb4-4662-b181-de427883f7b7 admin admin] PATH_INFO: `/v3/projects/bcc05271499e4f69a3046ff1c21531e3/users/f2630fe813fc403c97cd4332e77dd203/roles/d00eabaec96a4956aaec2c37a5819c25` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:55:31.592994 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7470cae3-ecb4-4662-b181-de427883f7b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcc05271499e4f69a3046ff1c21531e3, user_id=f2630fe813fc403c97cd4332e77dd203, role_id=d00eabaec96a4956aaec2c37a5819c25)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:55:31.595680 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7470cae3-ecb4-4662-b181-de427883f7b7 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:55:31.606072 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1462/2918] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Aug 29 22:55:31 2022] PUT /identity/v3/projects/bcc05271499e4f69a3046ff1c21531e3/users/f2630fe813fc403c97cd4332e77dd203/roles/d00eabaec96a4956aaec2c37a5819c25 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:55:36.108277 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434779ee-79f0-4908-82ef-7ff90e629457 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:55:36.108765 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434779ee-79f0-4908-82ef-7ff90e629457 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:55:36.108765 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434779ee-79f0-4908-82ef-7ff90e629457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:55:36.156335 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-434779ee-79f0-4908-82ef-7ff90e629457 None None] MFA Rules not processed for user `f2630fe813fc403c97cd4332e77dd203`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:55:36.157616 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-434779ee-79f0-4908-82ef-7ff90e629457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:55:36.276362 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1457/2919] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:55:36 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:55:36.289534 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7470cae3-ecb4-4662-b181-de427883f7b7 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:55:36.291755 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-7470cae3-ecb4-4662-b181-de427883f7b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:55:36.386674 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7470cae3-ecb4-4662-b181-de427883f7b7 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:55:36.394514 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e65d63f-021d-43d7-82f7-af184da5887e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35441c061e514b1b9341e7694ec2c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:55:36.395858 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65d63f-021d-43d7-82f7-af184da5887e service nova] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:55:36.396148 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65d63f-021d-43d7-82f7-af184da5887e service nova] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:55:36.396416 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65d63f-021d-43d7-82f7-af184da5887e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:55:36.463780 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e65d63f-021d-43d7-82f7-af184da5887e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:55:36.465564 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e65d63f-021d-43d7-82f7-af184da5887e service nova] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:55:36.476570 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1463/2920] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:55:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:55:37.534935 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c4f817-74ad-41d6-b0c6-84a21e239db9 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:55:37.536321 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c4f817-74ad-41d6-b0c6-84a21e239db9 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:55:37.536321 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c4f817-74ad-41d6-b0c6-84a21e239db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:55:37.555262 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-e3c4f817-74ad-41d6-b0c6-84a21e239db9 None None] MFA Rules not processed for user `e3f7118e9a0747e39ad3d1dafd18b1f9`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:55:37.556474 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-e3c4f817-74ad-41d6-b0c6-84a21e239db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:55:37.563311 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1458/2921] 10.222.0.47 () {58 vars in 958 bytes} [Mon Aug 29 22:55:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:55:41.431082 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e65d63f-021d-43d7-82f7-af184da5887e service nova] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:55:41.490283 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e65d63f-021d-43d7-82f7-af184da5887e service nova] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:55:41.493863 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3aa79b-4c8c-4863-b325-b99bcc9fd68b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:55:41.494461 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3aa79b-4c8c-4863-b325-b99bcc9fd68b service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:55:41.494734 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3aa79b-4c8c-4863-b325-b99bcc9fd68b service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:55:41.494998 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3aa79b-4c8c-4863-b325-b99bcc9fd68b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:55:41.496708 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-bd3aa79b-4c8c-4863-b325-b99bcc9fd68b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:55:41.511004 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3aa79b-4c8c-4863-b325-b99bcc9fd68b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:55:41.512427 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3aa79b-4c8c-4863-b325-b99bcc9fd68b service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:55:41.518526 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:55:41.527095 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1464/2922] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:55:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:55:47.544027 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c4f817-74ad-41d6-b0c6-84a21e239db9 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:55:47.548595 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:55:47.557285 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c4f817-74ad-41d6-b0c6-84a21e239db9 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:55:47.562468 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbbd708-9ecb-4010-8acf-9d0550bd39e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:55:47.563154 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbbd708-9ecb-4010-8acf-9d0550bd39e2 service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:55:47.563533 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbbd708-9ecb-4010-8acf-9d0550bd39e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:55:47.563904 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbbd708-9ecb-4010-8acf-9d0550bd39e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:55:47.566206 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-0fbbd708-9ecb-4010-8acf-9d0550bd39e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:55:47.583037 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbbd708-9ecb-4010-8acf-9d0550bd39e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:55:47.584580 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbbd708-9ecb-4010-8acf-9d0550bd39e2 service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:55:47.596788 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1459/2923] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:55:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:55:49.938069 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ceffa-9ec6-481f-b77b-005ec473ccfb None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:55:49.938623 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ceffa-9ec6-481f-b77b-005ec473ccfb None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:55:49.938623 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ceffa-9ec6-481f-b77b-005ec473ccfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:55:49.987829 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-270ceffa-9ec6-481f-b77b-005ec473ccfb None None] MFA Rules not processed for user `e49a4666712746d098ace9e1cb0bf07c`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:55:49.988964 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-270ceffa-9ec6-481f-b77b-005ec473ccfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:55:50.055165 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1465/2924] 10.222.0.47 () {58 vars in 967 bytes} [Mon Aug 29 22:55:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:55:50.104541 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbbd708-9ecb-4010-8acf-9d0550bd39e2 service neutron] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:55:50.106241 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-0fbbd708-9ecb-4010-8acf-9d0550bd39e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:55:50.205181 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbbd708-9ecb-4010-8acf-9d0550bd39e2 service neutron] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:55:50.210471 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0963e68-d8f9-48b9-a703-b949d6581677 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '388d8dea2edf4fb888d42ca878c1434d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:55:50.211075 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0963e68-d8f9-48b9-a703-b949d6581677 service swift] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:55:50.211354 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0963e68-d8f9-48b9-a703-b949d6581677 service swift] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:55:50.211625 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0963e68-d8f9-48b9-a703-b949d6581677 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:55:50.220106 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0963e68-d8f9-48b9-a703-b949d6581677 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:55:50.221793 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0963e68-d8f9-48b9-a703-b949d6581677 service swift] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:55:50.232195 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1460/2925] 10.222.0.47 () {60 vars in 1384 bytes} [Mon Aug 29 22:55:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 22:55:51.622249 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270ceffa-9ec6-481f-b77b-005ec473ccfb None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:55:51.623701 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-270ceffa-9ec6-481f-b77b-005ec473ccfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:55:51.703519 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270ceffa-9ec6-481f-b77b-005ec473ccfb None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:55:51.709207 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c765c9e-6690-4492-8025-46b6e714777d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296cbef772104e078971ba93aa2e022c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:55:51.710354 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c765c9e-6690-4492-8025-46b6e714777d service placement] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:55:51.710907 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c765c9e-6690-4492-8025-46b6e714777d service placement] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:55:51.711543 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c765c9e-6690-4492-8025-46b6e714777d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:55:51.714542 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-2c765c9e-6690-4492-8025-46b6e714777d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:55:51.738627 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c765c9e-6690-4492-8025-46b6e714777d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:55:51.741194 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c765c9e-6690-4492-8025-46b6e714777d service placement] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:55:51.754483 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1466/2926] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:55:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:55:53.867979 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0963e68-d8f9-48b9-a703-b949d6581677 service swift] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:55:53.869676 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-f0963e68-d8f9-48b9-a703-b949d6581677 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:55:53.885564 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0963e68-d8f9-48b9-a703-b949d6581677 service swift] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:55:53.898359 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccc17ab-e72e-4e45-a150-42c0acaded81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:55:53.899111 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc17ab-e72e-4e45-a150-42c0acaded81 service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:55:53.899451 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc17ab-e72e-4e45-a150-42c0acaded81 service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:55:53.899719 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc17ab-e72e-4e45-a150-42c0acaded81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:55:53.902300 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-bccc17ab-e72e-4e45-a150-42c0acaded81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:55:53.917311 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccc17ab-e72e-4e45-a150-42c0acaded81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:55:53.918858 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccc17ab-e72e-4e45-a150-42c0acaded81 service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:55:53.938608 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1461/2927] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:55:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:55:54.631498 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c765c9e-6690-4492-8025-46b6e714777d service placement] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:55:54.634138 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-2c765c9e-6690-4492-8025-46b6e714777d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:55:54.654073 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c765c9e-6690-4492-8025-46b6e714777d service placement] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:55:54.660367 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be534104-5087-4d9c-b471-cf279034e97f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35441c061e514b1b9341e7694ec2c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:55:54.661974 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be534104-5087-4d9c-b471-cf279034e97f service nova] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:55:54.662257 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be534104-5087-4d9c-b471-cf279034e97f service nova] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:55:54.662527 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be534104-5087-4d9c-b471-cf279034e97f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:55:54.664455 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-be534104-5087-4d9c-b471-cf279034e97f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:55:54.678456 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be534104-5087-4d9c-b471-cf279034e97f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:55:54.680367 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be534104-5087-4d9c-b471-cf279034e97f service nova] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:55:54.699131 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1467/2928] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:55:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:55:58.023599 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccc17ab-e72e-4e45-a150-42c0acaded81 service neutron] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:55:58.039012 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccc17ab-e72e-4e45-a150-42c0acaded81 service neutron] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:55:58.044755 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6d4f3-d342-45b9-89c5-aa8f9d3813a3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296cbef772104e078971ba93aa2e022c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:55:58.045418 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6d4f3-d342-45b9-89c5-aa8f9d3813a3 service placement] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:55:58.045706 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6d4f3-d342-45b9-89c5-aa8f9d3813a3 service placement] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:55:58.045983 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6d4f3-d342-45b9-89c5-aa8f9d3813a3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:55:58.047826 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-cbc6d4f3-d342-45b9-89c5-aa8f9d3813a3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:55:58.066153 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc6d4f3-d342-45b9-89c5-aa8f9d3813a3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:55:58.068489 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc6d4f3-d342-45b9-89c5-aa8f9d3813a3 service placement] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:55:58.081479 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1462/2929] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:55:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:55:58.084574 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be534104-5087-4d9c-b471-cf279034e97f service nova] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:55:58.086070 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-be534104-5087-4d9c-b471-cf279034e97f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:55:58.158559 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:55:58.180143 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be534104-5087-4d9c-b471-cf279034e97f service nova] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:55:58.183526 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede9eb09-a379-4cad-bf85-937e3a1c963f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:55:58.184193 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9eb09-a379-4cad-bf85-937e3a1c963f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:55:58.184428 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9eb09-a379-4cad-bf85-937e3a1c963f admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:55:58.184697 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9eb09-a379-4cad-bf85-937e3a1c963f admin admin] PATH_INFO: `/v3/users/b85a9c2ea6214ba592f4677d94dcc0ca` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:55:58.185851 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede9eb09-a379-4cad-bf85-937e3a1c963f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b85a9c2ea6214ba592f4677d94dcc0ca)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:55:58.187753 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede9eb09-a379-4cad-bf85-937e3a1c963f admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:55:58.235519 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-ede9eb09-a379-4cad-bf85-937e3a1c963f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b85a9c2ea6214ba592f4677d94dcc0ca'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:55:58.243725 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-ede9eb09-a379-4cad-bf85-937e3a1c963f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b85a9c2ea6214ba592f4677d94dcc0ca'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:55:58.244344 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-ede9eb09-a379-4cad-bf85-937e3a1c963f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b85a9c2ea6214ba592f4677d94dcc0ca'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:55:58.251936 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-ede9eb09-a379-4cad-bf85-937e3a1c963f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b85a9c2ea6214ba592f4677d94dcc0ca'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:55:58.252253 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-ede9eb09-a379-4cad-bf85-937e3a1c963f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b85a9c2ea6214ba592f4677d94dcc0ca'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:55:58.271266 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1468/2930] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:55:58 2022] DELETE /identity/v3/users/b85a9c2ea6214ba592f4677d94dcc0ca => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:55:58.448952 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6d4f3-d342-45b9-89c5-aa8f9d3813a3 service placement] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:55:58.460319 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6d4f3-d342-45b9-89c5-aa8f9d3813a3 service placement] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:55:58.519027 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33015536-7966-4f25-8f20-e9e96d8b91b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:55:58.519587 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33015536-7966-4f25-8f20-e9e96d8b91b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:55:58.519867 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33015536-7966-4f25-8f20-e9e96d8b91b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:55:58.520739 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33015536-7966-4f25-8f20-e9e96d8b91b9 admin admin] PATH_INFO: `/v3/projects/45a76b747d25436581faddec6a442a27` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:55:58.521955 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33015536-7966-4f25-8f20-e9e96d8b91b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45a76b747d25436581faddec6a442a27)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:55:58.523852 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33015536-7966-4f25-8f20-e9e96d8b91b9 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:55:58.563586 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:55:58.576590 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-33015536-7966-4f25-8f20-e9e96d8b91b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45a76b747d25436581faddec6a442a27', 'request_id': 'req-33015536-7966-4f25-8f20-e9e96d8b91b9'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:55:58.583806 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-33015536-7966-4f25-8f20-e9e96d8b91b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45a76b747d25436581faddec6a442a27', 'request_id': 'req-33015536-7966-4f25-8f20-e9e96d8b91b9'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:55:58.589609 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-33015536-7966-4f25-8f20-e9e96d8b91b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45a76b747d25436581faddec6a442a27', 'request_id': 'req-33015536-7966-4f25-8f20-e9e96d8b91b9'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:55:58.604102 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-33015536-7966-4f25-8f20-e9e96d8b91b9 admin admin] The token cache is being invalidate because project 45a76b747d25436581faddec6a442a27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:55:58.604102 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-33015536-7966-4f25-8f20-e9e96d8b91b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:55:58.604783 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-33015536-7966-4f25-8f20-e9e96d8b91b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:55:58.606351 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1463/2931] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:55:58 2022] DELETE /identity/v3/projects/45a76b747d25436581faddec6a442a27 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:55:58.610560 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede9eb09-a379-4cad-bf85-937e3a1c963f admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:55:58.612061 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-ede9eb09-a379-4cad-bf85-937e3a1c963f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:55:58.625364 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede9eb09-a379-4cad-bf85-937e3a1c963f admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:55:58.684985 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92daf9cf-a6c3-497a-bafc-80961a506d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:55:58.685683 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92daf9cf-a6c3-497a-bafc-80961a506d2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:55:58.685958 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92daf9cf-a6c3-497a-bafc-80961a506d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:55:58.686252 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92daf9cf-a6c3-497a-bafc-80961a506d2e admin admin] PATH_INFO: `/v3/users/877e1c1c464a4b4d87b7ef485a0c7a17` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:55:58.687386 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92daf9cf-a6c3-497a-bafc-80961a506d2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=877e1c1c464a4b4d87b7ef485a0c7a17)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:55:58.689313 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92daf9cf-a6c3-497a-bafc-80961a506d2e admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:55:58.743356 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-92daf9cf-a6c3-497a-bafc-80961a506d2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '877e1c1c464a4b4d87b7ef485a0c7a17'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:55:58.751234 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-92daf9cf-a6c3-497a-bafc-80961a506d2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '877e1c1c464a4b4d87b7ef485a0c7a17'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:55:58.751945 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-92daf9cf-a6c3-497a-bafc-80961a506d2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '877e1c1c464a4b4d87b7ef485a0c7a17'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:55:58.760384 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-92daf9cf-a6c3-497a-bafc-80961a506d2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '877e1c1c464a4b4d87b7ef485a0c7a17'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:55:58.761107 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-92daf9cf-a6c3-497a-bafc-80961a506d2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '877e1c1c464a4b4d87b7ef485a0c7a17'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:55:58.766941 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:55:58.782401 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1469/2932] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:55:58 2022] DELETE /identity/v3/users/877e1c1c464a4b4d87b7ef485a0c7a17 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:55:58.962913 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33015536-7966-4f25-8f20-e9e96d8b91b9 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:55:58.964240 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-33015536-7966-4f25-8f20-e9e96d8b91b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:55:58.979785 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33015536-7966-4f25-8f20-e9e96d8b91b9 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:55:59.054377 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c42be1e-353b-4462-b352-9ebce63ae670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:55:59.055047 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c42be1e-353b-4462-b352-9ebce63ae670 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:55:59.055248 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c42be1e-353b-4462-b352-9ebce63ae670 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:55:59.055735 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c42be1e-353b-4462-b352-9ebce63ae670 admin admin] PATH_INFO: `/v3/projects/21c93015487a42418e2a86ac10129fac` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:55:59.057510 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c42be1e-353b-4462-b352-9ebce63ae670 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21c93015487a42418e2a86ac10129fac)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:55:59.059584 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c42be1e-353b-4462-b352-9ebce63ae670 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:55:59.111202 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-6c42be1e-353b-4462-b352-9ebce63ae670 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21c93015487a42418e2a86ac10129fac', 'request_id': 'req-6c42be1e-353b-4462-b352-9ebce63ae670'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:55:59.118687 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-6c42be1e-353b-4462-b352-9ebce63ae670 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21c93015487a42418e2a86ac10129fac', 'request_id': 'req-6c42be1e-353b-4462-b352-9ebce63ae670'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:55:59.124615 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-6c42be1e-353b-4462-b352-9ebce63ae670 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21c93015487a42418e2a86ac10129fac', 'request_id': 'req-6c42be1e-353b-4462-b352-9ebce63ae670'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:55:59.137719 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-6c42be1e-353b-4462-b352-9ebce63ae670 admin admin] The token cache is being invalidate because project 21c93015487a42418e2a86ac10129fac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:55:59.138014 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-6c42be1e-353b-4462-b352-9ebce63ae670 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:55:59.138871 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-6c42be1e-353b-4462-b352-9ebce63ae670 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:55:59.140413 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1464/2933] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:55:58 2022] DELETE /identity/v3/projects/21c93015487a42418e2a86ac10129fac => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:56:02.819539 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92daf9cf-a6c3-497a-bafc-80961a506d2e admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:56:02.821003 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-92daf9cf-a6c3-497a-bafc-80961a506d2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:02.880106 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92daf9cf-a6c3-497a-bafc-80961a506d2e admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:56:02.929435 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe66d4f4-16a1-4849-9725-4593c26c95aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:56:02.930044 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66d4f4-16a1-4849-9725-4593c26c95aa service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:56:02.930321 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66d4f4-16a1-4849-9725-4593c26c95aa service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:56:02.930590 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66d4f4-16a1-4849-9725-4593c26c95aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:56:02.932376 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-fe66d4f4-16a1-4849-9725-4593c26c95aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:56:02.995927 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe66d4f4-16a1-4849-9725-4593c26c95aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:56:02.997288 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe66d4f4-16a1-4849-9725-4593c26c95aa service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:56:03.006923 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1470/2934] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:56:02 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:56:09.134511 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:DELETE=12,keystone:SELECT=62,keystone:INSERT=2 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:56:13.002539 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=75,keystone:DELETE=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:13.021178 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c42be1e-353b-4462-b352-9ebce63ae670 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:13.022648 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-6c42be1e-353b-4462-b352-9ebce63ae670 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:13.035185 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c42be1e-353b-4462-b352-9ebce63ae670 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:13.038971 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ed91cb-4517-4843-9648-c4815263f567 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:13.039579 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed91cb-4517-4843-9648-c4815263f567 service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:13.039859 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed91cb-4517-4843-9648-c4815263f567 service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:13.040131 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed91cb-4517-4843-9648-c4815263f567 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:13.042193 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-31ed91cb-4517-4843-9648-c4815263f567 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:13.052877 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ed91cb-4517-4843-9648-c4815263f567 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:13.054359 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ed91cb-4517-4843-9648-c4815263f567 service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:13.063543 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1465/2935] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:58:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:58:13.161833 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe66d4f4-16a1-4849-9725-4593c26c95aa service neutron] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:13.163320 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-fe66d4f4-16a1-4849-9725-4593c26c95aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:13.175651 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe66d4f4-16a1-4849-9725-4593c26c95aa service neutron] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:13.180444 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce73f9e-01ae-4336-a538-a463ac378f9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27abbf7b40e54fc091ebfe10aa6da90d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:13.181263 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce73f9e-01ae-4336-a538-a463ac378f9e service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:13.181611 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce73f9e-01ae-4336-a538-a463ac378f9e service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:13.181962 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce73f9e-01ae-4336-a538-a463ac378f9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:13.184197 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-9ce73f9e-01ae-4336-a538-a463ac378f9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:13.259172 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce73f9e-01ae-4336-a538-a463ac378f9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:13.260623 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce73f9e-01ae-4336-a538-a463ac378f9e service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:13.272339 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1471/2936] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:58:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:58:15.271740 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ed91cb-4517-4843-9648-c4815263f567 service neutron] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:15.274989 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-31ed91cb-4517-4843-9648-c4815263f567 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:15.292707 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ed91cb-4517-4843-9648-c4815263f567 service neutron] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:15.299200 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3e0b27-651f-4e2a-a8de-7262d3064b4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35441c061e514b1b9341e7694ec2c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:15.299807 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e0b27-651f-4e2a-a8de-7262d3064b4b service nova] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:15.300081 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e0b27-651f-4e2a-a8de-7262d3064b4b service nova] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:15.300350 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e0b27-651f-4e2a-a8de-7262d3064b4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:15.302137 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-2d3e0b27-651f-4e2a-a8de-7262d3064b4b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:15.315649 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3e0b27-651f-4e2a-a8de-7262d3064b4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:15.317388 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3e0b27-651f-4e2a-a8de-7262d3064b4b service nova] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:15.328383 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1466/2937] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:58:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:58:23.267459 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=34 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:25.323562 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=12 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:42.013237 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce73f9e-01ae-4336-a538-a463ac378f9e service neutron] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:58:42.014667 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-9ce73f9e-01ae-4336-a538-a463ac378f9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:42.085431 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce73f9e-01ae-4336-a538-a463ac378f9e service neutron] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:58:42.090389 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd137c-e1f1-49f3-a805-55020f3c7684 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296cbef772104e078971ba93aa2e022c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:58:42.090992 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd137c-e1f1-49f3-a805-55020f3c7684 service placement] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:58:42.091268 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd137c-e1f1-49f3-a805-55020f3c7684 service placement] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:58:42.091535 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd137c-e1f1-49f3-a805-55020f3c7684 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:58:42.093256 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-e6dd137c-e1f1-49f3-a805-55020f3c7684 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:58:42.105844 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dd137c-e1f1-49f3-a805-55020f3c7684 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:58:42.107430 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dd137c-e1f1-49f3-a805-55020f3c7684 service placement] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:58:42.118373 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1472/2938] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:58:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:58:52.113077 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=32 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:39.587976 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3e0b27-651f-4e2a-a8de-7262d3064b4b service nova] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:39.599566 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3e0b27-651f-4e2a-a8de-7262d3064b4b service nova] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:39.605435 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8804175e-54d9-4290-8283-f4598bd273ad service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296cbef772104e078971ba93aa2e022c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:39.606045 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8804175e-54d9-4290-8283-f4598bd273ad service placement] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:39.606325 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8804175e-54d9-4290-8283-f4598bd273ad service placement] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:39.606595 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8804175e-54d9-4290-8283-f4598bd273ad service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:39.608338 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-8804175e-54d9-4290-8283-f4598bd273ad service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:39.621571 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8804175e-54d9-4290-8283-f4598bd273ad service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:39.623221 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8804175e-54d9-4290-8283-f4598bd273ad service placement] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:39.644281 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1467/2939] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 22:59:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:59:39.646259 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd137c-e1f1-49f3-a805-55020f3c7684 service placement] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:39.649900 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-e6dd137c-e1f1-49f3-a805-55020f3c7684 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:39.725139 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd137c-e1f1-49f3-a805-55020f3c7684 service placement] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:39.730720 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c8ddec-976d-4693-ab10-f268802574dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:39.731353 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8ddec-976d-4693-ab10-f268802574dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:39.731636 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8ddec-976d-4693-ab10-f268802574dc admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:39.731911 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8ddec-976d-4693-ab10-f268802574dc admin admin] PATH_INFO: `/v3/users/e3f7118e9a0747e39ad3d1dafd18b1f9` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:39.733039 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c8ddec-976d-4693-ab10-f268802574dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3f7118e9a0747e39ad3d1dafd18b1f9)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:39.734999 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c8ddec-976d-4693-ab10-f268802574dc admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:39.781180 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-74c8ddec-976d-4693-ab10-f268802574dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3f7118e9a0747e39ad3d1dafd18b1f9'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:39.787920 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-74c8ddec-976d-4693-ab10-f268802574dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3f7118e9a0747e39ad3d1dafd18b1f9'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:39.788625 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-74c8ddec-976d-4693-ab10-f268802574dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3f7118e9a0747e39ad3d1dafd18b1f9'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:39.797917 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-74c8ddec-976d-4693-ab10-f268802574dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3f7118e9a0747e39ad3d1dafd18b1f9'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:39.798531 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-74c8ddec-976d-4693-ab10-f268802574dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3f7118e9a0747e39ad3d1dafd18b1f9'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:39.816205 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1473/2940] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:59:39 2022] DELETE /identity/v3/users/e3f7118e9a0747e39ad3d1dafd18b1f9 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:59:39.992238 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8804175e-54d9-4290-8283-f4598bd273ad service placement] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:40.008902 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8804175e-54d9-4290-8283-f4598bd273ad service placement] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:40.067459 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e835da-ae53-4757-84a6-18515c67dcaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:40.068013 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e835da-ae53-4757-84a6-18515c67dcaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:40.068293 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e835da-ae53-4757-84a6-18515c67dcaa admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:40.068566 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e835da-ae53-4757-84a6-18515c67dcaa admin admin] PATH_INFO: `/v3/projects/16f40d4c73cc4c22adee3f0d589a452d` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:40.069715 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e835da-ae53-4757-84a6-18515c67dcaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=16f40d4c73cc4c22adee3f0d589a452d)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:40.071645 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e835da-ae53-4757-84a6-18515c67dcaa admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:40.117873 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-25e835da-ae53-4757-84a6-18515c67dcaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16f40d4c73cc4c22adee3f0d589a452d', 'request_id': 'req-25e835da-ae53-4757-84a6-18515c67dcaa'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:40.124848 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-25e835da-ae53-4757-84a6-18515c67dcaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16f40d4c73cc4c22adee3f0d589a452d', 'request_id': 'req-25e835da-ae53-4757-84a6-18515c67dcaa'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:40.132500 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-25e835da-ae53-4757-84a6-18515c67dcaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16f40d4c73cc4c22adee3f0d589a452d', 'request_id': 'req-25e835da-ae53-4757-84a6-18515c67dcaa'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:40.147106 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-25e835da-ae53-4757-84a6-18515c67dcaa admin admin] The token cache is being invalidate because project 16f40d4c73cc4c22adee3f0d589a452d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:59:40.147505 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-25e835da-ae53-4757-84a6-18515c67dcaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:40.148243 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-25e835da-ae53-4757-84a6-18515c67dcaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:40.149885 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1468/2941] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:59:39 2022] DELETE /identity/v3/projects/16f40d4c73cc4c22adee3f0d589a452d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:59:40.154419 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c8ddec-976d-4693-ab10-f268802574dc admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:40.155967 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-74c8ddec-976d-4693-ab10-f268802574dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:40.170784 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c8ddec-976d-4693-ab10-f268802574dc admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:40.230556 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19802fa-0ae9-4246-9c98-c4b57c5afd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:40.231198 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19802fa-0ae9-4246-9c98-c4b57c5afd03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:40.231482 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19802fa-0ae9-4246-9c98-c4b57c5afd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:40.231759 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19802fa-0ae9-4246-9c98-c4b57c5afd03 admin admin] PATH_INFO: `/v3/users/f2630fe813fc403c97cd4332e77dd203` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:40.232913 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19802fa-0ae9-4246-9c98-c4b57c5afd03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2630fe813fc403c97cd4332e77dd203)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:40.234984 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19802fa-0ae9-4246-9c98-c4b57c5afd03 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:40.260174 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:40.292481 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-b19802fa-0ae9-4246-9c98-c4b57c5afd03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2630fe813fc403c97cd4332e77dd203'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:40.299991 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-b19802fa-0ae9-4246-9c98-c4b57c5afd03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2630fe813fc403c97cd4332e77dd203'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:40.300679 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-b19802fa-0ae9-4246-9c98-c4b57c5afd03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2630fe813fc403c97cd4332e77dd203'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:40.310375 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-b19802fa-0ae9-4246-9c98-c4b57c5afd03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2630fe813fc403c97cd4332e77dd203'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:40.311193 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-b19802fa-0ae9-4246-9c98-c4b57c5afd03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2630fe813fc403c97cd4332e77dd203'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:40.333925 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1474/2942] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Aug 29 22:59:40 2022] DELETE /identity/v3/users/f2630fe813fc403c97cd4332e77dd203 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:59:40.509503 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e835da-ae53-4757-84a6-18515c67dcaa admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:59:40.510942 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-25e835da-ae53-4757-84a6-18515c67dcaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:59:40.524008 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e835da-ae53-4757-84a6-18515c67dcaa admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:59:40.583664 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e89528e-78a9-40b8-b4de-c6a562593ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2844206a473948fca3069da17e9f5996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ad4679521624f7c95e5cca6de7bc365', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:59:40.584362 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89528e-78a9-40b8-b4de-c6a562593ea7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:59:40.584583 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89528e-78a9-40b8-b4de-c6a562593ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:59:40.584860 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89528e-78a9-40b8-b4de-c6a562593ea7 admin admin] PATH_INFO: `/v3/projects/bcc05271499e4f69a3046ff1c21531e3` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:59:40.586013 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e89528e-78a9-40b8-b4de-c6a562593ea7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcc05271499e4f69a3046ff1c21531e3)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:59:40.588679 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e89528e-78a9-40b8-b4de-c6a562593ea7 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:59:40.610576 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:40.637795 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-1e89528e-78a9-40b8-b4de-c6a562593ea7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcc05271499e4f69a3046ff1c21531e3', 'request_id': 'req-1e89528e-78a9-40b8-b4de-c6a562593ea7'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:40.644098 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-1e89528e-78a9-40b8-b4de-c6a562593ea7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcc05271499e4f69a3046ff1c21531e3', 'request_id': 'req-1e89528e-78a9-40b8-b4de-c6a562593ea7'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:40.650222 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-1e89528e-78a9-40b8-b4de-c6a562593ea7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcc05271499e4f69a3046ff1c21531e3', 'request_id': 'req-1e89528e-78a9-40b8-b4de-c6a562593ea7'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:40.662504 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-1e89528e-78a9-40b8-b4de-c6a562593ea7 admin admin] The token cache is being invalidate because project bcc05271499e4f69a3046ff1c21531e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:59:40.662795 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-1e89528e-78a9-40b8-b4de-c6a562593ea7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:40.663435 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-1e89528e-78a9-40b8-b4de-c6a562593ea7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:59:40.664935 dv-cinder-854270-4-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1469/2943] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Aug 29 22:59:40 2022] DELETE /identity/v3/projects/bcc05271499e4f69a3046ff1c21531e3 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:59:50.328103 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:50.659494 dv-cinder-854270-4-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:03:43.978516 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19802fa-0ae9-4246-9c98-c4b57c5afd03 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:03:43.980100 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-b19802fa-0ae9-4246-9c98-c4b57c5afd03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:03:44.118557 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19802fa-0ae9-4246-9c98-c4b57c5afd03 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:03:44.177883 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28f216a-13c8-4c5a-83dd-9a1075ff76f5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296cbef772104e078971ba93aa2e022c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce09f0beb1a342febbb4a8b3c7cf60c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:03:44.178496 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f216a-13c8-4c5a-83dd-9a1075ff76f5 service placement] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:03:44.178776 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f216a-13c8-4c5a-83dd-9a1075ff76f5 service placement] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:03:44.179050 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f216a-13c8-4c5a-83dd-9a1075ff76f5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:03:44.180811 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-c28f216a-13c8-4c5a-83dd-9a1075ff76f5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:03:44.193075 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28f216a-13c8-4c5a-83dd-9a1075ff76f5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:03:44.194718 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28f216a-13c8-4c5a-83dd-9a1075ff76f5 service placement] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:03:44.204828 dv-cinder-854270-4-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1475/2944] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Aug 29 23:03:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:03:54.200406 dv-cinder-854270-4-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=89 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}